-- Logs begin at Mon 2022-07-25 11:32:00 UTC, end at Mon 2022-07-25 12:33:32 UTC. -- Jul 25 12:00:26.588678 dv-cinder-797608-61-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 12:00:26.597514 dv-cinder-797608-61-smb devstack@keystone.service[80305]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 12:00:26.599574 dv-cinder-797608-61-smb devstack@keystone.service[80305]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 12:00:26 2022] *** Jul 25 12:00:26.599574 dv-cinder-797608-61-smb devstack@keystone.service[80305]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 12:00:26.599574 dv-cinder-797608-61-smb devstack@keystone.service[80305]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 12:00:26.599574 dv-cinder-797608-61-smb devstack@keystone.service[80305]: nodename: dv-cinder-797608-61-smb Jul 25 12:00:26.599574 dv-cinder-797608-61-smb devstack@keystone.service[80305]: machine: x86_64 Jul 25 12:00:26.599574 dv-cinder-797608-61-smb devstack@keystone.service[80305]: clock source: unix Jul 25 12:00:26.599574 dv-cinder-797608-61-smb devstack@keystone.service[80305]: pcre jit disabled Jul 25 12:00:26.599574 dv-cinder-797608-61-smb devstack@keystone.service[80305]: detected number of CPU cores: 4 Jul 25 12:00:26.599574 dv-cinder-797608-61-smb devstack@keystone.service[80305]: current working directory: / Jul 25 12:00:26.599574 dv-cinder-797608-61-smb devstack@keystone.service[80305]: detected binary path: /usr/bin/uwsgi-core Jul 25 12:00:26.600085 dv-cinder-797608-61-smb devstack@keystone.service[80305]: your processes number limit is 47680 Jul 25 12:00:26.600085 dv-cinder-797608-61-smb devstack@keystone.service[80305]: your memory page size is 4096 bytes Jul 25 12:00:26.600085 dv-cinder-797608-61-smb devstack@keystone.service[80305]: detected max file descriptor number: 2048 Jul 25 12:00:26.600085 dv-cinder-797608-61-smb devstack@keystone.service[80305]: lock engine: pthread robust mutexes Jul 25 12:00:26.600085 dv-cinder-797608-61-smb devstack@keystone.service[80305]: thunder lock: enabled Jul 25 12:00:26.600085 dv-cinder-797608-61-smb devstack@keystone.service[80305]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 12:00:26.600085 dv-cinder-797608-61-smb devstack@keystone.service[80305]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 12:00:26.638226 dv-cinder-797608-61-smb devstack@keystone.service[80305]: Python main interpreter initialized at 0x56468cd989c0 Jul 25 12:00:26.638226 dv-cinder-797608-61-smb devstack@keystone.service[80305]: python threads support enabled Jul 25 12:00:26.638226 dv-cinder-797608-61-smb devstack@keystone.service[80305]: your server socket listen backlog is limited to 100 connections Jul 25 12:00:26.638226 dv-cinder-797608-61-smb devstack@keystone.service[80305]: your mercy for graceful operations on workers is 90 seconds Jul 25 12:00:26.638540 dv-cinder-797608-61-smb devstack@keystone.service[80305]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 12:00:26.638618 dv-cinder-797608-61-smb devstack@keystone.service[80305]: *** Operational MODE: preforking *** Jul 25 12:00:26.638882 dv-cinder-797608-61-smb devstack@keystone.service[80305]: *** uWSGI is running in multiple interpreter mode *** Jul 25 12:00:26.638882 dv-cinder-797608-61-smb devstack@keystone.service[80305]: spawned uWSGI master process (pid: 80305) Jul 25 12:00:26.639069 dv-cinder-797608-61-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 25 12:00:26.640131 dv-cinder-797608-61-smb devstack@keystone.service[80305]: spawned uWSGI worker 1 (pid: 80316, cores: 1) Jul 25 12:00:26.640131 dv-cinder-797608-61-smb devstack@keystone.service[80305]: spawned uWSGI worker 2 (pid: 80317, cores: 1) Jul 25 12:00:26.640131 dv-cinder-797608-61-smb devstack@keystone.service[80305]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 12:00:32.068894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:00:32.068894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: from cryptography.utils import int_from_bytes Jul 25 12:00:32.069682 dv-cinder-797608-61-smb devstack@keystone.service[80317]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:00:32.069682 dv-cinder-797608-61-smb devstack@keystone.service[80317]: from cryptography.utils import int_from_bytes Jul 25 12:00:32.069977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:00:32.069977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: from cryptography.utils import int_from_bytes Jul 25 12:00:32.070453 dv-cinder-797608-61-smb devstack@keystone.service[80316]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:00:32.070453 dv-cinder-797608-61-smb devstack@keystone.service[80316]: from cryptography.utils import int_from_bytes Jul 25 12:00:32.118563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 12:00:32.118752 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 12:00:32.118944 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] command line args: [] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 12:00:32.119213 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 12:00:32.119389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ================================================================================ {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 12:00:32.119471 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 12:00:32.119625 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 12:00:32.119711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] admin_token = **** {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.119820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] command line args: [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 12:00:32.119905 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] config_dir = [] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.120042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.120142 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 12:00:32.120214 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] config_source = [] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.120278 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ================================================================================ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 12:00:32.120388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] debug = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.120517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] admin_token = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.120596 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.120839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] config_dir = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.120903 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.120965 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.121178 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] config_source = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.121267 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.121335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] debug = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.121394 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.121449 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.121641 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.121721 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.121787 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] list_limit = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.121850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.122112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] log_config_append = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.122206 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.122266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.122322 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] log_dir = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.122387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.122556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] log_file = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.122641 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.122705 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.122767 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_config_append = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.122907 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.123001 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.123075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_dir = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.123169 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.123286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.123417 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.123516 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.123599 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.123673 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.123749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.123920 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.124010 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.124153 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.124241 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.124323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.124425 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.124509 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.124656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.124777 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.124873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.124996 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.125110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.125195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.125355 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.125445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.125600 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.125728 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.125842 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.125926 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.126114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.126366 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.126444 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.126571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] publish_errors = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.126651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.126758 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.126987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.127113 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.127201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.127281 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] publish_errors = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.127393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.127517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.127625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.127749 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.127846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] standard_threads = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.127926 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.128073 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.128151 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.128313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.128444 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.128518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.128587 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] standard_threads = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.128655 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] use_journal = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.128808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] use_json = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.128886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.128975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] use_stderr = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.129052 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.129128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] use_syslog = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.129204 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.129356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.129441 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_journal = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.129548 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_json = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.129625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.129725 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_stderr = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.129836 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.129914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_syslog = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.130122 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.130216 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:00:32.130363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.130441 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.130611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.130691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.130847 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.130933 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.131094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.131177 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.131329 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.131413 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.131568 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.131653 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.131811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.131888 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.132048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.132124 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.132278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.132363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.132525 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.132603 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.132759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.132836 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.132993 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.133081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.133237 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.133315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.133498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.133575 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.133745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.133905 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.133986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.134122 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.134248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.134326 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.134492 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.134582 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.134748 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.134832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.134993 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.135069 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.135231 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.135317 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.135485 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.135562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.135718 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.135795 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.135947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.136033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.136176 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.136262 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.136411 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.136493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.136660 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.136739 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.136891 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.136969 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.137126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.137204 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.137355 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.137440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.137600 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.137677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.137835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.137912 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.138091 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.138184 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.138344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.138421 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.138573 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.138650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.138807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.138888 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.139041 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.139119 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.139270 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.139348 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.139493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.139572 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.139714 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.139792 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.139941 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.140025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.140177 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.140262 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.140409 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.140486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.140637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.140713 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.140872 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.140951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.141101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.141177 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.141335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.141468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.141554 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.141632 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.141794 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.141871 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.142041 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.142149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.142262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.142367 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.142494 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.142614 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.142712 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.142838 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.142948 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.143057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.143168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.143291 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.143412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.143498 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.143618 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.143699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.143856 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.143977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.144090 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.144178 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.144321 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.144413 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.144573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.144660 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.144806 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.144927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.145034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.145126 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.145274 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.145369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.145509 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.145592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.145743 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.145872 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.145985 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.146126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.146244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.146330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.146490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.146577 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.146727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.146805 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.146960 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.147042 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.147194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.147289 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.147437 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.147515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.147670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.147752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.147906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.148000 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.148147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.148224 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.148381 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.148465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.148617 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.148704 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.148852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.148932 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.149110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.149188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.149344 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.149432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.149581 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.149658 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.149822 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.149900 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.150083 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.150177 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.150321 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.150399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.150561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.150640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.150797 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.150951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.151026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.151102 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.151254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.151333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.151484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.151571 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.151713 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.151804 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.151941 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.152021 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.152173 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.152250 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.152399 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.152485 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.152630 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.152707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.152863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.152940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.153093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.153173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.153328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.153406 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.153566 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.153644 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.153819 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.153899 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.154076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.154157 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.154309 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] auth.external = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.154400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.154540 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.154621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.154815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.154894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.155051 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.external = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.155139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.155282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] auth.password = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.155370 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.155513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] auth.token = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.155594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.155753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.155832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.155990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.156070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.password = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.156235 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.156316 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.token = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.156468 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.156547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.156707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.156785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.156952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.157033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.157180 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.157261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.157415 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] credential.caching = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.157494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.157660 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.157742 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.157894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.157972 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.158159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.158240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.158395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.158475 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.158637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.158722 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.158871 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.158950 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.159113 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.159192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.159367 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.159446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.159599 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.159677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.159876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.159971 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.160107 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.160185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.160350 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.160429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.160609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.160690 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.160848 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.160927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.161104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.161183 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.161338 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] federation.caching = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.161418 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.161574 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.161653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.161818 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.161897 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.162086 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.162170 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.162319 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.162398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.162566 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.162645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.162803 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.162884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.163036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.163114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.163280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.163358 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.163520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.163600 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.163757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.163835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.164003 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.164092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.164499 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] identity.caching = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.165067 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.165263 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.165342 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.165511 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.165672 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.165749 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.165819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.165974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.166077 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.166244 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.166335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.166476 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.166555 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.166714 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.166791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.166958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.167044 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.167191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.167269 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.167427 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.167505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.167658 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.167745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.167887 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.167974 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.168129 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.168209 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.168360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.168446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.168596 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.168675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.168844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.168922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.169086 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.169172 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.169333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.169445 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.169580 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.169666 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.169789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.169918 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.170046 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.170129 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.170287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.170367 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.170517 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.170609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.170752 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.170832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.170990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.171075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.171226 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.171314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.171461 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.171545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.171689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.171773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.171935 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.172021 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.172176 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.172254 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.172409 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.172488 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.172649 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.172736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.172892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.172971 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.173119 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.173198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.173354 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.173705 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.173788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.173859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.173928 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.174182 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.174274 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.174361 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.174442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.174516 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.174586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.174657 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.174733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.174814 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.174952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.175033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.175195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.175273 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.175420 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.175507 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.175653 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.175733 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.175899 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.175979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.176129 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.176216 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.176363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.176442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.176595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.176673 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.176829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.176911 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.177059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.177138 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.177296 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.177374 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.177536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.177617 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.177768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.177846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.178020 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.178102 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.178270 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.178351 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.178508 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.178586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.178738 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.178817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.178967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.179048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.179199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.179278 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.179431 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.179510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.179665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.179746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.179892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.179972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.180128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.180206 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.180945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.181038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.181181 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.181262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.181434 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.181513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.181687 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.181767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.181938 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.182035 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.182227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.182305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.182465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.182547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.182702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.182782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.182937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.183016 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.183172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.183253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.183415 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.183496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.183662 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.183741 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.183898 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.183980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.184152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.184231 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.184382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.184466 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.184624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.184705 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.184859 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.184938 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.185091 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.185170 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.185326 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.185407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.185566 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.185644 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.185805 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.185882 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.186057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.186153 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.186297 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.186377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.186537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] resource.caching = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.186616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.186770 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.186850 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.187018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.187097 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.187255 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.187333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.187502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.187582 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.187750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.187828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.187982 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.188059 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.188227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.188307 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.188463 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.188542 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.188703 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.188781 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.188930 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] role.caching = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.189004 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.189167 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] role.driver = sql {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.189247 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.189396 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.189475 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.189634 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] role.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.189713 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.189877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.189955 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] role.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.190132 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.190211 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.190387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.190469 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.190630 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.190708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.190874 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.190961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.191120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.191199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.191365 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.191444 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.191594 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.191680 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.191838 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.191918 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.192083 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.192162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.192315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.192401 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.192559 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.192638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.192805 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.192950 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.193053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.193187 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.193302 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.193436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.193683 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.193761 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.193923 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.194041 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.194194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.194274 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.194430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.194511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.194680 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.194771 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.194930 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.195009 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.195164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.195242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.195391 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.195478 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.195627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.195706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.195896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.195979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.196141 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.196221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.196376 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.196456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.196611 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.196691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.196850 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.196930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.197085 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.197164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.197315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.197393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.197550 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] token.caching = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.197632 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.197786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.197865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.198042 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.198124 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.198278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.198359 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.198516 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.198598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.198765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.198843 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.198999 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.199079 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.199241 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.199320 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.199480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.199560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.199717 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.199797 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.199949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.200027 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.200187 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.200266 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.200421 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.200502 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.200662 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.200740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.200905 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.200984 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.201131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.201211 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.201373 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.201451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.201620 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.201698 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.201854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.201934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.connection = **** {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.202123 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.202215 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.202397 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.202476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.202633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.202724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.202873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.202966 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.203106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.203185 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.203341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.203420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.203575 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.203662 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.203808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.203888 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.204051 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.204130 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.204283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.204374 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.204519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.204616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.204751 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.204835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.204994 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.205083 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.205228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.205308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.205463 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.205541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.205696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.205783 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.205936 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.206034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.206195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.206285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.206360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 12:00:32.206440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.206668 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.206907 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:00:32.207080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 12:00:32.236063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.236294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.236518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.236602 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.236760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.236989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.244902 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.245343 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.274569 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.274802 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.275109 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.275343 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.326227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.327059 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.375808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.376036 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.377328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.377568 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.439637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.439842 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.439930 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.440072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.440174 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.440291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.440372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.440507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.440590 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.440722 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.440820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.440947 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.464029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.464247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.464400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.464565 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.464712 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.464852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.464992 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.465128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.465276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.465428 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.465567 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.465704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.465840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.465840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.476651 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.477167 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.489483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.489713 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.489856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.489995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.490140 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.490263 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.490385 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.490518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.490643 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.490764 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.490885 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.491006 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.491128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.491128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:00:32.507818 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.508026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 12:00:32.508154 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.508375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 12:00:32.508511 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.508634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 12:00:32.508754 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.508874 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.508995 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 12:00:32.509124 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.509253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.509380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.509534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.509671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.509753 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.509921 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.520270 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.520542 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.520734 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.520859 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.520993 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.521116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.521244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.521527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.529737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.530353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.533004 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.533277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.533551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.533674 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.533823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.533957 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.534127 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.534262 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.534391 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.534517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.534652 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.534779 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.534905 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.535030 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.535155 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.535281 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.535423 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.535550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.535686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.535813 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.535978 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.536246 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.564104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.565000 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.565694 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.565967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.566643 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.566922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.571714 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.572097 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.572377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.572698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.573092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.573377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.579656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.579888 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.580663 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.580942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.584329 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.584613 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.584892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.585165 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.585414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.585496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.585684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.585764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.585945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.586045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.586233 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.586314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.587057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.587339 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.587611 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.587878 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.605332 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.605602 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.606680 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.606961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.610142 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.611511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.613843 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.614258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.615196 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.615594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.619241 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.620634 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.622826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.624242 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.626446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.626751 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.627031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.627310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.627581 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.627853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.627940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.628176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.628464 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.628751 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.629039 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.629334 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.647195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.647472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.647734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.647990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.648794 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.649616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.649884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.650169 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.656430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.658107 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.658193 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.658387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.659813 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.660090 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.661524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.661807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.662116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.662394 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.662666 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.663295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.663579 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.663860 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.664142 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.664722 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.676309 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.676585 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.676863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.677140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.677508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.677798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.678028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.678112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.678308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.678597 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.678878 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.679251 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.679528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.679806 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.695739 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.698168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.699490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.701418 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.702772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.704501 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.704776 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.706145 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.706422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.706537 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.706701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.708183 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.708465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.708750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.714492 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.716272 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.716700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.718355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.719506 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.719792 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.720180 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.720471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.721580 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.721866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.722283 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.722564 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.729463 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.729746 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.730106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.731655 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.731942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.732220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.737878 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.738176 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.738452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.738722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.738992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.739364 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.739634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.739910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.740092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:00:32.740182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.740378 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.740467 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.740659 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.740757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.740934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.741022 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.741208 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.741347 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.741467 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.741565 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.741845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.742155 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.742431 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.742731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.743015 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.743279 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.743566 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.743833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:00:32.782724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56468cd989c0 pid: 80316 (default app) Jul 25 12:00:32.782819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56468cd989c0 pid: 80317 (default app) Jul 25 12:00:32.786123 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87cc59-d963-48d5-a469-dae2dd0f20d6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:32.786421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87cc59-d963-48d5-a469-dae2dd0f20d6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:32.786701 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87cc59-d963-48d5-a469-dae2dd0f20d6 None None] PATH_INFO: `/v3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:32.791191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Mon Jul 25 12:00:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:00:40.340993 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad216d-9772-490f-ac1a-6ffffd4f8e3f None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:40.341553 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad216d-9772-490f-ac1a-6ffffd4f8e3f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:40.341553 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad216d-9772-490f-ac1a-6ffffd4f8e3f None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:40.345792 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:00:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:00:40.351017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e00154-194d-43ab-bb6b-d4442d850770 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:40.351421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e00154-194d-43ab-bb6b-d4442d850770 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:40.351574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e00154-194d-43ab-bb6b-d4442d850770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:40.421975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: INFO dbcounter [None req-44e00154-194d-43ab-bb6b-d4442d850770 None None] Registered counter for database keystone Jul 25 12:00:40.443505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG oslo_db.sqlalchemy.engines [None req-44e00154-194d-43ab-bb6b-d4442d850770 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:00:40.450270 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writer thread running {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:00:40.630273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG passlib.handlers.bcrypt [None req-44e00154-194d-43ab-bb6b-d4442d850770 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80316) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 12:00:40.630598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG passlib.handlers.bcrypt [None req-44e00154-194d-43ab-bb6b-d4442d850770 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80316) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 12:00:40.684949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-44e00154-194d-43ab-bb6b-d4442d850770 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:00:40.686576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-44e00154-194d-43ab-bb6b-d4442d850770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:00:40.807866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:00:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 25 12:00:40.935545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad216d-9772-490f-ac1a-6ffffd4f8e3f None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:41.004787 dv-cinder-797608-61-smb devstack@keystone.service[80317]: INFO dbcounter [None req-e0ad216d-9772-490f-ac1a-6ffffd4f8e3f None None] Registered counter for database keystone Jul 25 12:00:41.023881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG oslo_db.sqlalchemy.engines [None req-e0ad216d-9772-490f-ac1a-6ffffd4f8e3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:00:41.030008 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writer thread running {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:00:41.149239 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad216d-9772-490f-ac1a-6ffffd4f8e3f None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:41.153450 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f6f90-2b60-41d8-89e0-1269e6e4762f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:41.154139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f6f90-2b60-41d8-89e0-1269e6e4762f admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:41.154423 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f6f90-2b60-41d8-89e0-1269e6e4762f admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:41.154697 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f6f90-2b60-41d8-89e0-1269e6e4762f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:41.162923 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f6f90-2b60-41d8-89e0-1269e6e4762f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:41.213700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: WARNING keystone.common.rbac_enforcer.enforcer [None req-764f6f90-2b60-41d8-89e0-1269e6e4762f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 12:00:41.213978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f6f90-2b60-41d8-89e0-1269e6e4762f admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:41.223392 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Mon Jul 25 12:00:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 12:00:41.230098 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e00154-194d-43ab-bb6b-d4442d850770 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:41.244405 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e00154-194d-43ab-bb6b-d4442d850770 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:41.248843 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e4fe4-07e2-4c94-a130-d93177c76dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:41.249955 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e4fe4-07e2-4c94-a130-d93177c76dad admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:41.250277 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e4fe4-07e2-4c94-a130-d93177c76dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:41.250557 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e4fe4-07e2-4c94-a130-d93177c76dad admin admin] PATH_INFO: `/v3/projects/41f6b44ea8df423598fdb5ab7cad5172` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:41.252092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e4fe4-07e2-4c94-a130-d93177c76dad admin admin] RBAC: Authorizing `identity:get_project(project_id=41f6b44ea8df423598fdb5ab7cad5172)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:41.304682 dv-cinder-797608-61-smb devstack@keystone.service[80316]: WARNING keystone.common.rbac_enforcer.enforcer [None req-319e4fe4-07e2-4c94-a130-d93177c76dad admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 12:00:41.305031 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e4fe4-07e2-4c94-a130-d93177c76dad admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:41.310507 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Mon Jul 25 12:00:41 2022] GET /identity/v3/projects/41f6b44ea8df423598fdb5ab7cad5172 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:00:43.264562 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b0b39-e873-4cd5-ba6e-edc7cb2cd381 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:43.265095 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b0b39-e873-4cd5-ba6e-edc7cb2cd381 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:43.265095 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b0b39-e873-4cd5-ba6e-edc7cb2cd381 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:43.269225 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:00:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:00:43.274511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d8ed7-91dd-4a4a-b322-3672ca2df5b5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:43.274891 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d8ed7-91dd-4a4a-b322-3672ca2df5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:43.275065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d8ed7-91dd-4a4a-b322-3672ca2df5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:43.295417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-666d8ed7-91dd-4a4a-b322-3672ca2df5b5 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:00:43.296925 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-666d8ed7-91dd-4a4a-b322-3672ca2df5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:00:43.304683 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:00:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 12:00:43.326258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b0b39-e873-4cd5-ba6e-edc7cb2cd381 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:43.338440 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b0b39-e873-4cd5-ba6e-edc7cb2cd381 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:43.342673 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2509b-0960-4b04-b480-c0024cc69143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:43.343304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2509b-0960-4b04-b480-c0024cc69143 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:43.343586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2509b-0960-4b04-b480-c0024cc69143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:43.343860 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2509b-0960-4b04-b480-c0024cc69143 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:43.351477 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2509b-0960-4b04-b480-c0024cc69143 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:43.353744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2509b-0960-4b04-b480-c0024cc69143 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:43.362492 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Mon Jul 25 12:00:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:00:43.367743 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d8ed7-91dd-4a4a-b322-3672ca2df5b5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:43.377217 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d8ed7-91dd-4a4a-b322-3672ca2df5b5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:43.381556 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47706dee-05fc-4673-be39-8c07286e8f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:43.382499 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47706dee-05fc-4673-be39-8c07286e8f3c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:43.382824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47706dee-05fc-4673-be39-8c07286e8f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:43.383102 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47706dee-05fc-4673-be39-8c07286e8f3c admin admin] PATH_INFO: `/v3/users/2482f101e58a43bca5e9411a6d355e61` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:43.384528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47706dee-05fc-4673-be39-8c07286e8f3c admin admin] RBAC: Authorizing `identity:get_user(user_id=2482f101e58a43bca5e9411a6d355e61)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:43.386390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47706dee-05fc-4673-be39-8c07286e8f3c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:43.387964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Mon Jul 25 12:00:43 2022] GET /identity/v3/users/2482f101e58a43bca5e9411a6d355e61 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:00:45.422394 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079838e-1971-4803-9b75-d1c5104ff7c5 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:45.422904 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079838e-1971-4803-9b75-d1c5104ff7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:45.423007 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079838e-1971-4803-9b75-d1c5104ff7c5 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:45.424322 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:00:45.430187 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28c94b-959b-4a74-9be9-93375a7cbd4e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:45.431178 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28c94b-959b-4a74-9be9-93375a7cbd4e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:45.431407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28c94b-959b-4a74-9be9-93375a7cbd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:45.449345 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3f28c94b-959b-4a74-9be9-93375a7cbd4e None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:00:45.450549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3f28c94b-959b-4a74-9be9-93375a7cbd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:00:45.473163 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e7f1c-cdbf-4bce-9aef-60615228885a None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:45.473456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e7f1c-cdbf-4bce-9aef-60615228885a None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:45.473736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e7f1c-cdbf-4bce-9aef-60615228885a None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:45.475150 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:00:45.481051 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7a311-618d-4af4-93af-0690ab81d399 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:45.481339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7a311-618d-4af4-93af-0690ab81d399 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:45.481620 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7a311-618d-4af4-93af-0690ab81d399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:45.524035 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG passlib.handlers.bcrypt [None req-3ed7a311-618d-4af4-93af-0690ab81d399 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80317) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 12:00:45.524480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG passlib.handlers.bcrypt [None req-3ed7a311-618d-4af4-93af-0690ab81d399 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80317) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 12:00:45.531127 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:00:45.554644 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28c94b-959b-4a74-9be9-93375a7cbd4e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:45.570826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-3ed7a311-618d-4af4-93af-0690ab81d399 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:00:45.572459 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-3ed7a311-618d-4af4-93af-0690ab81d399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:00:45.578339 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:45.661018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28c94b-959b-4a74-9be9-93375a7cbd4e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:45.670868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:00:45.692583 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7a311-618d-4af4-93af-0690ab81d399 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:45.696862 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdc028-8970-485a-87a1-d5e44d7b6c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:45.697663 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdc028-8970-485a-87a1-d5e44d7b6c01 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:45.697951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdc028-8970-485a-87a1-d5e44d7b6c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:45.698263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdc028-8970-485a-87a1-d5e44d7b6c01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:45.709830 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdc028-8970-485a-87a1-d5e44d7b6c01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:00:45.721519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8acdc028-8970-485a-87a1-d5e44d7b6c01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:00:45.721519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:00:45.721519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:00:45.721519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:00:45.721519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:00:45.721519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:00:45.721519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:00:45.721519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:00:45.721519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:00:45.721519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:00:45.721519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:00:45.721519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:00:45.721519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:00:45.721519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:00:45.721519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:00:45.721519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:00:45.722573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:00:45.722573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:00:45.722573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:00:45.722573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:00:45.722573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:00:45.722573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:00:45.722573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:00:45.722573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:00:45.722573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:00:45.722573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:00:45.722573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:00:45.722573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:00:45.722573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:00:45.722573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:00:45.722573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:00:45.722573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:00:45.723390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:00:45.723390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:00:45.723390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:00:45.723390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:00:45.723390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:00:45.723390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:00:45.723390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:00:45.723390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:00:45.723390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:00:45.723390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:00:45.723390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:00:45.723390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:00:45.723390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:00:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:00:45.730663 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdc028-8970-485a-87a1-d5e44d7b6c01 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:45.794436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7a311-618d-4af4-93af-0690ab81d399 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:45.796713 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:45.811548 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:45.830186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdc028-8970-485a-87a1-d5e44d7b6c01 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:45.834435 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838c8cc-7d37-45fc-8aa7-fc879aed897c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:45.835332 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838c8cc-7d37-45fc-8aa7-fc879aed897c None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:45.835617 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838c8cc-7d37-45fc-8aa7-fc879aed897c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:45.835891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838c8cc-7d37-45fc-8aa7-fc879aed897c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:45.864497 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86774617-1312-4e9c-a2a4-71d53183a778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:45.865161 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86774617-1312-4e9c-a2a4-71d53183a778 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:45.865443 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86774617-1312-4e9c-a2a4-71d53183a778 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:45.865717 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86774617-1312-4e9c-a2a4-71d53183a778 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:45.866503 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86774617-1312-4e9c-a2a4-71d53183a778 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:00:45.866814 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86774617-1312-4e9c-a2a4-71d53183a778 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:45.868214 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86774617-1312-4e9c-a2a4-71d53183a778 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:45.879705 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:00:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:00:45.885650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86774617-1312-4e9c-a2a4-71d53183a778 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:45.903901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838c8cc-7d37-45fc-8aa7-fc879aed897c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:45.905414 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838c8cc-7d37-45fc-8aa7-fc879aed897c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:45.984411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86774617-1312-4e9c-a2a4-71d53183a778 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:46.002575 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:00:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 12:00:46.008217 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838c8cc-7d37-45fc-8aa7-fc879aed897c None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:46.011238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:46.017830 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f8f0c-4941-4e10-a96c-a4dd8943535f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:46.018740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f8f0c-4941-4e10-a96c-a4dd8943535f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:46.019024 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f8f0c-4941-4e10-a96c-a4dd8943535f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:46.019296 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f8f0c-4941-4e10-a96c-a4dd8943535f None admin] PATH_INFO: `/v3/users/2482f101e58a43bca5e9411a6d355e61` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:46.020507 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f8f0c-4941-4e10-a96c-a4dd8943535f None admin] RBAC: Authorizing `identity:get_user(user_id=2482f101e58a43bca5e9411a6d355e61)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:46.021968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f8f0c-4941-4e10-a96c-a4dd8943535f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:46.023611 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:00:45 2022] GET /identity/v3/users/2482f101e58a43bca5e9411a6d355e61 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:00:46.029338 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f8f0c-4941-4e10-a96c-a4dd8943535f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:46.044443 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:46.105831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838c8cc-7d37-45fc-8aa7-fc879aed897c None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:46.126543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f8f0c-4941-4e10-a96c-a4dd8943535f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:46.138573 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cd017-5dd0-46c6-8c4c-78fe152d7e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:46.139369 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cd017-5dd0-46c6-8c4c-78fe152d7e2e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:46.139651 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cd017-5dd0-46c6-8c4c-78fe152d7e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:46.139928 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cd017-5dd0-46c6-8c4c-78fe152d7e2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:46.158348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cd017-5dd0-46c6-8c4c-78fe152d7e2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:46.159809 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cd017-5dd0-46c6-8c4c-78fe152d7e2e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:46.159908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced43815-46b1-4968-8160-3b4f08251b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:46.160690 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced43815-46b1-4968-8160-3b4f08251b9f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:46.160974 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced43815-46b1-4968-8160-3b4f08251b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:46.161248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced43815-46b1-4968-8160-3b4f08251b9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:46.162460 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced43815-46b1-4968-8160-3b4f08251b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:46.163896 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced43815-46b1-4968-8160-3b4f08251b9f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:46.165769 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 10/18] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:00:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:00:46.171434 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced43815-46b1-4968-8160-3b4f08251b9f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:46.180777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-2a9cd017-5dd0-46c6-8c4c-78fe152d7e2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:00:46.180777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:00:46.180777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:00:46.180777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:00:46.180777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:00:46.180777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:00:46.180777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:00:46.180777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:00:46.180777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:00:46.180777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:00:46.180777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:00:46.180777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:00:46.180777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:00:46.180777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:00:46.180777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:00:46.181561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:00:46.181561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:00:46.181561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:00:46.181561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:00:46.181561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:00:46.181561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:00:46.181561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:00:46.181561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:00:46.181561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:00:46.181561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:00:46.181561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:00:46.181561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:00:46.181561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:00:46.181561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:00:46.181561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:00:46.181561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:00:46.181561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:00:46.182664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:00:46.182664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:00:46.182664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:00:46.182664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:00:46.182664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 9/19] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:00:46.187660 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cd017-5dd0-46c6-8c4c-78fe152d7e2e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:46.242716 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:46.289635 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cd017-5dd0-46c6-8c4c-78fe152d7e2e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:46.326160 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b632dd-4b77-469b-b504-22409f2cca12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:46.326842 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b632dd-4b77-469b-b504-22409f2cca12 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:46.327127 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b632dd-4b77-469b-b504-22409f2cca12 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:46.327402 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b632dd-4b77-469b-b504-22409f2cca12 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:46.328154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b632dd-4b77-469b-b504-22409f2cca12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:00:46.328462 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b632dd-4b77-469b-b504-22409f2cca12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:46.329895 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b632dd-4b77-469b-b504-22409f2cca12 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:46.349200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 10/20] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:00:46.357244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:46.378377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced43815-46b1-4968-8160-3b4f08251b9f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:46.415688 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852f14c-997c-451f-b493-3e1d87d00fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:46.416365 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852f14c-997c-451f-b493-3e1d87d00fce None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:46.416650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852f14c-997c-451f-b493-3e1d87d00fce None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:46.416924 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852f14c-997c-451f-b493-3e1d87d00fce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:46.417825 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852f14c-997c-451f-b493-3e1d87d00fce None admin] RBAC: Adding query filter params (role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.domain.id=default, user.id=2482f101e58a43bca5e9411a6d355e61) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:00:46.418173 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852f14c-997c-451f-b493-3e1d87d00fce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:46.419656 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852f14c-997c-451f-b493-3e1d87d00fce None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:46.427307 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 11/21] 10.222.0.48 () {56 vars in 1322 bytes} [Mon Jul 25 12:00:46 2022] GET /identity/v3/role_assignments?user.id=2482f101e58a43bca5e9411a6d355e61&scope.domain.id=default&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 233 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:00:48.641397 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ab78-2e1e-4dd2-9bf5-a746b4ae0f94 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:48.642435 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ab78-2e1e-4dd2-9bf5-a746b4ae0f94 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:48.642921 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ab78-2e1e-4dd2-9bf5-a746b4ae0f94 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:48.644765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 11/22] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:00:48.650482 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceae50f-b600-414e-bc7a-7971e73141be None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:48.651356 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceae50f-b600-414e-bc7a-7971e73141be None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:48.651832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceae50f-b600-414e-bc7a-7971e73141be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:48.679252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0ceae50f-b600-414e-bc7a-7971e73141be None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:00:48.681371 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0ceae50f-b600-414e-bc7a-7971e73141be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:00:48.763507 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 12/23] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:00:48.798819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69ab78-2e1e-4dd2-9bf5-a746b4ae0f94 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:48.952795 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69ab78-2e1e-4dd2-9bf5-a746b4ae0f94 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:48.962326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd3f05-e0b7-44e0-9467-32fe32d49dc7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:48.962933 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd3f05-e0b7-44e0-9467-32fe32d49dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:48.963277 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd3f05-e0b7-44e0-9467-32fe32d49dc7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:48.965202 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:00:48.971003 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d40ee-9ffe-4959-a28f-c9b6c9960140 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:48.971506 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d40ee-9ffe-4959-a28f-c9b6c9960140 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:48.971983 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d40ee-9ffe-4959-a28f-c9b6c9960140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:48.982356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:49.002194 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fd5d40ee-9ffe-4959-a28f-c9b6c9960140 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:00:49.003389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fd5d40ee-9ffe-4959-a28f-c9b6c9960140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:00:49.006573 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbecae-289c-4099-988b-38d92d10b8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:49.007375 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbecae-289c-4099-988b-38d92d10b8ad None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:49.007658 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbecae-289c-4099-988b-38d92d10b8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:49.007934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbecae-289c-4099-988b-38d92d10b8ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:49.028140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbecae-289c-4099-988b-38d92d10b8ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:49.029557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbecae-289c-4099-988b-38d92d10b8ad None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:49.057058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-d0fbecae-289c-4099-988b-38d92d10b8ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:00:49.057058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:00:49.057058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:00:49.057058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:00:49.057058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:00:49.057058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:00:49.057058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:00:49.057058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:00:49.057058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:00:49.057058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:00:49.057058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:00:49.057058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:00:49.057058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:00:49.057058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:00:49.057058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:00:49.057915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:00:49.057915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:00:49.057915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:00:49.057915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:00:49.057915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:00:49.057915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:00:49.057915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:00:49.057915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:00:49.057915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:00:49.057915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:00:49.057915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:00:49.057915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:00:49.057915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:00:49.057915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:00:49.057915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:00:49.057915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:00:49.057915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:00:49.058722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:00:49.058722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:00:49.058722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:00:49.058722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:00:49.062429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 12/25] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:00:49.068301 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbecae-289c-4099-988b-38d92d10b8ad None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:49.164541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 14/26] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:00:49.203339 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d40ee-9ffe-4959-a28f-c9b6c9960140 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:49.214491 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:49.275531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbecae-289c-4099-988b-38d92d10b8ad None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:49.322666 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e5cec-2ef8-43f3-87bc-66111c052c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:49.323259 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e5cec-2ef8-43f3-87bc-66111c052c12 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:49.323542 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e5cec-2ef8-43f3-87bc-66111c052c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:49.323820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e5cec-2ef8-43f3-87bc-66111c052c12 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:49.324545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e5cec-2ef8-43f3-87bc-66111c052c12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:00:49.324849 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e5cec-2ef8-43f3-87bc-66111c052c12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:49.326255 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e5cec-2ef8-43f3-87bc-66111c052c12 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:49.341594 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 13/27] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:00:49.344174 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e6f4c-d9b1-4a06-9224-9e4fd7104d1f None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:49.344463 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e6f4c-d9b1-4a06-9224-9e4fd7104d1f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:49.344738 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e6f4c-d9b1-4a06-9224-9e4fd7104d1f None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:49.346792 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 14/28] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:00:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:00:49.347997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661dca-a9c8-4c7e-8505-e9d458b6444e None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:49.348283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661dca-a9c8-4c7e-8505-e9d458b6444e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:49.348556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661dca-a9c8-4c7e-8505-e9d458b6444e None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:49.353940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 15/29] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:00:49.354698 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67661dca-a9c8-4c7e-8505-e9d458b6444e None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:49.363425 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d40ee-9ffe-4959-a28f-c9b6c9960140 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:49.390796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:49.410027 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18f37f-b1ef-4002-b088-19ac62ce425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:49.411377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18f37f-b1ef-4002-b088-19ac62ce425a None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:49.411807 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18f37f-b1ef-4002-b088-19ac62ce425a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:49.412653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18f37f-b1ef-4002-b088-19ac62ce425a None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:49.413838 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18f37f-b1ef-4002-b088-19ac62ce425a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:49.416045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18f37f-b1ef-4002-b088-19ac62ce425a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:49.488607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67661dca-a9c8-4c7e-8505-e9d458b6444e None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:49.526393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf581548-d8f6-4aa7-8a1f-f2f52db3a01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:49.527396 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf581548-d8f6-4aa7-8a1f-f2f52db3a01a None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:49.527825 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf581548-d8f6-4aa7-8a1f-f2f52db3a01a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:49.528328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf581548-d8f6-4aa7-8a1f-f2f52db3a01a None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:49.529445 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf581548-d8f6-4aa7-8a1f-f2f52db3a01a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:49.531120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf581548-d8f6-4aa7-8a1f-f2f52db3a01a None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:49.564453 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 15/30] 10.222.0.48 () {60 vars in 1131 bytes} [Mon Jul 25 12:00:49 2022] POST /identity/v3/roles => generated 219 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:00:49.566297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3b650-0876-4d88-a6cc-3d7a782419a6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:49.566589 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3b650-0876-4d88-a6cc-3d7a782419a6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:49.566958 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3b650-0876-4d88-a6cc-3d7a782419a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:49.589179 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-94d3b650-0876-4d88-a6cc-3d7a782419a6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:00:49.590711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-94d3b650-0876-4d88-a6cc-3d7a782419a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:00:49.691142 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:49.713700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 16/31] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:00:49.715619 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d874199-ac8b-4c21-a6e8-071bb8d4bb68 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:49.716203 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d874199-ac8b-4c21-a6e8-071bb8d4bb68 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:49.716710 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d874199-ac8b-4c21-a6e8-071bb8d4bb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:49.755228 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4d874199-ac8b-4c21-a6e8-071bb8d4bb68 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:00:49.756887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4d874199-ac8b-4c21-a6e8-071bb8d4bb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:00:49.820216 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 16/32] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 12:00:49 2022] POST /identity/v3/projects => generated 301 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:00:49.822074 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf581548-d8f6-4aa7-8a1f-f2f52db3a01a None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:49.844192 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 17/33] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:00:49.877930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d874199-ac8b-4c21-a6e8-071bb8d4bb68 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:49.936411 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:49.965711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf581548-d8f6-4aa7-8a1f-f2f52db3a01a None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:50.010450 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26e1f4-a09a-4001-a643-3a2016df04ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:50.011670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26e1f4-a09a-4001-a643-3a2016df04ba None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:50.012151 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26e1f4-a09a-4001-a643-3a2016df04ba None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:50.012621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26e1f4-a09a-4001-a643-3a2016df04ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:50.029140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26e1f4-a09a-4001-a643-3a2016df04ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:00:50.040412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-4a26e1f4-a09a-4001-a643-3a2016df04ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:00:50.040412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:00:50.040412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:00:50.040412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:00:50.040412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:00:50.040412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:00:50.040412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:00:50.040412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:00:50.040412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:00:50.040412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:00:50.040412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:00:50.040412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:00:50.040412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:00:50.040412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:00:50.040412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:00:50.040412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:00:50.041258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:00:50.041258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:00:50.041258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:00:50.041258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:00:50.041258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:00:50.041258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:00:50.041258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:00:50.041258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:00:50.041258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:00:50.041258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:00:50.041258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:00:50.041258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:00:50.041258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:00:50.041258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:00:50.041258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:00:50.041258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:00:50.041988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:00:50.041988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:00:50.041988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:00:50.041988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:00:50.041988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:00:50.041988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:00:50.041988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:00:50.041988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:00:50.041988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:00:50.041988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:00:50.041988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:00:50.041988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:00:50.045282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 17/34] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:00:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:00:50.051410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26e1f4-a09a-4001-a643-3a2016df04ba None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:50.068817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d874199-ac8b-4c21-a6e8-071bb8d4bb68 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:50.096847 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:50.107309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb706e-595a-4840-995d-59acd8917d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:50.108027 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb706e-595a-4840-995d-59acd8917d73 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:50.108272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb706e-595a-4840-995d-59acd8917d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:50.108550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb706e-595a-4840-995d-59acd8917d73 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:50.109322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb706e-595a-4840-995d-59acd8917d73 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:50.110908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb706e-595a-4840-995d-59acd8917d73 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:50.128745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 18/35] 10.222.0.48 () {60 vars in 1131 bytes} [Mon Jul 25 12:00:49 2022] POST /identity/v3/roles => generated 225 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:00:50.186065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26e1f4-a09a-4001-a643-3a2016df04ba None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:50.231729 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ee323-401c-4d58-8705-2964b3694e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:50.232687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ee323-401c-4d58-8705-2964b3694e1c None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:50.233150 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ee323-401c-4d58-8705-2964b3694e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:50.233593 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ee323-401c-4d58-8705-2964b3694e1c None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:50.234598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ee323-401c-4d58-8705-2964b3694e1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:00:50.235058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ee323-401c-4d58-8705-2964b3694e1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:50.236909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ee323-401c-4d58-8705-2964b3694e1c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:50.253866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 18/36] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:00:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:00:50.259882 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb706e-595a-4840-995d-59acd8917d73 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:50.278101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c11701-5d27-4425-aeda-e31c7cada571 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:50.278561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c11701-5d27-4425-aeda-e31c7cada571 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:50.278914 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c11701-5d27-4425-aeda-e31c7cada571 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:50.280418 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 19/37] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:00:50.285899 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039440-a7f6-43f6-a6c8-728d846ab392 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:50.286305 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039440-a7f6-43f6-a6c8-728d846ab392 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:50.286663 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039440-a7f6-43f6-a6c8-728d846ab392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:50.296986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:50.307881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-3c039440-a7f6-43f6-a6c8-728d846ab392 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:00:50.310261 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-3c039440-a7f6-43f6-a6c8-728d846ab392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:00:50.389243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 20/38] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:00:50.392078 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb706e-595a-4840-995d-59acd8917d73 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:50.394749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116e4a6-5540-4ee6-9664-2e92b27866c1 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:50.395052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116e4a6-5540-4ee6-9664-2e92b27866c1 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:50.395343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116e4a6-5540-4ee6-9664-2e92b27866c1 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:50.396716 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 21/39] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:00:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:00:50.403327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc6a3f-1414-45db-810a-762eb59ffd7f None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:50.403617 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc6a3f-1414-45db-810a-762eb59ffd7f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:50.404388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc6a3f-1414-45db-810a-762eb59ffd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:50.424366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-08fc6a3f-1414-45db-810a-762eb59ffd7f None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:00:50.425536 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-08fc6a3f-1414-45db-810a-762eb59ffd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:00:50.427870 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09323c00-697e-456e-a767-f545e57308e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:50.428746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09323c00-697e-456e-a767-f545e57308e8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:50.429033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09323c00-697e-456e-a767-f545e57308e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:50.429312 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09323c00-697e-456e-a767-f545e57308e8 None admin] PATH_INFO: `/v3/users/2482f101e58a43bca5e9411a6d355e61` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:50.431024 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09323c00-697e-456e-a767-f545e57308e8 None admin] RBAC: Authorizing `identity:get_user(user_id=2482f101e58a43bca5e9411a6d355e61)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:50.432503 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09323c00-697e-456e-a767-f545e57308e8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:50.434150 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 19/40] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:00:50 2022] GET /identity/v3/users/2482f101e58a43bca5e9411a6d355e61 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:00:50.434916 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09323c00-697e-456e-a767-f545e57308e8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:50.487118 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:50.499734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 22/41] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:00:50.500641 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc6a3f-1414-45db-810a-762eb59ffd7f None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:50.537135 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09323c00-697e-456e-a767-f545e57308e8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:50.563986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:50.571983 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56421cb4-0efe-477b-8712-b2e06a109621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:50.572785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56421cb4-0efe-477b-8712-b2e06a109621 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:50.573070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56421cb4-0efe-477b-8712-b2e06a109621 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:50.573349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56421cb4-0efe-477b-8712-b2e06a109621 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:50.574578 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56421cb4-0efe-477b-8712-b2e06a109621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:50.576051 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56421cb4-0efe-477b-8712-b2e06a109621 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:50.577673 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 20/42] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:00:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:00:50.578519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56421cb4-0efe-477b-8712-b2e06a109621 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:50.603607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc6a3f-1414-45db-810a-762eb59ffd7f None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:50.638241 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173e2d2-7a5b-4f77-87ab-43a2595f139a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:50.639036 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173e2d2-7a5b-4f77-87ab-43a2595f139a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:50.639374 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173e2d2-7a5b-4f77-87ab-43a2595f139a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:50.639601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173e2d2-7a5b-4f77-87ab-43a2595f139a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:50.640822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173e2d2-7a5b-4f77-87ab-43a2595f139a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:50.642285 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173e2d2-7a5b-4f77-87ab-43a2595f139a None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:50.643916 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 23/43] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:00:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:00:50.644660 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173e2d2-7a5b-4f77-87ab-43a2595f139a None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:50.679877 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56421cb4-0efe-477b-8712-b2e06a109621 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:50.699441 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:50.713376 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd6c0c-00b7-4937-9a79-2536732ed648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:50.714079 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd6c0c-00b7-4937-9a79-2536732ed648 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:50.714371 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd6c0c-00b7-4937-9a79-2536732ed648 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:50.714653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd6c0c-00b7-4937-9a79-2536732ed648 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:50.715399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd6c0c-00b7-4937-9a79-2536732ed648 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:50.716780 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd6c0c-00b7-4937-9a79-2536732ed648 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:50.731655 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 21/44] 10.222.0.48 () {60 vars in 1131 bytes} [Mon Jul 25 12:00:50 2022] POST /identity/v3/roles => generated 223 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:00:50.732587 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd6c0c-00b7-4937-9a79-2536732ed648 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:50.745359 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173e2d2-7a5b-4f77-87ab-43a2595f139a None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:50.778410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:50.786832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414beea-fff1-499b-accc-2f699959aa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:50.787531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414beea-fff1-499b-accc-2f699959aa91 None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:50.787825 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414beea-fff1-499b-accc-2f699959aa91 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:50.788513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414beea-fff1-499b-accc-2f699959aa91 None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:50.788850 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414beea-fff1-499b-accc-2f699959aa91 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:50.791156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414beea-fff1-499b-accc-2f699959aa91 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:50.821551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 24/45] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 12:00:50 2022] POST /identity/v3/projects => generated 312 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:00:50.865991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd6c0c-00b7-4937-9a79-2536732ed648 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:50.907191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0008e-4cb8-46ce-aff3-8368eece085b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:50.908026 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0008e-4cb8-46ce-aff3-8368eece085b None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:50.908313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0008e-4cb8-46ce-aff3-8368eece085b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:50.908598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0008e-4cb8-46ce-aff3-8368eece085b None admin] PATH_INFO: `/v3/domains/default/users/2482f101e58a43bca5e9411a6d355e61/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:50.911533 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0008e-4cb8-46ce-aff3-8368eece085b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2482f101e58a43bca5e9411a6d355e61, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:50.912782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0008e-4cb8-46ce-aff3-8368eece085b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:50.929900 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 22/46] 10.222.0.48 () {58 vars in 1361 bytes} [Mon Jul 25 12:00:50 2022] PUT /identity/v3/domains/default/users/2482f101e58a43bca5e9411a6d355e61/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:00:52.829402 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2ae54-1dd4-455a-a7e0-13acbbe1f292 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:52.829907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2ae54-1dd4-455a-a7e0-13acbbe1f292 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:52.829986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2ae54-1dd4-455a-a7e0-13acbbe1f292 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:52.831384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 25/47] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:00:52.836457 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45129c-a703-4cf7-a10c-755bf7e3ac3d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:52.836824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45129c-a703-4cf7-a10c-755bf7e3ac3d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:52.837138 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45129c-a703-4cf7-a10c-755bf7e3ac3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:52.855474 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3b45129c-a703-4cf7-a10c-755bf7e3ac3d None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:00:52.856650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3b45129c-a703-4cf7-a10c-755bf7e3ac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:00:52.889632 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508d137-85fa-476d-b53c-4bd54efc1f55 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:52.889930 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508d137-85fa-476d-b53c-4bd54efc1f55 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:52.890244 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508d137-85fa-476d-b53c-4bd54efc1f55 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:52.890401 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:52.891633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 26/48] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:00:52.896664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbe33a-b7b7-4718-afec-c700cd019bfe None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:52.896960 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbe33a-b7b7-4718-afec-c700cd019bfe None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:52.897243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbe33a-b7b7-4718-afec-c700cd019bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:52.914623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-7fcbe33a-b7b7-4718-afec-c700cd019bfe None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:00:52.916591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-7fcbe33a-b7b7-4718-afec-c700cd019bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:00:52.925697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 23/49] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:00:52.948516 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45129c-a703-4cf7-a10c-755bf7e3ac3d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:52.983741 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 27/50] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:00:53.006836 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbe33a-b7b7-4718-afec-c700cd019bfe None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:53.044648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45129c-a703-4cf7-a10c-755bf7e3ac3d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:53.079111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5b2a6-f181-4cbd-8120-3d2a7eb906ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:53.079965 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5b2a6-f181-4cbd-8120-3d2a7eb906ec None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:53.080183 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5b2a6-f181-4cbd-8120-3d2a7eb906ec None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:53.080455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5b2a6-f181-4cbd-8120-3d2a7eb906ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:53.081628 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5b2a6-f181-4cbd-8120-3d2a7eb906ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:53.083679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba5b2a6-f181-4cbd-8120-3d2a7eb906ec None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:53.085276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 24/51] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:00:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:00:53.090836 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5b2a6-f181-4cbd-8120-3d2a7eb906ec None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:53.101863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbe33a-b7b7-4718-afec-c700cd019bfe None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:53.115195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:53.130638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:53.137410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63fd25-ff7f-42e1-9bfb-8c3dae921470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:53.138227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63fd25-ff7f-42e1-9bfb-8c3dae921470 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:53.138510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63fd25-ff7f-42e1-9bfb-8c3dae921470 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:53.138786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63fd25-ff7f-42e1-9bfb-8c3dae921470 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:53.149165 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63fd25-ff7f-42e1-9bfb-8c3dae921470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:00:53.156992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-2e63fd25-ff7f-42e1-9bfb-8c3dae921470 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:00:53.156992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:00:53.156992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:00:53.156992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:00:53.156992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:00:53.156992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:00:53.156992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:00:53.156992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:00:53.156992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:00:53.156992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:00:53.156992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:00:53.156992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:00:53.156992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:00:53.156992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:00:53.156992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:00:53.156992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:00:53.157858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:00:53.157858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:00:53.157858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:00:53.157858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:00:53.157858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:00:53.157858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:00:53.157858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:00:53.157858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:00:53.157858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:00:53.157858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:00:53.157858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:00:53.157858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:00:53.157858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:00:53.157858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:00:53.157858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:00:53.157858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:00:53.158629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:00:53.158629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:00:53.158629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:00:53.158629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:00:53.158629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:00:53.158629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:00:53.158629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:00:53.158629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:00:53.158629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:00:53.158629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:00:53.158629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:00:53.158629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:00:53.158629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 28/52] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:00:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:00:53.164574 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63fd25-ff7f-42e1-9bfb-8c3dae921470 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:53.194049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5b2a6-f181-4cbd-8120-3d2a7eb906ec None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:53.227148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd3793-4fd9-4150-8252-f0951444464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:53.228385 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd3793-4fd9-4150-8252-f0951444464c None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:53.228674 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd3793-4fd9-4150-8252-f0951444464c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:53.228958 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd3793-4fd9-4150-8252-f0951444464c None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:53.229674 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd3793-4fd9-4150-8252-f0951444464c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:53.231178 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd3793-4fd9-4150-8252-f0951444464c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:53.259143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 25/53] 10.222.0.48 () {60 vars in 1140 bytes} [Mon Jul 25 12:00:53 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:00:53.264429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63fd25-ff7f-42e1-9bfb-8c3dae921470 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:53.301937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf5ffc-1942-4547-938c-fd5fc7dcaa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:53.302647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf5ffc-1942-4547-938c-fd5fc7dcaa89 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:53.302933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf5ffc-1942-4547-938c-fd5fc7dcaa89 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:53.303215 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf5ffc-1942-4547-938c-fd5fc7dcaa89 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:53.303984 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf5ffc-1942-4547-938c-fd5fc7dcaa89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:00:53.304292 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf5ffc-1942-4547-938c-fd5fc7dcaa89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:53.305787 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf5ffc-1942-4547-938c-fd5fc7dcaa89 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:53.315434 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 29/54] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:00:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:00:53.321261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd3793-4fd9-4150-8252-f0951444464c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:53.416063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:53.427616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd3793-4fd9-4150-8252-f0951444464c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:53.462775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff60b0-7459-42e3-9e44-2e13b0f6b68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:53.463652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff60b0-7459-42e3-9e44-2e13b0f6b68f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:53.463932 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff60b0-7459-42e3-9e44-2e13b0f6b68f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:53.464205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff60b0-7459-42e3-9e44-2e13b0f6b68f None admin] PATH_INFO: `/v3/users/2482f101e58a43bca5e9411a6d355e61` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:53.465436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff60b0-7459-42e3-9e44-2e13b0f6b68f None admin] RBAC: Authorizing `identity:get_user(user_id=2482f101e58a43bca5e9411a6d355e61)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:53.466923 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff60b0-7459-42e3-9e44-2e13b0f6b68f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:53.469258 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 26/55] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:00:53 2022] GET /identity/v3/users/2482f101e58a43bca5e9411a6d355e61 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:00:53.474122 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf5ffc-1942-4547-938c-fd5fc7dcaa89 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:53.508548 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:53.573583 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf5ffc-1942-4547-938c-fd5fc7dcaa89 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:53.606021 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995b2cf-f212-452b-a989-f1a30f9b7c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:53.606835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995b2cf-f212-452b-a989-f1a30f9b7c4e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:53.607116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995b2cf-f212-452b-a989-f1a30f9b7c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:53.607391 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995b2cf-f212-452b-a989-f1a30f9b7c4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:53.608558 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995b2cf-f212-452b-a989-f1a30f9b7c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:53.610024 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995b2cf-f212-452b-a989-f1a30f9b7c4e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:53.611639 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 30/56] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:00:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:00:53.617289 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff60b0-7459-42e3-9e44-2e13b0f6b68f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:53.713916 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff60b0-7459-42e3-9e44-2e13b0f6b68f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:53.745697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c122925-8cd1-45b9-a616-8fb23e54aef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:53.746379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c122925-8cd1-45b9-a616-8fb23e54aef0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:53.746664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c122925-8cd1-45b9-a616-8fb23e54aef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:53.746941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c122925-8cd1-45b9-a616-8fb23e54aef0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:53.747770 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c122925-8cd1-45b9-a616-8fb23e54aef0 None admin] RBAC: Adding query filter params (role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.domain.id=default, user.id=2482f101e58a43bca5e9411a6d355e61) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:00:53.748083 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c122925-8cd1-45b9-a616-8fb23e54aef0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:53.749523 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c122925-8cd1-45b9-a616-8fb23e54aef0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:53.755180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 27/57] 10.222.0.48 () {56 vars in 1322 bytes} [Mon Jul 25 12:00:53 2022] GET /identity/v3/role_assignments?user.id=2482f101e58a43bca5e9411a6d355e61&scope.domain.id=default&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 530 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:00:55.260953 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b3c1c-8b64-4e93-94be-3c0d4ebba033 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:55.261465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b3c1c-8b64-4e93-94be-3c0d4ebba033 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:55.261547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b3c1c-8b64-4e93-94be-3c0d4ebba033 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:55.262953 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 31/58] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:00:55.267942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bf8c5-dcde-496b-ae7a-b419757b9039 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:55.268298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bf8c5-dcde-496b-ae7a-b419757b9039 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:55.268519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bf8c5-dcde-496b-ae7a-b419757b9039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:55.286692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-475bf8c5-dcde-496b-ae7a-b419757b9039 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:00:55.287869 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-475bf8c5-dcde-496b-ae7a-b419757b9039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:00:55.303837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:55.352715 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 28/59] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:00:55.376680 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b3c1c-8b64-4e93-94be-3c0d4ebba033 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:55.479039 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b3c1c-8b64-4e93-94be-3c0d4ebba033 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:55.480555 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:55.513783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66893d-9e04-4507-8a1e-414ff029589c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:55.514549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66893d-9e04-4507-8a1e-414ff029589c None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:55.514839 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66893d-9e04-4507-8a1e-414ff029589c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:55.515116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66893d-9e04-4507-8a1e-414ff029589c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:55.516307 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66893d-9e04-4507-8a1e-414ff029589c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:55.517767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66893d-9e04-4507-8a1e-414ff029589c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:55.519417 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 32/60] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:00:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:00:55.524960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bf8c5-dcde-496b-ae7a-b419757b9039 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:55.620225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bf8c5-dcde-496b-ae7a-b419757b9039 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:55.652729 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864eb465-2f74-4316-adfb-437f829021a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:55.653387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eb465-2f74-4316-adfb-437f829021a6 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:55.653674 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eb465-2f74-4316-adfb-437f829021a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:55.653954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eb465-2f74-4316-adfb-437f829021a6 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:55.654699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864eb465-2f74-4316-adfb-437f829021a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:55.656157 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864eb465-2f74-4316-adfb-437f829021a6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:55.682246 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 29/61] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 12:00:55 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:00:58.633593 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b258e6-cb60-44fd-8959-dbde8aecc8f9 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:58.635140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b258e6-cb60-44fd-8959-dbde8aecc8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:58.635629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b258e6-cb60-44fd-8959-dbde8aecc8f9 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:58.637221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 33/62] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:00:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:00:58.642573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769034e-46e9-4ad7-8ae1-baf907ea8ca0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:58.643382 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769034e-46e9-4ad7-8ae1-baf907ea8ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:58.643854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769034e-46e9-4ad7-8ae1-baf907ea8ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:58.664121 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a769034e-46e9-4ad7-8ae1-baf907ea8ca0 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:00:58.665903 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a769034e-46e9-4ad7-8ae1-baf907ea8ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:00:58.668531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:58.765940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 30/63] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:00:58.801096 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b258e6-cb60-44fd-8959-dbde8aecc8f9 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:58.939675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b258e6-cb60-44fd-8959-dbde8aecc8f9 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:58.983627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31612cf9-3682-4f4a-ad63-691878bc933e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:58.984442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31612cf9-3682-4f4a-ad63-691878bc933e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:58.984729 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31612cf9-3682-4f4a-ad63-691878bc933e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:58.985006 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31612cf9-3682-4f4a-ad63-691878bc933e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:59.007165 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31612cf9-3682-4f4a-ad63-691878bc933e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:00:59.017194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-31612cf9-3682-4f4a-ad63-691878bc933e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:00:59.017194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:00:59.017194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:00:59.017194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:00:59.017194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:00:59.017194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:00:59.017194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:00:59.017194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:00:59.017194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:00:59.017194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:00:59.017194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:00:59.017194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:00:59.017194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:00:59.017194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:00:59.017194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:00:59.017194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:00:59.018395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:00:59.018395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:00:59.018395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:00:59.018395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:00:59.018395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:00:59.018395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:00:59.018395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:00:59.018395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:00:59.018395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:00:59.018395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:00:59.018395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:00:59.018395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:00:59.018395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:00:59.018395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:00:59.018395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:00:59.018395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:00:59.019388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:00:59.019388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:00:59.019388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:00:59.019388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:00:59.019388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:00:59.019388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:00:59.019388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:00:59.019388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:00:59.019388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:00:59.019388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:00:59.019388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:00:59.019388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:00:59.020225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5e910-8543-423c-9648-3e4f6c11f1f9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:59.020225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5e910-8543-423c-9648-3e4f6c11f1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:59.020225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5e910-8543-423c-9648-3e4f6c11f1f9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:59.020384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 34/64] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:00:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:00:59.020522 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 31/65] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:00:59.020595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96dbe8-cdea-423e-b2a8-8c768570f040 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:59.020595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96dbe8-cdea-423e-b2a8-8c768570f040 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:59.020595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96dbe8-cdea-423e-b2a8-8c768570f040 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:59.020595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 35/66] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:00:59.022953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b99c6-b72e-42e5-9e57-beaeca236727 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:59.023491 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b99c6-b72e-42e5-9e57-beaeca236727 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:59.023968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b99c6-b72e-42e5-9e57-beaeca236727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:59.025470 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96dbe8-cdea-423e-b2a8-8c768570f040 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:59.043055 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-886b99c6-b72e-42e5-9e57-beaeca236727 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:00:59.044585 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-886b99c6-b72e-42e5-9e57-beaeca236727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:00:59.059303 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:59.131218 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 32/67] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:00:59.132616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67cbe2-064f-41b1-a9b8-a519e1d8bec4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:59.133069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67cbe2-064f-41b1-a9b8-a519e1d8bec4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:59.133588 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67cbe2-064f-41b1-a9b8-a519e1d8bec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:59.138137 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96dbe8-cdea-423e-b2a8-8c768570f040 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:59.151747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ae67cbe2-064f-41b1-a9b8-a519e1d8bec4 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:00:59.153362 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ae67cbe2-064f-41b1-a9b8-a519e1d8bec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:00:59.174596 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394dedf0-db35-467a-8197-e4b2bd7cc823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:59.175277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394dedf0-db35-467a-8197-e4b2bd7cc823 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:59.175563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394dedf0-db35-467a-8197-e4b2bd7cc823 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:59.176233 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394dedf0-db35-467a-8197-e4b2bd7cc823 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:59.177008 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394dedf0-db35-467a-8197-e4b2bd7cc823 None admin] RBAC: Adding query filter params (name=member) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:00:59.177461 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394dedf0-db35-467a-8197-e4b2bd7cc823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:59.178910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394dedf0-db35-467a-8197-e4b2bd7cc823 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:59.192144 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 36/68] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:00:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:00:59.192144 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62479a67-5c49-4a3d-a0a4-aaa9091be184 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:59.192144 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62479a67-5c49-4a3d-a0a4-aaa9091be184 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:59.192144 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62479a67-5c49-4a3d-a0a4-aaa9091be184 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:59.192144 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 37/69] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:00:59.192144 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62479a67-5c49-4a3d-a0a4-aaa9091be184 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:59.223250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:59.230995 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 33/70] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:00:59.231664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67cbe2-064f-41b1-a9b8-a519e1d8bec4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:59.301368 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:59.311987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62479a67-5c49-4a3d-a0a4-aaa9091be184 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:59.331891 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67cbe2-064f-41b1-a9b8-a519e1d8bec4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:59.346802 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73264cc9-fdae-402c-adc4-b2bc86cd4be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:59.347591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73264cc9-fdae-402c-adc4-b2bc86cd4be7 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:59.347873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73264cc9-fdae-402c-adc4-b2bc86cd4be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:59.348144 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73264cc9-fdae-402c-adc4-b2bc86cd4be7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:59.358722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73264cc9-fdae-402c-adc4-b2bc86cd4be7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:00:59.366065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46038bcf-9119-44e0-8593-806284972e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:59.366704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-73264cc9-fdae-402c-adc4-b2bc86cd4be7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:00:59.366704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:00:59.366704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:00:59.366704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:00:59.366704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:00:59.366704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:00:59.366704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:00:59.366704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:00:59.366704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:00:59.366704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:00:59.366704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:00:59.366704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:00:59.366704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:00:59.366704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:00:59.366704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:00:59.366704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:00:59.367549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:00:59.367549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:00:59.367549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:00:59.367549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:00:59.367549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:00:59.367549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:00:59.367549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:00:59.367549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:00:59.367549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:00:59.367549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:00:59.367549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:00:59.367549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:00:59.367549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:00:59.367549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:00:59.367549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:00:59.367549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:00:59.368336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:00:59.368336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:00:59.368336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:00:59.368336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:00:59.368336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:00:59.368336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:00:59.368336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:00:59.368336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:00:59.368336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:00:59.368336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:00:59.368336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:00:59.368336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:00:59.368885 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46038bcf-9119-44e0-8593-806284972e0e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:59.368885 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46038bcf-9119-44e0-8593-806284972e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:59.368885 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46038bcf-9119-44e0-8593-806284972e0e None admin] PATH_INFO: `/v3/users/b4f363b5e16e42eea33d3a46852cf542` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:59.369053 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 38/71] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:00:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:00:59.369774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a365b6-7c60-4b96-b6ae-c123624b8720 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:59.369774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a365b6-7c60-4b96-b6ae-c123624b8720 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:59.369975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a365b6-7c60-4b96-b6ae-c123624b8720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:59.384943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46038bcf-9119-44e0-8593-806284972e0e None admin] RBAC: Authorizing `identity:get_user(user_id=b4f363b5e16e42eea33d3a46852cf542)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:59.386489 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46038bcf-9119-44e0-8593-806284972e0e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:59.387275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-50a365b6-7c60-4b96-b6ae-c123624b8720 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:00:59.392741 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 34/72] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:00:59 2022] GET /identity/v3/users/b4f363b5e16e42eea33d3a46852cf542 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:00:59.392888 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-50a365b6-7c60-4b96-b6ae-c123624b8720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:00:59.392979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46038bcf-9119-44e0-8593-806284972e0e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:59.457415 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:59.466922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 39/73] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:00:59.466922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a365b6-7c60-4b96-b6ae-c123624b8720 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:59.528089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46038bcf-9119-44e0-8593-806284972e0e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:59.554713 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:59.564244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219c2ab-1124-4b34-b650-48e02128c1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:59.565056 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219c2ab-1124-4b34-b650-48e02128c1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:59.565338 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219c2ab-1124-4b34-b650-48e02128c1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:59.565614 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219c2ab-1124-4b34-b650-48e02128c1d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:59.572874 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a365b6-7c60-4b96-b6ae-c123624b8720 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:59.576249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219c2ab-1124-4b34-b650-48e02128c1d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:00:59.584414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6219c2ab-1124-4b34-b650-48e02128c1d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:00:59.584414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:00:59.584414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:00:59.584414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:00:59.584414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:00:59.584414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:00:59.584414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:00:59.584414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:00:59.584414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:00:59.584414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:00:59.584414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:00:59.584414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:00:59.584414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:00:59.584414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:00:59.584414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:00:59.584414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:00:59.585324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:00:59.585324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:00:59.585324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:00:59.585324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:00:59.585324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:00:59.585324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:00:59.585324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:00:59.585324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:00:59.585324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:00:59.585324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:00:59.585324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:00:59.585324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:00:59.585324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:00:59.585324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:00:59.585324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:00:59.585324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:00:59.586075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:00:59.586075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:00:59.586075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:00:59.586075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:00:59.586075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:00:59.586075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:00:59.586075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:00:59.586075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:00:59.586075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:00:59.586075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:00:59.586075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:00:59.586075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:00:59.586075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 35/74] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:00:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:00:59.586684 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219c2ab-1124-4b34-b650-48e02128c1d0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:59.607931 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd7604-1696-4a46-aa1f-f999d35b71bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:59.608598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd7604-1696-4a46-aa1f-f999d35b71bc None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:59.608876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd7604-1696-4a46-aa1f-f999d35b71bc None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:59.609150 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd7604-1696-4a46-aa1f-f999d35b71bc None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:59.609890 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd7604-1696-4a46-aa1f-f999d35b71bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:00:59.610236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd7604-1696-4a46-aa1f-f999d35b71bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:59.611617 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd7604-1696-4a46-aa1f-f999d35b71bc None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:59.619522 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 40/75] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:00:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:00:59.620295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd7604-1696-4a46-aa1f-f999d35b71bc None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:59.683763 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219c2ab-1124-4b34-b650-48e02128c1d0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:59.699755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:59.718346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31d67e-3ec0-469c-910e-636b473e1b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:59.719002 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31d67e-3ec0-469c-910e-636b473e1b23 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:59.719293 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31d67e-3ec0-469c-910e-636b473e1b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:59.719441 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd7604-1696-4a46-aa1f-f999d35b71bc None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:59.719837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31d67e-3ec0-469c-910e-636b473e1b23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:59.752646 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af1766-76c5-4966-9437-413bc99da350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:59.753437 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af1766-76c5-4966-9437-413bc99da350 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:59.753724 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af1766-76c5-4966-9437-413bc99da350 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:59.754030 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af1766-76c5-4966-9437-413bc99da350 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:59.764505 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af1766-76c5-4966-9437-413bc99da350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:00:59.772196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-98af1766-76c5-4966-9437-413bc99da350 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:00:59.772196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:00:59.772196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:00:59.772196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:00:59.772196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:00:59.772196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:00:59.772196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:00:59.772196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:00:59.772196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:00:59.772196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:00:59.772196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:00:59.772196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:00:59.772196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:00:59.772196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:00:59.772196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:00:59.772196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:00:59.773031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:00:59.773031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:00:59.773031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:00:59.773031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:00:59.773031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:00:59.773031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:00:59.773031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:00:59.773031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:00:59.773031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:00:59.773031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:00:59.773031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:00:59.773031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:00:59.773031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:00:59.773031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:00:59.773031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:00:59.773031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:00:59.773766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:00:59.773766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:00:59.773766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:00:59.773766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:00:59.773766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:00:59.773766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:00:59.773766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:00:59.773766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:00:59.773766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:00:59.773766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:00:59.773766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:00:59.773766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:00:59.773766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 41/76] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:00:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:00:59.775238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6ac8b-9662-473b-9f58-4294bd348e99 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:59.775519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6ac8b-9662-473b-9f58-4294bd348e99 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:59.775777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6ac8b-9662-473b-9f58-4294bd348e99 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:59.777063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 42/77] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:00:59.777763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6ac8b-9662-473b-9f58-4294bd348e99 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:59.781976 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:59.793348 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31d67e-3ec0-469c-910e-636b473e1b23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:59.794880 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31d67e-3ec0-469c-910e-636b473e1b23 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:59.877361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6ac8b-9662-473b-9f58-4294bd348e99 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:59.892435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 36/78] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:00:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:00:59.893280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31d67e-3ec0-469c-910e-636b473e1b23 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:59.910364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:00:59.916861 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e5ed2-79c4-4835-a8a0-cf468f35cd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:00:59.917534 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e5ed2-79c4-4835-a8a0-cf468f35cd8a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:00:59.917827 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e5ed2-79c4-4835-a8a0-cf468f35cd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:00:59.918133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e5ed2-79c4-4835-a8a0-cf468f35cd8a None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:00:59.918893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e5ed2-79c4-4835-a8a0-cf468f35cd8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:00:59.919200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e5ed2-79c4-4835-a8a0-cf468f35cd8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:00:59.920575 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e5ed2-79c4-4835-a8a0-cf468f35cd8a None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:00:59.928400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 43/79] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:00:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:00:59.928400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e5ed2-79c4-4835-a8a0-cf468f35cd8a None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:00:59.991198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31d67e-3ec0-469c-910e-636b473e1b23 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:00:59.994128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:00.024661 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea454a-f5d5-41a2-82d4-da3c74d7197d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:00.025524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea454a-f5d5-41a2-82d4-da3c74d7197d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:00.025808 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea454a-f5d5-41a2-82d4-da3c74d7197d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:00.026113 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea454a-f5d5-41a2-82d4-da3c74d7197d None admin] PATH_INFO: `/v3/users/2482f101e58a43bca5e9411a6d355e61` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:00.027300 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea454a-f5d5-41a2-82d4-da3c74d7197d None admin] RBAC: Authorizing `identity:get_user(user_id=2482f101e58a43bca5e9411a6d355e61)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:00.028532 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e5ed2-79c4-4835-a8a0-cf468f35cd8a None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:00.028750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea454a-f5d5-41a2-82d4-da3c74d7197d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:00.030608 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 37/80] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:00:59 2022] GET /identity/v3/users/2482f101e58a43bca5e9411a6d355e61 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:00.031546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bdaba-e596-40b8-8e6b-8556a3324879 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:00.031830 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bdaba-e596-40b8-8e6b-8556a3324879 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:00.032108 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bdaba-e596-40b8-8e6b-8556a3324879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:00.049162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5c6bdaba-e596-40b8-8e6b-8556a3324879 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:00.050389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5c6bdaba-e596-40b8-8e6b-8556a3324879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:00.066543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdad44-28d1-493b-b063-26aa2229e35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:00.067210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdad44-28d1-493b-b063-26aa2229e35f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:00.067498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdad44-28d1-493b-b063-26aa2229e35f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:00.067775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdad44-28d1-493b-b063-26aa2229e35f None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:00.068526 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdad44-28d1-493b-b063-26aa2229e35f None admin] RBAC: Adding query filter params (name=member) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:00.068835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdad44-28d1-493b-b063-26aa2229e35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:00.070243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdad44-28d1-493b-b063-26aa2229e35f None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:00.078805 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 44/81] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:00:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:00.079590 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdad44-28d1-493b-b063-26aa2229e35f None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:00.122585 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 38/82] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:00.123425 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bdaba-e596-40b8-8e6b-8556a3324879 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:00.148650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:00.183171 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdad44-28d1-493b-b063-26aa2229e35f None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:00.208321 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:00.217074 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cdb81-e6de-494b-92ef-07006918e30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:00.217942 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cdb81-e6de-494b-92ef-07006918e30e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:00.218266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cdb81-e6de-494b-92ef-07006918e30e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:00.218547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cdb81-e6de-494b-92ef-07006918e30e None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:00.219763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03cdb81-e6de-494b-92ef-07006918e30e None admin] RBAC: Authorizing `identity:get_project(project_id=ace9baa6f68746d49a7c11b95f550e58)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:00.221228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03cdb81-e6de-494b-92ef-07006918e30e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:00.222974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 45/83] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:00 2022] GET /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:00.223746 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cdb81-e6de-494b-92ef-07006918e30e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:00.233892 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bdaba-e596-40b8-8e6b-8556a3324879 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:00.265590 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2713e-3d1c-4242-949e-77cb498d196b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:00.266494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2713e-3d1c-4242-949e-77cb498d196b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:00.266778 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2713e-3d1c-4242-949e-77cb498d196b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:00.267053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2713e-3d1c-4242-949e-77cb498d196b None admin] PATH_INFO: `/v3/users/b4f363b5e16e42eea33d3a46852cf542` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:00.268243 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2713e-3d1c-4242-949e-77cb498d196b None admin] RBAC: Authorizing `identity:get_user(user_id=b4f363b5e16e42eea33d3a46852cf542)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:00.269692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2713e-3d1c-4242-949e-77cb498d196b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:00.271362 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 39/84] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:00 2022] GET /identity/v3/users/b4f363b5e16e42eea33d3a46852cf542 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:00.276573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2713e-3d1c-4242-949e-77cb498d196b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:00.323583 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cdb81-e6de-494b-92ef-07006918e30e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:00.354551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:00.357285 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51b64b-eab5-442e-b95f-ad9ae8a8fdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:00.357959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51b64b-eab5-442e-b95f-ad9ae8a8fdbc None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:00.358273 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51b64b-eab5-442e-b95f-ad9ae8a8fdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:00.358551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51b64b-eab5-442e-b95f-ad9ae8a8fdbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:00.374269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2713e-3d1c-4242-949e-77cb498d196b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:00.410409 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f036a-0700-4e0f-b33c-7f3d18f9b130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:00.411242 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f036a-0700-4e0f-b33c-7f3d18f9b130 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:00.411524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f036a-0700-4e0f-b33c-7f3d18f9b130 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:00.411799 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f036a-0700-4e0f-b33c-7f3d18f9b130 None admin] PATH_INFO: `/v3/users/b4f363b5e16e42eea33d3a46852cf542` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:00.412987 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f036a-0700-4e0f-b33c-7f3d18f9b130 None admin] RBAC: Authorizing `identity:get_user(user_id=b4f363b5e16e42eea33d3a46852cf542)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:00.414472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f036a-0700-4e0f-b33c-7f3d18f9b130 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:00.416669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 40/85] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:00 2022] GET /identity/v3/users/b4f363b5e16e42eea33d3a46852cf542 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:00.417466 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f036a-0700-4e0f-b33c-7f3d18f9b130 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:00.419913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:00.427614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51b64b-eab5-442e-b95f-ad9ae8a8fdbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:00.429120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51b64b-eab5-442e-b95f-ad9ae8a8fdbc None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:00.514696 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f036a-0700-4e0f-b33c-7f3d18f9b130 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:00.528903 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 46/86] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:00.529753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51b64b-eab5-442e-b95f-ad9ae8a8fdbc None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:00.549104 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f322e19-525a-46ba-a67a-f6a7580304e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:00.549899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f322e19-525a-46ba-a67a-f6a7580304e9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:00.550214 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f322e19-525a-46ba-a67a-f6a7580304e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:00.550492 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f322e19-525a-46ba-a67a-f6a7580304e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:00.551656 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f322e19-525a-46ba-a67a-f6a7580304e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:00.553106 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f322e19-525a-46ba-a67a-f6a7580304e9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:00.554736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 41/87] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:00.555487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f322e19-525a-46ba-a67a-f6a7580304e9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:00.575532 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:00.622824 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:00.629589 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51b64b-eab5-442e-b95f-ad9ae8a8fdbc None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:00.655557 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f322e19-525a-46ba-a67a-f6a7580304e9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:00.664772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3788ec-59e2-4325-b4ec-a8da1834310e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:00.665629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3788ec-59e2-4325-b4ec-a8da1834310e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:00.665914 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3788ec-59e2-4325-b4ec-a8da1834310e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:00.666292 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3788ec-59e2-4325-b4ec-a8da1834310e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:00.667146 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3788ec-59e2-4325-b4ec-a8da1834310e None admin] RBAC: Adding query filter params (role.id=ae11679806844c6f8d55ce5ccb32ee8b, scope.project.id=ace9baa6f68746d49a7c11b95f550e58, user.id=b4f363b5e16e42eea33d3a46852cf542) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:00.667460 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3788ec-59e2-4325-b4ec-a8da1834310e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:00.668899 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3788ec-59e2-4325-b4ec-a8da1834310e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:00.677031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 47/88] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:00 2022] GET /identity/v3/role_assignments?user.id=b4f363b5e16e42eea33d3a46852cf542&scope.project.id=ace9baa6f68746d49a7c11b95f550e58&role.id=ae11679806844c6f8d55ce5ccb32ee8b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:00.677830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3788ec-59e2-4325-b4ec-a8da1834310e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:00.691511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dd27b-9667-40a8-8d08-672a612008d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:00.692186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd27b-9667-40a8-8d08-672a612008d9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:00.692473 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd27b-9667-40a8-8d08-672a612008d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:00.692751 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd27b-9667-40a8-8d08-672a612008d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:00.767655 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dd27b-9667-40a8-8d08-672a612008d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:00.769164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dd27b-9667-40a8-8d08-672a612008d9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:00.789684 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:00.796588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3788ec-59e2-4325-b4ec-a8da1834310e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:00.842995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0557ef6-cdaf-40f4-976f-08cd733a3643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:00.844158 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0557ef6-cdaf-40f4-976f-08cd733a3643 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:00.844457 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0557ef6-cdaf-40f4-976f-08cd733a3643 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:00.844742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0557ef6-cdaf-40f4-976f-08cd733a3643 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:00.875721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:00.886066 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 42/89] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:00.886066 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dd27b-9667-40a8-8d08-672a612008d9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:00.923471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0557ef6-cdaf-40f4-976f-08cd733a3643 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:00.924991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0557ef6-cdaf-40f4-976f-08cd733a3643 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:00.982951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dd27b-9667-40a8-8d08-672a612008d9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:01.001735 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:01.021015 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d083eb-90b6-4f74-95da-b164d3ea59cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:01.021875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d083eb-90b6-4f74-95da-b164d3ea59cb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:01.022193 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d083eb-90b6-4f74-95da-b164d3ea59cb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:01.022474 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d083eb-90b6-4f74-95da-b164d3ea59cb None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:01.023902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d083eb-90b6-4f74-95da-b164d3ea59cb None admin] RBAC: Authorizing `identity:get_project(project_id=ace9baa6f68746d49a7c11b95f550e58)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:01.025403 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d083eb-90b6-4f74-95da-b164d3ea59cb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:01.027368 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 43/90] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:00 2022] GET /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:01.028114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d083eb-90b6-4f74-95da-b164d3ea59cb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:01.039231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 48/91] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:01.039231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0557ef6-cdaf-40f4-976f-08cd733a3643 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:01.098175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:01.137187 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d083eb-90b6-4f74-95da-b164d3ea59cb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:01.140542 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0557ef6-cdaf-40f4-976f-08cd733a3643 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:01.173651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0a474-dbb2-462a-a23a-19a661599aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:01.174297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0a474-dbb2-462a-a23a-19a661599aa5 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:01.174588 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0a474-dbb2-462a-a23a-19a661599aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:01.174870 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0a474-dbb2-462a-a23a-19a661599aa5 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:01.175592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0a474-dbb2-462a-a23a-19a661599aa5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:01.175936 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1a950-627f-45fa-bc76-6daa7539737e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:01.176798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1a950-627f-45fa-bc76-6daa7539737e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:01.177063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0a474-dbb2-462a-a23a-19a661599aa5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:01.177153 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1a950-627f-45fa-bc76-6daa7539737e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:01.177340 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1a950-627f-45fa-bc76-6daa7539737e None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:01.178879 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1a950-627f-45fa-bc76-6daa7539737e None admin] RBAC: Authorizing `identity:get_project(project_id=ace9baa6f68746d49a7c11b95f550e58)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:01.180317 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1a950-627f-45fa-bc76-6daa7539737e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:01.187420 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 49/92] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:01 2022] GET /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:01.187420 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1a950-627f-45fa-bc76-6daa7539737e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:01.206029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 44/93] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 12:01:01 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:01:01.206029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0a474-dbb2-462a-a23a-19a661599aa5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:01.251677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:01.324768 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0a474-dbb2-462a-a23a-19a661599aa5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:01.338053 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1a950-627f-45fa-bc76-6daa7539737e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:01.369313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:01.373273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c7520-fb12-481b-bd86-99e3be5b1ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:01.374538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c7520-fb12-481b-bd86-99e3be5b1ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:01.375067 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c7520-fb12-481b-bd86-99e3be5b1ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:01.375649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c7520-fb12-481b-bd86-99e3be5b1ea3 None admin] PATH_INFO: `/v3/projects/3d635b2ea7e04bb9918b295d4bb24798` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:01.377503 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c7520-fb12-481b-bd86-99e3be5b1ea3 None admin] RBAC: Authorizing `identity:get_project(project_id=3d635b2ea7e04bb9918b295d4bb24798)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:01.379367 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c7520-fb12-481b-bd86-99e3be5b1ea3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:01.380143 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bacf4e-86c1-46b0-aaa0-a2a8094cc22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:01.380911 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bacf4e-86c1-46b0-aaa0-a2a8094cc22a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:01.381535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bacf4e-86c1-46b0-aaa0-a2a8094cc22a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:01.381657 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 45/94] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:01 2022] GET /identity/v3/projects/3d635b2ea7e04bb9918b295d4bb24798 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:01.381741 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bacf4e-86c1-46b0-aaa0-a2a8094cc22a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:01.382243 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c7520-fb12-481b-bd86-99e3be5b1ea3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:01.382812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bacf4e-86c1-46b0-aaa0-a2a8094cc22a None admin] RBAC: Adding query filter params (role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.project.id=ace9baa6f68746d49a7c11b95f550e58, user.id=2482f101e58a43bca5e9411a6d355e61) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:01.383232 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bacf4e-86c1-46b0-aaa0-a2a8094cc22a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:01.384918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bacf4e-86c1-46b0-aaa0-a2a8094cc22a None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:01.391568 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 50/95] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:01 2022] GET /identity/v3/role_assignments?user.id=2482f101e58a43bca5e9411a6d355e61&scope.project.id=ace9baa6f68746d49a7c11b95f550e58&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:01.392557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bacf4e-86c1-46b0-aaa0-a2a8094cc22a None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:01.513802 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bacf4e-86c1-46b0-aaa0-a2a8094cc22a None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:01.516719 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c7520-fb12-481b-bd86-99e3be5b1ea3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:01.528559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:01.553822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a66c7-cf20-46fb-a389-add37653be68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:01.554741 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a66c7-cf20-46fb-a389-add37653be68 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:01.555138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a66c7-cf20-46fb-a389-add37653be68 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:01.555556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a66c7-cf20-46fb-a389-add37653be68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:01.556571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a66c7-cf20-46fb-a389-add37653be68 None admin] RBAC: Adding query filter params (role.id=ae11679806844c6f8d55ce5ccb32ee8b, scope.project.id=3d635b2ea7e04bb9918b295d4bb24798, user.id=b4f363b5e16e42eea33d3a46852cf542) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:01.557026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a66c7-cf20-46fb-a389-add37653be68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:01.558663 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a66c7-cf20-46fb-a389-add37653be68 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:01.560282 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad288c3-5fc4-4a4b-8395-d068a8c6a215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:01.561137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad288c3-5fc4-4a4b-8395-d068a8c6a215 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:01.561559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad288c3-5fc4-4a4b-8395-d068a8c6a215 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:01.561968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad288c3-5fc4-4a4b-8395-d068a8c6a215 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:01.564036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad288c3-5fc4-4a4b-8395-d068a8c6a215 None admin] RBAC: Adding query filter params (role.id=639e5e5307f34a64a854cfb59086518e, scope.project.id=ace9baa6f68746d49a7c11b95f550e58, user.id=b4f363b5e16e42eea33d3a46852cf542) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:01.564494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad288c3-5fc4-4a4b-8395-d068a8c6a215 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:01.565819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 51/96] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:01 2022] GET /identity/v3/role_assignments?user.id=b4f363b5e16e42eea33d3a46852cf542&scope.project.id=3d635b2ea7e04bb9918b295d4bb24798&role.id=ae11679806844c6f8d55ce5ccb32ee8b => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:01.566363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad288c3-5fc4-4a4b-8395-d068a8c6a215 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:01.573566 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 46/97] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:01 2022] GET /identity/v3/role_assignments?user.id=b4f363b5e16e42eea33d3a46852cf542&scope.project.id=ace9baa6f68746d49a7c11b95f550e58&role.id=639e5e5307f34a64a854cfb59086518e => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:02.834077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b5a73-3b24-4b59-b694-50f2bfc4f587 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:02.834613 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b5a73-3b24-4b59-b694-50f2bfc4f587 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:02.834687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b5a73-3b24-4b59-b694-50f2bfc4f587 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:02.836043 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 52/98] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:02.841300 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ddb95-41e1-4dcc-a715-15836189642b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:02.841679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ddb95-41e1-4dcc-a715-15836189642b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:02.841860 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ddb95-41e1-4dcc-a715-15836189642b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:02.866912 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3d6ddb95-41e1-4dcc-a715-15836189642b None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:02.868095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3d6ddb95-41e1-4dcc-a715-15836189642b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:02.959531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 47/99] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:01:02.989332 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b5a73-3b24-4b59-b694-50f2bfc4f587 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:03.071824 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:03.135885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b5a73-3b24-4b59-b694-50f2bfc4f587 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:03.185377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783306-a727-4644-9979-f7458fd07b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:03.186221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783306-a727-4644-9979-f7458fd07b00 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:03.186515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783306-a727-4644-9979-f7458fd07b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:03.186800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783306-a727-4644-9979-f7458fd07b00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:03.203410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9783306-a727-4644-9979-f7458fd07b00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:03.211519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-e9783306-a727-4644-9979-f7458fd07b00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:03.211519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:03.211519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:03.211519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:03.211519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:03.211519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:03.211519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:03.211519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:03.211519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:03.211519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:03.211519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:03.211519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:03.211519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:03.211519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:03.211519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:03.211519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:03.212869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:03.212869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:03.212869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:03.212869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:03.212869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:03.212869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:03.212869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:03.212869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:03.212869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:03.212869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:03.212869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:03.212869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:03.212869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:03.212869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:03.212869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:03.212869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:03.214057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:03.214057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:03.214057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:03.214057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:03.214057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:03.214057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:03.214057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:03.214057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:03.214057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:03.214057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:03.214057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:03.214057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:03.214057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 53/100] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:03.219341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ddb95-41e1-4dcc-a715-15836189642b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:03.349333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ddb95-41e1-4dcc-a715-15836189642b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:03.353363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:03.394490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59f28a-e8ae-4fd4-aff1-f47eb8875b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:03.395084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59f28a-e8ae-4fd4-aff1-f47eb8875b86 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:03.395366 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59f28a-e8ae-4fd4-aff1-f47eb8875b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:03.395641 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59f28a-e8ae-4fd4-aff1-f47eb8875b86 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:03.396390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59f28a-e8ae-4fd4-aff1-f47eb8875b86 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:03.396751 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59f28a-e8ae-4fd4-aff1-f47eb8875b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:03.398204 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59f28a-e8ae-4fd4-aff1-f47eb8875b86 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:03.407457 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 48/101] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:03.413086 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783306-a727-4644-9979-f7458fd07b00 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:03.554675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783306-a727-4644-9979-f7458fd07b00 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:03.572255 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:03.597498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80421c5d-81f4-4374-815c-bb3e3f0babc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:03.598421 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80421c5d-81f4-4374-815c-bb3e3f0babc7 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:03.598710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80421c5d-81f4-4374-815c-bb3e3f0babc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:03.598990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80421c5d-81f4-4374-815c-bb3e3f0babc7 None admin] PATH_INFO: `/v3/users/b4f363b5e16e42eea33d3a46852cf542` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:03.600475 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80421c5d-81f4-4374-815c-bb3e3f0babc7 None admin] RBAC: Authorizing `identity:get_user(user_id=b4f363b5e16e42eea33d3a46852cf542)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:03.601946 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80421c5d-81f4-4374-815c-bb3e3f0babc7 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:03.603840 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 54/102] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:03 2022] GET /identity/v3/users/b4f363b5e16e42eea33d3a46852cf542 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:03.609621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59f28a-e8ae-4fd4-aff1-f47eb8875b86 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:03.727228 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59f28a-e8ae-4fd4-aff1-f47eb8875b86 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:03.769541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb581d8c-c407-41b0-9538-7fed7c90e350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:03.770446 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb581d8c-c407-41b0-9538-7fed7c90e350 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:03.770737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb581d8c-c407-41b0-9538-7fed7c90e350 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:03.771016 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb581d8c-c407-41b0-9538-7fed7c90e350 None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:03.772267 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb581d8c-c407-41b0-9538-7fed7c90e350 None admin] RBAC: Authorizing `identity:get_project(project_id=ace9baa6f68746d49a7c11b95f550e58)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:03.773730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb581d8c-c407-41b0-9538-7fed7c90e350 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:03.775822 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 49/103] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:03 2022] GET /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:03.781402 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80421c5d-81f4-4374-815c-bb3e3f0babc7 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:03.936396 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80421c5d-81f4-4374-815c-bb3e3f0babc7 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:03.984075 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916473f-be6b-435d-9e9b-5b1ef7f39423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:03.985283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916473f-be6b-435d-9e9b-5b1ef7f39423 None admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:03.985763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916473f-be6b-435d-9e9b-5b1ef7f39423 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:03.986256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916473f-be6b-435d-9e9b-5b1ef7f39423 None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58/users/b4f363b5e16e42eea33d3a46852cf542/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:03.988515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916473f-be6b-435d-9e9b-5b1ef7f39423 None admin] RBAC: Authorizing `identity:create_grant(project_id=ace9baa6f68746d49a7c11b95f550e58, user_id=b4f363b5e16e42eea33d3a46852cf542, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:03.990212 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916473f-be6b-435d-9e9b-5b1ef7f39423 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:04.017087 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 55/104] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:01:03 2022] PUT /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58/users/b4f363b5e16e42eea33d3a46852cf542/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:01:04.296294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd6190-8677-4d02-9ad7-54ab426b8819 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:04.296294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd6190-8677-4d02-9ad7-54ab426b8819 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:04.296294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd6190-8677-4d02-9ad7-54ab426b8819 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:04.296294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 50/105] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:04.303594 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd9665-8908-4fdf-89c4-f20a4a7a1750 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:04.303886 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd9665-8908-4fdf-89c4-f20a4a7a1750 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:04.304170 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd9665-8908-4fdf-89c4-f20a4a7a1750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:04.331364 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-fcdd9665-8908-4fdf-89c4-f20a4a7a1750 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:04.332579 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-fcdd9665-8908-4fdf-89c4-f20a4a7a1750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:04.385084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:04.413165 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 56/106] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:04.419839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e139c3c-daed-4b81-95c3-f495e0415ee4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:04.420137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e139c3c-daed-4b81-95c3-f495e0415ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:04.420423 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e139c3c-daed-4b81-95c3-f495e0415ee4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:04.421811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 51/107] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:04.440991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191a33b-ed90-4c9b-8a0a-bd059a1bd98b None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:04.440991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191a33b-ed90-4c9b-8a0a-bd059a1bd98b None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:04.440991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191a33b-ed90-4c9b-8a0a-bd059a1bd98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:04.446967 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e139c3c-daed-4b81-95c3-f495e0415ee4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:04.460925 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-3191a33b-ed90-4c9b-8a0a-bd059a1bd98b None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:04.462691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-3191a33b-ed90-4c9b-8a0a-bd059a1bd98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:04.516153 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:04.614221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 57/108] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:04.615233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e139c3c-daed-4b81-95c3-f495e0415ee4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:04.675662 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289f0ea-49cf-4ae5-9de1-537aa904e582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:04.676486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289f0ea-49cf-4ae5-9de1-537aa904e582 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:04.676775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289f0ea-49cf-4ae5-9de1-537aa904e582 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:04.677110 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289f0ea-49cf-4ae5-9de1-537aa904e582 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:04.692932 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289f0ea-49cf-4ae5-9de1-537aa904e582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:04.694648 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191a33b-ed90-4c9b-8a0a-bd059a1bd98b None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:04.701554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f289f0ea-49cf-4ae5-9de1-537aa904e582 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:01:04.701554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:04.701554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:04.701554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:04.701554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:04.701554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:04.701554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:04.701554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:04.701554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:04.701554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:04.701554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:04.701554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:04.701554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:04.701554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:04.701554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:04.701554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:04.702439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:04.702439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:04.702439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:04.702439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:04.702439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:04.702439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:04.702439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:04.702439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:04.702439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:04.702439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:04.702439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:04.702439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:04.702439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:04.702439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:04.702439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:04.702439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:04.703669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:04.703669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:04.703669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:04.703669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:04.703669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:04.703669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:04.703669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:04.703669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:04.703669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:04.703669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:04.703669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:01:04.703669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:04.703669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 52/109] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:01:04.709518 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289f0ea-49cf-4ae5-9de1-537aa904e582 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:04.834451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:04.840897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191a33b-ed90-4c9b-8a0a-bd059a1bd98b None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:04.844070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:04.846043 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289f0ea-49cf-4ae5-9de1-537aa904e582 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:04.880114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea888a-7923-4e01-b0c8-d9ceeea2adff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:04.880815 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea888a-7923-4e01-b0c8-d9ceeea2adff None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:04.881104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea888a-7923-4e01-b0c8-d9ceeea2adff None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:04.881381 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea888a-7923-4e01-b0c8-d9ceeea2adff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:04.891704 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd0611-d1ab-4b29-ad6c-0858753876d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:04.892645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd0611-d1ab-4b29-ad6c-0858753876d5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:04.893344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd0611-d1ab-4b29-ad6c-0858753876d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:04.893751 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea888a-7923-4e01-b0c8-d9ceeea2adff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:04.893993 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd0611-d1ab-4b29-ad6c-0858753876d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:04.894941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd0611-d1ab-4b29-ad6c-0858753876d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:04.895415 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd0611-d1ab-4b29-ad6c-0858753876d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:04.896970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd0611-d1ab-4b29-ad6c-0858753876d5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:04.903230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-62ea888a-7923-4e01-b0c8-d9ceeea2adff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:01:04.903230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:04.903230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:04.903230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:04.903230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:04.903230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:04.903230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:04.903230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:04.903230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:04.903230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:04.903230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:04.903230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:04.903230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:04.903230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:04.903230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:04.903230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:04.904058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:04.904058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:04.904058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:04.904058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:04.904058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:04.904058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:04.904058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:04.904058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:04.904058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:04.904058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:04.904058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:04.904058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:04.904058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:04.904058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:04.904058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:04.904058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:04.904991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:04.904991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:04.904991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:04.904991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:04.904991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:04.904991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:04.904991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:04.904991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:04.904991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:04.904991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:04.904991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:01:04.904991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:04.904991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 58/110] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:01:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:01:04.906174 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285570b-8ccd-4a10-a84c-295bf8f7114e None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:04.906533 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285570b-8ccd-4a10-a84c-295bf8f7114e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:04.906884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285570b-8ccd-4a10-a84c-295bf8f7114e None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:04.908250 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 59/111] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:04.909408 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d89824-1cac-40ea-9d80-1b625e7ab877 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:04.909808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d89824-1cac-40ea-9d80-1b625e7ab877 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:04.910191 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d89824-1cac-40ea-9d80-1b625e7ab877 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:04.910505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 53/112] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:04.911717 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd0611-d1ab-4b29-ad6c-0858753876d5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:04.916641 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 60/113] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:04.917671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d5bb6-0118-4822-9823-8875cbc83c68 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:04.917967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d5bb6-0118-4822-9823-8875cbc83c68 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:04.918272 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d5bb6-0118-4822-9823-8875cbc83c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:04.937108 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-dd1d5bb6-0118-4822-9823-8875cbc83c68 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:04.938334 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-dd1d5bb6-0118-4822-9823-8875cbc83c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:05.012319 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 61/114] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:05.013219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d5bb6-0118-4822-9823-8875cbc83c68 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:05.050136 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd0611-d1ab-4b29-ad6c-0858753876d5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:05.085481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc473c4-7933-4e34-811d-f1254367bebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:05.086261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc473c4-7933-4e34-811d-f1254367bebe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:05.086575 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc473c4-7933-4e34-811d-f1254367bebe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:05.086856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc473c4-7933-4e34-811d-f1254367bebe None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:05.088178 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc473c4-7933-4e34-811d-f1254367bebe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:05.088485 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc473c4-7933-4e34-811d-f1254367bebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:05.089874 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc473c4-7933-4e34-811d-f1254367bebe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:05.098417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 54/115] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:05.100566 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d91a46-15ef-42e3-b00d-a6c1c65d5aa2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:05.100864 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d91a46-15ef-42e3-b00d-a6c1c65d5aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:05.101141 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d91a46-15ef-42e3-b00d-a6c1c65d5aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:05.114695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:05.119677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c1d91a46-15ef-42e3-b00d-a6c1c65d5aa2 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:05.120864 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c1d91a46-15ef-42e3-b00d-a6c1c65d5aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:05.122552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d5bb6-0118-4822-9823-8875cbc83c68 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:05.135237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:05.162476 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff5007-2d34-4ec4-9659-b2c27aa52ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:05.163419 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff5007-2d34-4ec4-9659-b2c27aa52ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:05.163710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff5007-2d34-4ec4-9659-b2c27aa52ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:05.163985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff5007-2d34-4ec4-9659-b2c27aa52ae5 None admin] PATH_INFO: `/v3/users/a556370c96284547a0c2f4711c3b428d` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:05.183089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff5007-2d34-4ec4-9659-b2c27aa52ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=a556370c96284547a0c2f4711c3b428d)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:05.184997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff5007-2d34-4ec4-9659-b2c27aa52ae5 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:05.187609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 62/116] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:05 2022] GET /identity/v3/users/a556370c96284547a0c2f4711c3b428d => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:05.190864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff5007-2d34-4ec4-9659-b2c27aa52ae5 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:05.197570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 55/117] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:05.199005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddc571-1b9c-4d9a-a393-ed7e2d1839fd None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:05.199385 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddc571-1b9c-4d9a-a393-ed7e2d1839fd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:05.199730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddc571-1b9c-4d9a-a393-ed7e2d1839fd None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:05.201498 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 56/118] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:05.206528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddc571-1b9c-4d9a-a393-ed7e2d1839fd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:05.301920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff5007-2d34-4ec4-9659-b2c27aa52ae5 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:05.316115 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddc571-1b9c-4d9a-a393-ed7e2d1839fd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:05.335758 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a7b27-0b56-4078-b304-15064917b845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:05.336555 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a7b27-0b56-4078-b304-15064917b845 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:05.336842 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a7b27-0b56-4078-b304-15064917b845 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:05.337142 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a7b27-0b56-4078-b304-15064917b845 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:05.346962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a7b27-0b56-4078-b304-15064917b845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:05.351173 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f41c3-569e-4998-bc32-54ee08b4f133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:05.352048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f41c3-569e-4998-bc32-54ee08b4f133 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:05.352331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f41c3-569e-4998-bc32-54ee08b4f133 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:05.352604 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f41c3-569e-4998-bc32-54ee08b4f133 None admin] PATH_INFO: `/v3/users/2482f101e58a43bca5e9411a6d355e61` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:05.353824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f41c3-569e-4998-bc32-54ee08b4f133 None admin] RBAC: Authorizing `identity:get_user(user_id=2482f101e58a43bca5e9411a6d355e61)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:05.354650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-0c5a7b27-0b56-4078-b304-15064917b845 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:05.354650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:05.354650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:05.354650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:05.354650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:05.354650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:05.354650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:05.354650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:05.354650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:05.354650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:05.354650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:05.354650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:05.354650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:05.354650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:05.354650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:05.354650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:05.355454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:05.355454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:05.355454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:05.355454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:05.355454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:05.355454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:05.355454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:05.355454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:05.355454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:05.355454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:05.355454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:05.355454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:05.355454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:05.355454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:05.355454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:05.355454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:05.361621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:05.361621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:05.361621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:05.361621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:05.361621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:05.361621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:05.361621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:05.361621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:05.361621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:05.361621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:05.361621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:05.361621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:05.362225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f41c3-569e-4998-bc32-54ee08b4f133 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:05.362291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 63/119] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:05.362291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a7b27-0b56-4078-b304-15064917b845 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:05.362407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 57/120] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:05 2022] GET /identity/v3/users/2482f101e58a43bca5e9411a6d355e61 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:05.362470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eab6e3-bc1b-46aa-bc60-4e2a90b9e707 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:05.362823 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eab6e3-bc1b-46aa-bc60-4e2a90b9e707 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:05.362999 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eab6e3-bc1b-46aa-bc60-4e2a90b9e707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:05.376149 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:05.383157 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-66eab6e3-bc1b-46aa-bc60-4e2a90b9e707 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:05.384979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-66eab6e3-bc1b-46aa-bc60-4e2a90b9e707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:05.395993 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:05.466022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 58/121] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:05.466022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eab6e3-bc1b-46aa-bc60-4e2a90b9e707 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:05.480439 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a7b27-0b56-4078-b304-15064917b845 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:05.519393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743d739-aec1-45f1-9a39-c8894ea31416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:05.520626 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743d739-aec1-45f1-9a39-c8894ea31416 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:05.520924 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743d739-aec1-45f1-9a39-c8894ea31416 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:05.521207 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743d739-aec1-45f1-9a39-c8894ea31416 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:05.566978 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eab6e3-bc1b-46aa-bc60-4e2a90b9e707 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:05.593142 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743d739-aec1-45f1-9a39-c8894ea31416 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:05.594648 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743d739-aec1-45f1-9a39-c8894ea31416 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:05.603650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1a2b5-2272-405f-a3e1-960f056c4749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:05.604573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1a2b5-2272-405f-a3e1-960f056c4749 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:05.604849 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1a2b5-2272-405f-a3e1-960f056c4749 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:05.605127 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1a2b5-2272-405f-a3e1-960f056c4749 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:05.608465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:05.617130 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1a2b5-2272-405f-a3e1-960f056c4749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:05.626702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-34a1a2b5-2272-405f-a3e1-960f056c4749 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:05.626702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:05.626702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:05.626702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:05.626702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:05.626702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:05.626702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:05.626702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:05.626702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:05.626702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:05.626702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:05.626702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:05.626702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:05.626702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:05.626702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:05.626702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:05.627626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:05.627626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:05.627626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:05.627626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:05.627626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:05.627626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:05.627626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:05.627626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:05.627626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:05.627626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:05.627626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:05.627626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:05.627626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:05.627626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:05.627626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:05.627626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:05.628375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:05.628375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:05.628375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:05.628375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:05.628375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:05.628375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:05.628375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:05.628375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:05.628375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:05.628375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:05.628375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:05.628375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:05.628375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 59/122] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:01:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:05.628983 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1a2b5-2272-405f-a3e1-960f056c4749 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:05.638123 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:05.700622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 64/123] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:05.701468 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743d739-aec1-45f1-9a39-c8894ea31416 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:05.738899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1a2b5-2272-405f-a3e1-960f056c4749 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:05.772551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308d538-a5ce-4356-bc41-584087838842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:05.773308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308d538-a5ce-4356-bc41-584087838842 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:05.773604 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308d538-a5ce-4356-bc41-584087838842 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:05.773886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308d538-a5ce-4356-bc41-584087838842 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:05.774707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308d538-a5ce-4356-bc41-584087838842 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:05.775021 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308d538-a5ce-4356-bc41-584087838842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:05.776432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308d538-a5ce-4356-bc41-584087838842 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:05.789575 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 60/124] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:05.789575 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308d538-a5ce-4356-bc41-584087838842 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:05.812614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743d739-aec1-45f1-9a39-c8894ea31416 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:05.825600 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:05.848506 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0248f-a186-4fee-8d8c-6b8b36eda63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:05.849380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0248f-a186-4fee-8d8c-6b8b36eda63e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:05.849670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0248f-a186-4fee-8d8c-6b8b36eda63e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:05.850036 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0248f-a186-4fee-8d8c-6b8b36eda63e None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:05.851264 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0248f-a186-4fee-8d8c-6b8b36eda63e None admin] RBAC: Authorizing `identity:get_project(project_id=ace9baa6f68746d49a7c11b95f550e58)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:05.853246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0248f-a186-4fee-8d8c-6b8b36eda63e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:05.855157 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 65/125] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:05 2022] GET /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:05.855765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0248f-a186-4fee-8d8c-6b8b36eda63e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:05.858668 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:05.898033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308d538-a5ce-4356-bc41-584087838842 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:05.934013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc43f7b-ea9d-46d3-8763-288852bbca37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:05.934840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc43f7b-ea9d-46d3-8763-288852bbca37 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:05.935125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc43f7b-ea9d-46d3-8763-288852bbca37 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:05.935402 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc43f7b-ea9d-46d3-8763-288852bbca37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:05.936583 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc43f7b-ea9d-46d3-8763-288852bbca37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:05.938061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc43f7b-ea9d-46d3-8763-288852bbca37 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:05.939681 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 61/126] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:05.940444 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc43f7b-ea9d-46d3-8763-288852bbca37 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:05.969783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0248f-a186-4fee-8d8c-6b8b36eda63e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:06.006374 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ac59b-d41e-48e4-bcd2-f72874583f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:06.007069 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ac59b-d41e-48e4-bcd2-f72874583f2b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:06.007362 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ac59b-d41e-48e4-bcd2-f72874583f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:06.007633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ac59b-d41e-48e4-bcd2-f72874583f2b None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:06.008424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ac59b-d41e-48e4-bcd2-f72874583f2b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:06.008815 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ac59b-d41e-48e4-bcd2-f72874583f2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:06.010380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ac59b-d41e-48e4-bcd2-f72874583f2b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:06.023246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 66/127] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:01:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:06.023246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ac59b-d41e-48e4-bcd2-f72874583f2b None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:06.045107 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc43f7b-ea9d-46d3-8763-288852bbca37 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:06.065383 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:06.087786 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea999144-b677-4bb3-b855-669e2edec8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:06.088562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea999144-b677-4bb3-b855-669e2edec8ad None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:06.088923 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea999144-b677-4bb3-b855-669e2edec8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:06.089210 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea999144-b677-4bb3-b855-669e2edec8ad None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:06.090469 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea999144-b677-4bb3-b855-669e2edec8ad None admin] RBAC: Authorizing `identity:get_project(project_id=ace9baa6f68746d49a7c11b95f550e58)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:06.091999 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea999144-b677-4bb3-b855-669e2edec8ad None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:06.093818 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 62/128] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:05 2022] GET /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:06.099072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea999144-b677-4bb3-b855-669e2edec8ad None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:06.104071 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:06.133204 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ac59b-d41e-48e4-bcd2-f72874583f2b None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:06.172021 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6477352-5176-459b-80f4-b3aa2e22ff59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:06.172917 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6477352-5176-459b-80f4-b3aa2e22ff59 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:06.173189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6477352-5176-459b-80f4-b3aa2e22ff59 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:06.173462 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6477352-5176-459b-80f4-b3aa2e22ff59 None admin] PATH_INFO: `/v3/users/b4f363b5e16e42eea33d3a46852cf542` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:06.174720 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6477352-5176-459b-80f4-b3aa2e22ff59 None admin] RBAC: Authorizing `identity:get_user(user_id=b4f363b5e16e42eea33d3a46852cf542)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:06.176170 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6477352-5176-459b-80f4-b3aa2e22ff59 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:06.182403 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 67/129] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:06 2022] GET /identity/v3/users/b4f363b5e16e42eea33d3a46852cf542 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:06.182403 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6477352-5176-459b-80f4-b3aa2e22ff59 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:06.207198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea999144-b677-4bb3-b855-669e2edec8ad None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:06.242102 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a0545-0528-4323-9f3a-1e2f6ba4e964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:06.242940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a0545-0528-4323-9f3a-1e2f6ba4e964 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:06.243219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a0545-0528-4323-9f3a-1e2f6ba4e964 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:06.243534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a0545-0528-4323-9f3a-1e2f6ba4e964 None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58/users/2482f101e58a43bca5e9411a6d355e61/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:06.245515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a0545-0528-4323-9f3a-1e2f6ba4e964 None admin] RBAC: Authorizing `identity:create_grant(project_id=ace9baa6f68746d49a7c11b95f550e58, user_id=2482f101e58a43bca5e9411a6d355e61, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:06.247017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a0545-0528-4323-9f3a-1e2f6ba4e964 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:06.261130 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 63/130] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:01:06 2022] PUT /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58/users/2482f101e58a43bca5e9411a6d355e61/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:01:06.262192 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a0545-0528-4323-9f3a-1e2f6ba4e964 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:06.300824 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6477352-5176-459b-80f4-b3aa2e22ff59 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:06.314118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:06.344068 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:06.352302 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f9b30-016d-46aa-a997-da8d76ea2976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:06.353873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f9b30-016d-46aa-a997-da8d76ea2976 None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:06.354365 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f9b30-016d-46aa-a997-da8d76ea2976 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:06.354786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f9b30-016d-46aa-a997-da8d76ea2976 None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:06.355595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f9b30-016d-46aa-a997-da8d76ea2976 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:06.358308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f9b30-016d-46aa-a997-da8d76ea2976 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:06.394700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a0545-0528-4323-9f3a-1e2f6ba4e964 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:06.403411 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 68/131] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 12:01:06 2022] POST /identity/v3/projects => generated 302 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:01:06.405024 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f9b30-016d-46aa-a997-da8d76ea2976 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:06.453394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55d91b-7df5-4569-9a2b-6e06b3d0cbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:06.454389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55d91b-7df5-4569-9a2b-6e06b3d0cbea None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:06.454679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55d91b-7df5-4569-9a2b-6e06b3d0cbea None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:06.454956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55d91b-7df5-4569-9a2b-6e06b3d0cbea None admin] PATH_INFO: `/v3/users/b4f363b5e16e42eea33d3a46852cf542` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:06.457032 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55d91b-7df5-4569-9a2b-6e06b3d0cbea None admin] RBAC: Authorizing `identity:get_user(user_id=b4f363b5e16e42eea33d3a46852cf542)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:06.458698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55d91b-7df5-4569-9a2b-6e06b3d0cbea None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:06.460678 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 64/132] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:06 2022] GET /identity/v3/users/b4f363b5e16e42eea33d3a46852cf542 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:06.461290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55d91b-7df5-4569-9a2b-6e06b3d0cbea None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:06.557745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f9b30-016d-46aa-a997-da8d76ea2976 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:06.593970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55d91b-7df5-4569-9a2b-6e06b3d0cbea None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:06.606710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b1833-e94d-4645-999d-f4e84f788f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:06.607614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b1833-e94d-4645-999d-f4e84f788f1c None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:06.608223 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b1833-e94d-4645-999d-f4e84f788f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:06.608651 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b1833-e94d-4645-999d-f4e84f788f1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:06.610082 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b1833-e94d-4645-999d-f4e84f788f1c None admin] RBAC: Adding query filter params (role.id=89c1404610d74d74bdd3ea913c3de5ba, scope.project.id=ace9baa6f68746d49a7c11b95f550e58, user.id=a556370c96284547a0c2f4711c3b428d) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:06.610555 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b1833-e94d-4645-999d-f4e84f788f1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:06.612570 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b1833-e94d-4645-999d-f4e84f788f1c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:06.621669 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 69/133] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:06 2022] GET /identity/v3/role_assignments?user.id=a556370c96284547a0c2f4711c3b428d&scope.project.id=ace9baa6f68746d49a7c11b95f550e58&role.id=89c1404610d74d74bdd3ea913c3de5ba => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:06.623655 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8b0b9-ff76-405a-a82d-a7b431b0d38b None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:06.624109 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8b0b9-ff76-405a-a82d-a7b431b0d38b None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:06.624839 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8b0b9-ff76-405a-a82d-a7b431b0d38b None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:06.626878 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 70/134] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:06.628227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8b0b9-ff76-405a-a82d-a7b431b0d38b None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:06.629269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:06.644721 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57ed97-8b35-426d-a501-1597d82c5379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:06.645941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57ed97-8b35-426d-a501-1597d82c5379 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:06.646359 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57ed97-8b35-426d-a501-1597d82c5379 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:06.647255 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57ed97-8b35-426d-a501-1597d82c5379 None admin] PATH_INFO: `/v3/projects/3d635b2ea7e04bb9918b295d4bb24798` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:06.649411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57ed97-8b35-426d-a501-1597d82c5379 None admin] RBAC: Authorizing `identity:get_project(project_id=3d635b2ea7e04bb9918b295d4bb24798)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:06.652268 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57ed97-8b35-426d-a501-1597d82c5379 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:06.654766 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 65/135] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:06 2022] GET /identity/v3/projects/3d635b2ea7e04bb9918b295d4bb24798 => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:06.656847 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895b9c5-b411-467e-ba25-9fd3b561f246 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:06.656847 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895b9c5-b411-467e-ba25-9fd3b561f246 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:06.657052 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895b9c5-b411-467e-ba25-9fd3b561f246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:06.669034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:06.679889 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a895b9c5-b411-467e-ba25-9fd3b561f246 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:06.682304 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a895b9c5-b411-467e-ba25-9fd3b561f246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:06.765329 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8b0b9-ff76-405a-a82d-a7b431b0d38b None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:06.806830 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 66/136] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:06.808075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895b9c5-b411-467e-ba25-9fd3b561f246 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:06.821475 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580b357-87d8-4d11-80c3-003cb5fbeaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:06.834071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580b357-87d8-4d11-80c3-003cb5fbeaad None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:06.834071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580b357-87d8-4d11-80c3-003cb5fbeaad None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:06.834071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580b357-87d8-4d11-80c3-003cb5fbeaad None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:06.834071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580b357-87d8-4d11-80c3-003cb5fbeaad None admin] RBAC: Authorizing `identity:get_project(project_id=ace9baa6f68746d49a7c11b95f550e58)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:06.834071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580b357-87d8-4d11-80c3-003cb5fbeaad None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:06.836644 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 71/137] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:06 2022] GET /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:06.838418 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580b357-87d8-4d11-80c3-003cb5fbeaad None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:06.947393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:06.954837 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580b357-87d8-4d11-80c3-003cb5fbeaad None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:07.002662 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448befa1-84b0-4423-9b8f-b28e0a3bafb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:07.003464 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448befa1-84b0-4423-9b8f-b28e0a3bafb6 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:07.003747 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448befa1-84b0-4423-9b8f-b28e0a3bafb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:07.008665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448befa1-84b0-4423-9b8f-b28e0a3bafb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:07.025376 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448befa1-84b0-4423-9b8f-b28e0a3bafb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:07.033070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-448befa1-84b0-4423-9b8f-b28e0a3bafb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:07.033070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:07.033070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:07.033070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:07.033070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:07.033070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:07.033070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:07.033070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:07.033070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:07.033070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:07.033070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:07.033070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:07.033070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:07.033070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:07.033070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:07.033070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:07.033920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:07.033920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:07.033920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:07.033920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:07.033920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:07.033920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:07.033920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:07.033920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:07.033920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:07.033920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:07.033920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:07.033920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:07.033920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:07.033920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:07.033920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:07.033920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:07.034702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:07.034702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:07.034702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:07.034702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:07.034702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:07.034702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:07.034702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:07.034702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:07.034702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:07.034702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:07.034702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:07.034702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:07.038741 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 72/138] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:07.039688 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448befa1-84b0-4423-9b8f-b28e0a3bafb6 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:07.052505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895b9c5-b411-467e-ba25-9fd3b561f246 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:07.114441 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:07.123072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d62bb1-78ba-40a7-a1a1-1893092d826a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:07.123970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d62bb1-78ba-40a7-a1a1-1893092d826a None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:07.124249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d62bb1-78ba-40a7-a1a1-1893092d826a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:07.124519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d62bb1-78ba-40a7-a1a1-1893092d826a None admin] PATH_INFO: `/v3/projects/3d635b2ea7e04bb9918b295d4bb24798/users/b4f363b5e16e42eea33d3a46852cf542/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:07.128692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d62bb1-78ba-40a7-a1a1-1893092d826a None admin] RBAC: Authorizing `identity:create_grant(project_id=3d635b2ea7e04bb9918b295d4bb24798, user_id=b4f363b5e16e42eea33d3a46852cf542, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:07.130194 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d62bb1-78ba-40a7-a1a1-1893092d826a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:07.158719 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 67/139] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:01:06 2022] PUT /identity/v3/projects/3d635b2ea7e04bb9918b295d4bb24798/users/b4f363b5e16e42eea33d3a46852cf542/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:01:07.159541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d62bb1-78ba-40a7-a1a1-1893092d826a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:07.234176 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448befa1-84b0-4423-9b8f-b28e0a3bafb6 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:07.279339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b05cd9-9c20-4b26-97ac-6f05fd15153e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:07.281281 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b05cd9-9c20-4b26-97ac-6f05fd15153e None admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:07.281571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b05cd9-9c20-4b26-97ac-6f05fd15153e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:07.281858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b05cd9-9c20-4b26-97ac-6f05fd15153e None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58/users/b4f363b5e16e42eea33d3a46852cf542/roles/639e5e5307f34a64a854cfb59086518e` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:07.288329 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b05cd9-9c20-4b26-97ac-6f05fd15153e None admin] RBAC: Authorizing `identity:create_grant(project_id=ace9baa6f68746d49a7c11b95f550e58, user_id=b4f363b5e16e42eea33d3a46852cf542, role_id=639e5e5307f34a64a854cfb59086518e)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:07.291840 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b05cd9-9c20-4b26-97ac-6f05fd15153e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:07.320858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 73/140] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:01:07 2022] PUT /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58/users/b4f363b5e16e42eea33d3a46852cf542/roles/639e5e5307f34a64a854cfb59086518e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:01:07.354773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d62bb1-78ba-40a7-a1a1-1893092d826a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:07.408928 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e730999-3d1f-48f3-abe5-fdaac6d1fc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:07.409556 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e730999-3d1f-48f3-abe5-fdaac6d1fc7f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:07.409828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e730999-3d1f-48f3-abe5-fdaac6d1fc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:07.410132 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e730999-3d1f-48f3-abe5-fdaac6d1fc7f None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:07.410896 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e730999-3d1f-48f3-abe5-fdaac6d1fc7f None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:07.411204 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e730999-3d1f-48f3-abe5-fdaac6d1fc7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:07.412672 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e730999-3d1f-48f3-abe5-fdaac6d1fc7f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:07.422725 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 68/141] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:07.427974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b05cd9-9c20-4b26-97ac-6f05fd15153e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:07.448245 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:07.571264 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b05cd9-9c20-4b26-97ac-6f05fd15153e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:07.611073 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e04044-e573-4a3e-bcb5-8a2f2087b42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:07.611958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e04044-e573-4a3e-bcb5-8a2f2087b42a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:07.612244 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e04044-e573-4a3e-bcb5-8a2f2087b42a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:07.612521 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e04044-e573-4a3e-bcb5-8a2f2087b42a None admin] PATH_INFO: `/v3/users/b4f363b5e16e42eea33d3a46852cf542` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:07.613734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e04044-e573-4a3e-bcb5-8a2f2087b42a None admin] RBAC: Authorizing `identity:get_user(user_id=b4f363b5e16e42eea33d3a46852cf542)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:07.615228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e04044-e573-4a3e-bcb5-8a2f2087b42a None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:07.616858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 74/142] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:07 2022] GET /identity/v3/users/b4f363b5e16e42eea33d3a46852cf542 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:07.622888 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e730999-3d1f-48f3-abe5-fdaac6d1fc7f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:07.690484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:07.745599 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e730999-3d1f-48f3-abe5-fdaac6d1fc7f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:07.803709 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba25584-fed5-4e4a-bc61-b522a77057bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:07.804376 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba25584-fed5-4e4a-bc61-b522a77057bc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:07.804749 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba25584-fed5-4e4a-bc61-b522a77057bc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:07.805047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba25584-fed5-4e4a-bc61-b522a77057bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:07.902241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba25584-fed5-4e4a-bc61-b522a77057bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:07.903750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba25584-fed5-4e4a-bc61-b522a77057bc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:07.983588 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:08.037715 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 69/143] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:08.043912 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e04044-e573-4a3e-bcb5-8a2f2087b42a None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:08.147663 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:08.171056 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e04044-e573-4a3e-bcb5-8a2f2087b42a None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:08.217327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899a83c-ad0e-4e87-bd4d-f7f093b17f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:08.218217 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899a83c-ad0e-4e87-bd4d-f7f093b17f6b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:08.218501 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899a83c-ad0e-4e87-bd4d-f7f093b17f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:08.218774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899a83c-ad0e-4e87-bd4d-f7f093b17f6b None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:08.219966 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899a83c-ad0e-4e87-bd4d-f7f093b17f6b None admin] RBAC: Authorizing `identity:get_project(project_id=ace9baa6f68746d49a7c11b95f550e58)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:08.221417 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899a83c-ad0e-4e87-bd4d-f7f093b17f6b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:08.223433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 75/144] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:08 2022] GET /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:08.229805 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba25584-fed5-4e4a-bc61-b522a77057bc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:08.379835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba25584-fed5-4e4a-bc61-b522a77057bc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:08.423870 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050d1f1-9174-4678-bdff-8acf4912ff8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:08.424544 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050d1f1-9174-4678-bdff-8acf4912ff8e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:08.424832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050d1f1-9174-4678-bdff-8acf4912ff8e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:08.425113 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050d1f1-9174-4678-bdff-8acf4912ff8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:08.425959 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050d1f1-9174-4678-bdff-8acf4912ff8e None admin] RBAC: Adding query filter params (role.id=ae11679806844c6f8d55ce5ccb32ee8b, scope.project.id=ace9baa6f68746d49a7c11b95f550e58, user.id=b4f363b5e16e42eea33d3a46852cf542) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:08.426303 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050d1f1-9174-4678-bdff-8acf4912ff8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:08.427760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050d1f1-9174-4678-bdff-8acf4912ff8e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:08.438856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 70/145] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:08 2022] GET /identity/v3/role_assignments?user.id=b4f363b5e16e42eea33d3a46852cf542&scope.project.id=ace9baa6f68746d49a7c11b95f550e58&role.id=ae11679806844c6f8d55ce5ccb32ee8b => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:08.724448 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70507fd2-96c6-4bc7-83b9-1135943897c5 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:08.724814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70507fd2-96c6-4bc7-83b9-1135943897c5 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:08.725008 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70507fd2-96c6-4bc7-83b9-1135943897c5 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:08.726457 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 76/146] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:08.732356 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ffca8-234f-4689-a266-4303d9671b7c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:08.732649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ffca8-234f-4689-a266-4303d9671b7c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:08.732936 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ffca8-234f-4689-a266-4303d9671b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:08.753128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-eb3ffca8-234f-4689-a266-4303d9671b7c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:08.754512 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-eb3ffca8-234f-4689-a266-4303d9671b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:08.768060 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:08.830916 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 71/147] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:08.872929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70507fd2-96c6-4bc7-83b9-1135943897c5 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:09.011241 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70507fd2-96c6-4bc7-83b9-1135943897c5 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:09.054693 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc0aa0-5242-4057-955d-c6cbdf7326c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:09.055507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc0aa0-5242-4057-955d-c6cbdf7326c8 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:09.055798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc0aa0-5242-4057-955d-c6cbdf7326c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:09.056664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc0aa0-5242-4057-955d-c6cbdf7326c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:09.067437 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc0aa0-5242-4057-955d-c6cbdf7326c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:09.075710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-6ffc0aa0-5242-4057-955d-c6cbdf7326c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:01:09.075710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:09.075710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:09.075710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:09.075710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:09.075710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:09.075710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:09.075710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:09.075710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:09.075710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:09.075710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:09.075710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:09.075710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:09.075710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:09.075710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:09.075710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:09.076523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:09.076523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:09.076523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:09.076523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:09.076523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:09.076523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:09.076523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:09.076523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:09.076523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:09.076523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:09.076523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:09.076523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:09.076523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:09.076523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:09.076523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:09.076523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:09.077707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:09.077707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:09.077707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:09.077707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:09.077707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:09.077707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:09.077707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:09.077707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:09.077707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:09.077707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:09.077707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:01:09.077707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:09.077707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 77/148] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:01:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:09.082866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ffca8-234f-4689-a266-4303d9671b7c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:09.245353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ffca8-234f-4689-a266-4303d9671b7c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:09.276834 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20c810-57d2-4f75-9cfb-eabeb62f23ea None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:09.277116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20c810-57d2-4f75-9cfb-eabeb62f23ea None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:09.277313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20c810-57d2-4f75-9cfb-eabeb62f23ea None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:09.278871 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 78/149] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:01:09.286195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c4883-fec2-4864-8548-fe64b16fcdfc None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:09.286488 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c4883-fec2-4864-8548-fe64b16fcdfc None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:09.286768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c4883-fec2-4864-8548-fe64b16fcdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:09.311265 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-652c4883-fec2-4864-8548-fe64b16fcdfc None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:09.312745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-652c4883-fec2-4864-8548-fe64b16fcdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:09.317846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5679e9-de26-4155-ab06-c0b47e5b6b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:09.318803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5679e9-de26-4155-ab06-c0b47e5b6b88 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:09.319167 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5679e9-de26-4155-ab06-c0b47e5b6b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:09.319447 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5679e9-de26-4155-ab06-c0b47e5b6b88 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:09.320595 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5679e9-de26-4155-ab06-c0b47e5b6b88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:09.320914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5679e9-de26-4155-ab06-c0b47e5b6b88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:09.322937 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5679e9-de26-4155-ab06-c0b47e5b6b88 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:09.338114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:09.339698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 72/150] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:09.345374 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5679e9-de26-4155-ab06-c0b47e5b6b88 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:09.361469 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:09.457392 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 79/151] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:09.504094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c4883-fec2-4864-8548-fe64b16fcdfc None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:09.548918 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5679e9-de26-4155-ab06-c0b47e5b6b88 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:09.615832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ad2af-0ebb-4fdb-9b7a-e76d3aca28a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:09.616718 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ad2af-0ebb-4fdb-9b7a-e76d3aca28a0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:09.617000 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ad2af-0ebb-4fdb-9b7a-e76d3aca28a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:09.617277 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ad2af-0ebb-4fdb-9b7a-e76d3aca28a0 None admin] PATH_INFO: `/v3/users/2482f101e58a43bca5e9411a6d355e61` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:09.619332 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ad2af-0ebb-4fdb-9b7a-e76d3aca28a0 None admin] RBAC: Authorizing `identity:get_user(user_id=2482f101e58a43bca5e9411a6d355e61)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:09.620794 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ad2af-0ebb-4fdb-9b7a-e76d3aca28a0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:09.624108 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 73/152] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:09 2022] GET /identity/v3/users/2482f101e58a43bca5e9411a6d355e61 => generated 247 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:09.629934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ad2af-0ebb-4fdb-9b7a-e76d3aca28a0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:09.700951 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c4883-fec2-4864-8548-fe64b16fcdfc None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:09.778526 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3915f3-3122-48fe-b463-6611704e0c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:09.779522 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3915f3-3122-48fe-b463-6611704e0c80 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:09.779907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3915f3-3122-48fe-b463-6611704e0c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:09.780287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3915f3-3122-48fe-b463-6611704e0c80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:09.782379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3915f3-3122-48fe-b463-6611704e0c80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:09.783935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3915f3-3122-48fe-b463-6611704e0c80 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:09.786677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:09.794095 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 80/153] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:09.803139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3915f3-3122-48fe-b463-6611704e0c80 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:09.820090 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:09.838643 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ad2af-0ebb-4fdb-9b7a-e76d3aca28a0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:09.918669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaab04-1b9e-461f-b0d1-7c2fdab1fed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:09.919529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaab04-1b9e-461f-b0d1-7c2fdab1fed6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:09.919915 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaab04-1b9e-461f-b0d1-7c2fdab1fed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:09.920296 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaab04-1b9e-461f-b0d1-7c2fdab1fed6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:09.979483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3915f3-3122-48fe-b463-6611704e0c80 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:10.019787 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b4e3b-9f4e-4839-b453-f5bae38a3ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:10.020465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b4e3b-9f4e-4839-b453-f5bae38a3ab2 None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:10.020749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b4e3b-9f4e-4839-b453-f5bae38a3ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:10.021029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b4e3b-9f4e-4839-b453-f5bae38a3ab2 None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:10.021751 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b4e3b-9f4e-4839-b453-f5bae38a3ab2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:10.022039 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaab04-1b9e-461f-b0d1-7c2fdab1fed6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:10.023220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b4e3b-9f4e-4839-b453-f5bae38a3ab2 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:10.025398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaab04-1b9e-461f-b0d1-7c2fdab1fed6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:10.059826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 81/154] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 12:01:09 2022] POST /identity/v3/users => generated 283 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:01:10.062879 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329d26c-9fa1-4a7b-8541-fe166cc1d2de None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:10.063550 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329d26c-9fa1-4a7b-8541-fe166cc1d2de None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:10.064388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329d26c-9fa1-4a7b-8541-fe166cc1d2de None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:10.066450 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 82/155] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:10.069232 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc357fd2-7e21-4949-b932-4149e18690e9 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:10.069882 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc357fd2-7e21-4949-b932-4149e18690e9 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:10.075520 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc357fd2-7e21-4949-b932-4149e18690e9 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:10.077271 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 83/156] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:10.084125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba70a38-3ba2-4500-9f2c-f06c65d5ad0d None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:10.084714 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba70a38-3ba2-4500-9f2c-f06c65d5ad0d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:10.085126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba70a38-3ba2-4500-9f2c-f06c65d5ad0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:10.120686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-cba70a38-3ba2-4500-9f2c-f06c65d5ad0d None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:10.122184 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-cba70a38-3ba2-4500-9f2c-f06c65d5ad0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:10.154399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:10.193356 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 74/157] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:10.197059 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2710e0-d23a-4d17-af73-06e21c4da5bb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:10.197662 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2710e0-d23a-4d17-af73-06e21c4da5bb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:10.198408 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2710e0-d23a-4d17-af73-06e21c4da5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:10.222865 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:10.224765 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-eb2710e0-d23a-4d17-af73-06e21c4da5bb None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:10.226330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-eb2710e0-d23a-4d17-af73-06e21c4da5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:10.240996 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 84/158] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:10.241664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba70a38-3ba2-4500-9f2c-f06c65d5ad0d None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:10.312863 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 75/159] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:10.314676 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc107df-a9ca-4693-a696-b7d162ade02a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:10.314676 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc107df-a9ca-4693-a696-b7d162ade02a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:10.314882 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc107df-a9ca-4693-a696-b7d162ade02a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:10.316142 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 76/160] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:10.316685 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc107df-a9ca-4693-a696-b7d162ade02a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:10.357986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba70a38-3ba2-4500-9f2c-f06c65d5ad0d None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:10.402860 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e5768-330d-493e-80ba-72f66eef7d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:10.403753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e5768-330d-493e-80ba-72f66eef7d64 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:10.404034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e5768-330d-493e-80ba-72f66eef7d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:10.404592 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e5768-330d-493e-80ba-72f66eef7d64 None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:10.405976 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e5768-330d-493e-80ba-72f66eef7d64 None admin] RBAC: Authorizing `identity:get_project(project_id=ace9baa6f68746d49a7c11b95f550e58)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:10.408286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e5768-330d-493e-80ba-72f66eef7d64 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:10.410077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 85/161] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:10 2022] GET /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:10.411266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd9135-1ae2-482a-b064-2b1e887b2691 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:10.411549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd9135-1ae2-482a-b064-2b1e887b2691 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:10.411828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd9135-1ae2-482a-b064-2b1e887b2691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:10.434276 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-4bbd9135-1ae2-482a-b064-2b1e887b2691 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:10.435527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-4bbd9135-1ae2-482a-b064-2b1e887b2691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:10.441779 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc107df-a9ca-4693-a696-b7d162ade02a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:10.452840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:10.486749 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5999b-eb37-450d-914d-12e7a2c6fc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:10.487555 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5999b-eb37-450d-914d-12e7a2c6fc4f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:10.487836 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5999b-eb37-450d-914d-12e7a2c6fc4f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:10.488111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5999b-eb37-450d-914d-12e7a2c6fc4f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:10.503113 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5999b-eb37-450d-914d-12e7a2c6fc4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:10.513039 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:10.513648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b1c5999b-eb37-450d-914d-12e7a2c6fc4f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:01:10.513648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:10.513648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:10.513648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:10.513648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:10.513648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:10.513648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:10.513648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:10.513648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:10.513648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:10.513648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:10.513648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:10.513648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:10.513648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:10.513648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:10.513648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:10.514692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:10.514692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:10.514692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:10.514692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:10.514692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:10.514692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:10.514692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:10.514692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:10.514692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:10.514692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:10.514692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:10.514692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:10.514692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:10.514692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:10.514692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:10.514692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:10.515427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:10.515427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:10.515427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:10.515427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:10.515427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:10.515427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:10.515427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:10.515427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:10.515427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:10.515427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:10.515427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:01:10.515427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:10.521086 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 77/162] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:10.522446 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5999b-eb37-450d-914d-12e7a2c6fc4f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:10.532733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 86/163] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:10.533722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd9135-1ae2-482a-b064-2b1e887b2691 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:10.643058 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5999b-eb37-450d-914d-12e7a2c6fc4f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:10.687249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd9135-1ae2-482a-b064-2b1e887b2691 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:10.687791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbe047-1496-440a-8343-67d0b15a1e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:10.688613 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbe047-1496-440a-8343-67d0b15a1e04 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:10.688894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbe047-1496-440a-8343-67d0b15a1e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:10.689167 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbe047-1496-440a-8343-67d0b15a1e04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:10.700358 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbe047-1496-440a-8343-67d0b15a1e04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:10.709510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5ecbe047-1496-440a-8343-67d0b15a1e04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:10.709510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:10.709510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:10.709510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:10.709510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:10.709510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:10.709510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:10.709510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:10.709510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:10.709510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:10.709510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:10.709510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:10.709510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:10.709510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:10.709510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:10.709510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:10.711664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:10.711664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:10.711664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:10.711664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:10.711664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:10.711664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:10.711664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:10.711664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:10.711664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:10.711664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:10.711664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:10.711664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:10.711664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:10.711664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:10.711664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:10.711664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:10.713470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:10.713470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:10.713470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:10.713470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:10.713470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:10.713470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:10.713470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:10.713470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:10.713470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:10.713470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:10.713470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:10.713470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:10.713470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 78/164] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:10.713470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbe047-1496-440a-8343-67d0b15a1e04 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:10.724750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9077e6-2692-4901-89ba-6947db89db4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:10.725419 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9077e6-2692-4901-89ba-6947db89db4c None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:10.725703 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9077e6-2692-4901-89ba-6947db89db4c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:10.725978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9077e6-2692-4901-89ba-6947db89db4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:10.726858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9077e6-2692-4901-89ba-6947db89db4c None admin] RBAC: Adding query filter params (role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.project.id=ace9baa6f68746d49a7c11b95f550e58, user.id=2482f101e58a43bca5e9411a6d355e61) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:10.727171 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9077e6-2692-4901-89ba-6947db89db4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:10.728803 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9077e6-2692-4901-89ba-6947db89db4c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:10.736365 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 87/165] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:10 2022] GET /identity/v3/role_assignments?user.id=2482f101e58a43bca5e9411a6d355e61&scope.project.id=ace9baa6f68746d49a7c11b95f550e58&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:10.737198 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9077e6-2692-4901-89ba-6947db89db4c None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:10.753218 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:10.804267 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:10.854351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9077e6-2692-4901-89ba-6947db89db4c None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:10.892203 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbe047-1496-440a-8343-67d0b15a1e04 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:10.895738 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea623eb-0e9a-4bae-9b4f-0c4d48faa30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:10.896503 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea623eb-0e9a-4bae-9b4f-0c4d48faa30a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:10.896784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea623eb-0e9a-4bae-9b4f-0c4d48faa30a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:10.897059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea623eb-0e9a-4bae-9b4f-0c4d48faa30a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:10.917546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea623eb-0e9a-4bae-9b4f-0c4d48faa30a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:10.925913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-fea623eb-0e9a-4bae-9b4f-0c4d48faa30a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:10.925913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:10.925913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:10.925913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:10.925913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:10.925913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:10.925913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:10.925913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:10.925913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:10.925913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:10.925913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:10.925913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:10.925913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:10.925913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:10.925913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:10.925913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:10.926876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:10.926876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:10.926876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:10.926876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:10.926876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:10.926876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:10.926876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:10.926876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:10.926876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:10.926876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:10.926876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:10.926876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:10.926876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:10.926876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:10.926876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:10.926876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:10.927615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:10.927615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:10.927615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:10.927615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:10.927615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:10.927615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:10.927615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:10.927615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:10.927615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:10.927615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:10.927615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:10.927615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:10.928196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 88/166] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:01:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:10.929125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea623eb-0e9a-4bae-9b4f-0c4d48faa30a None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:10.965916 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3a4d6-de45-422e-8d46-47c556488cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:10.966620 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3a4d6-de45-422e-8d46-47c556488cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:10.966904 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3a4d6-de45-422e-8d46-47c556488cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:10.967180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3a4d6-de45-422e-8d46-47c556488cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:10.967937 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3a4d6-de45-422e-8d46-47c556488cb1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:10.968245 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3a4d6-de45-422e-8d46-47c556488cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:10.969657 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3a4d6-de45-422e-8d46-47c556488cb1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:10.992165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 79/167] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:10.992846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3a4d6-de45-422e-8d46-47c556488cb1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:11.129269 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea623eb-0e9a-4bae-9b4f-0c4d48faa30a None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:11.150098 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:11.164018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:11.176000 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba68aad-5a70-4b99-bfbb-11fce211eae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:11.176676 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba68aad-5a70-4b99-bfbb-11fce211eae1 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:11.176961 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba68aad-5a70-4b99-bfbb-11fce211eae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:11.177237 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba68aad-5a70-4b99-bfbb-11fce211eae1 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:11.178028 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba68aad-5a70-4b99-bfbb-11fce211eae1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:11.178328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba68aad-5a70-4b99-bfbb-11fce211eae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:11.179727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba68aad-5a70-4b99-bfbb-11fce211eae1 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:11.191862 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3a4d6-de45-422e-8d46-47c556488cb1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:11.197377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 89/168] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:11.198257 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba68aad-5a70-4b99-bfbb-11fce211eae1 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:11.247562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8a921-f2ec-41be-ac62-74feb9d0e7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:11.248385 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8a921-f2ec-41be-ac62-74feb9d0e7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:11.248673 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8a921-f2ec-41be-ac62-74feb9d0e7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:11.248950 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8a921-f2ec-41be-ac62-74feb9d0e7b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:11.249702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8a921-f2ec-41be-ac62-74feb9d0e7b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:11.250025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8a921-f2ec-41be-ac62-74feb9d0e7b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:11.253238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8a921-f2ec-41be-ac62-74feb9d0e7b9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:11.262866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 80/169] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:01:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:11.263946 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8a921-f2ec-41be-ac62-74feb9d0e7b9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:11.400581 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8a921-f2ec-41be-ac62-74feb9d0e7b9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:11.441018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0c24f-95de-4cb1-9fb0-7d174a433379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:11.441018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0c24f-95de-4cb1-9fb0-7d174a433379 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:11.441018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0c24f-95de-4cb1-9fb0-7d174a433379 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:11.441018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0c24f-95de-4cb1-9fb0-7d174a433379 None admin] PATH_INFO: `/v3/users/b4f363b5e16e42eea33d3a46852cf542` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:11.444394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0c24f-95de-4cb1-9fb0-7d174a433379 None admin] RBAC: Authorizing `identity:get_user(user_id=b4f363b5e16e42eea33d3a46852cf542)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:11.446123 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0c24f-95de-4cb1-9fb0-7d174a433379 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:11.447852 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 81/170] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:11 2022] GET /identity/v3/users/b4f363b5e16e42eea33d3a46852cf542 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:11.448784 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0c24f-95de-4cb1-9fb0-7d174a433379 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:11.460844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba68aad-5a70-4b99-bfbb-11fce211eae1 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:11.482370 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:11.527520 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984c5c5-d96e-46e0-b984-40a6ac059bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:11.528417 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984c5c5-d96e-46e0-b984-40a6ac059bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:11.528702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984c5c5-d96e-46e0-b984-40a6ac059bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:11.528981 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984c5c5-d96e-46e0-b984-40a6ac059bf5 None admin] PATH_INFO: `/v3/users/a556370c96284547a0c2f4711c3b428d` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:11.530912 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984c5c5-d96e-46e0-b984-40a6ac059bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=a556370c96284547a0c2f4711c3b428d)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:11.532389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984c5c5-d96e-46e0-b984-40a6ac059bf5 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:11.536126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 90/171] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:11 2022] GET /identity/v3/users/a556370c96284547a0c2f4711c3b428d => generated 289 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:11.536964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984c5c5-d96e-46e0-b984-40a6ac059bf5 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:11.627172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:11.629980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0c24f-95de-4cb1-9fb0-7d174a433379 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:11.691379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f6a43-817f-4dbd-9d5f-7f437ceff65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:11.692226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f6a43-817f-4dbd-9d5f-7f437ceff65e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:11.692515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f6a43-817f-4dbd-9d5f-7f437ceff65e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:11.692791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f6a43-817f-4dbd-9d5f-7f437ceff65e None admin] PATH_INFO: `/v3/users/b4f363b5e16e42eea33d3a46852cf542` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:11.694699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f6a43-817f-4dbd-9d5f-7f437ceff65e None admin] RBAC: Authorizing `identity:get_user(user_id=b4f363b5e16e42eea33d3a46852cf542)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:11.696157 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f6a43-817f-4dbd-9d5f-7f437ceff65e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:11.699036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 82/172] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:11 2022] GET /identity/v3/users/b4f363b5e16e42eea33d3a46852cf542 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:11.699630 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f6a43-817f-4dbd-9d5f-7f437ceff65e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:11.726246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984c5c5-d96e-46e0-b984-40a6ac059bf5 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:11.788551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0e5fc-8d44-46b8-8de7-69bbe99114c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:11.789826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0e5fc-8d44-46b8-8de7-69bbe99114c1 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:11.790867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0e5fc-8d44-46b8-8de7-69bbe99114c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:11.791674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0e5fc-8d44-46b8-8de7-69bbe99114c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:11.846384 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:11.874455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f6a43-817f-4dbd-9d5f-7f437ceff65e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:11.889254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0e5fc-8d44-46b8-8de7-69bbe99114c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:11.890776 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0e5fc-8d44-46b8-8de7-69bbe99114c1 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:11.941562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ff99d-2f6d-4c1d-ba59-43caf5aa6429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:11.942392 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ff99d-2f6d-4c1d-ba59-43caf5aa6429 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:11.942672 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ff99d-2f6d-4c1d-ba59-43caf5aa6429 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:11.943085 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ff99d-2f6d-4c1d-ba59-43caf5aa6429 None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:11.945946 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ff99d-2f6d-4c1d-ba59-43caf5aa6429 None admin] RBAC: Authorizing `identity:get_project(project_id=ace9baa6f68746d49a7c11b95f550e58)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:11.948003 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ff99d-2f6d-4c1d-ba59-43caf5aa6429 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:11.949868 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 83/173] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:11 2022] GET /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:11.950502 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ff99d-2f6d-4c1d-ba59-43caf5aa6429 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:11.957513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:12.056816 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 91/174] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:12.057487 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0e5fc-8d44-46b8-8de7-69bbe99114c1 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:12.138542 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ff99d-2f6d-4c1d-ba59-43caf5aa6429 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:12.178120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf18899-90ae-4924-8881-49e39dc05d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:12.179146 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf18899-90ae-4924-8881-49e39dc05d40 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:12.179641 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf18899-90ae-4924-8881-49e39dc05d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:12.180124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf18899-90ae-4924-8881-49e39dc05d40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:12.205905 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:12.249903 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0e5fc-8d44-46b8-8de7-69bbe99114c1 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:12.251888 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf18899-90ae-4924-8881-49e39dc05d40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:12.253553 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf18899-90ae-4924-8881-49e39dc05d40 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:12.313797 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67ded4-0fbb-45dc-b129-47720dd8258b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:12.314822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67ded4-0fbb-45dc-b129-47720dd8258b None admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:12.315110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67ded4-0fbb-45dc-b129-47720dd8258b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:12.315389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67ded4-0fbb-45dc-b129-47720dd8258b None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58/users/a556370c96284547a0c2f4711c3b428d/roles/89c1404610d74d74bdd3ea913c3de5ba` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:12.320722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67ded4-0fbb-45dc-b129-47720dd8258b None admin] RBAC: Authorizing `identity:create_grant(project_id=ace9baa6f68746d49a7c11b95f550e58, user_id=a556370c96284547a0c2f4711c3b428d, role_id=89c1404610d74d74bdd3ea913c3de5ba)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:12.322853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67ded4-0fbb-45dc-b129-47720dd8258b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:12.347799 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 92/175] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:01:12 2022] PUT /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58/users/a556370c96284547a0c2f4711c3b428d/roles/89c1404610d74d74bdd3ea913c3de5ba => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:01:12.348783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67ded4-0fbb-45dc-b129-47720dd8258b None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:12.361219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 84/176] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:12.366441 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:12.367626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf18899-90ae-4924-8881-49e39dc05d40 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:12.447735 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:12.501689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf18899-90ae-4924-8881-49e39dc05d40 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:12.536553 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08872f9c-6943-4fad-88bc-2228822637b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:12.537763 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08872f9c-6943-4fad-88bc-2228822637b4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:12.538296 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08872f9c-6943-4fad-88bc-2228822637b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:12.538765 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08872f9c-6943-4fad-88bc-2228822637b4 None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:12.540162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08872f9c-6943-4fad-88bc-2228822637b4 None admin] RBAC: Authorizing `identity:get_project(project_id=ace9baa6f68746d49a7c11b95f550e58)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:12.542632 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08872f9c-6943-4fad-88bc-2228822637b4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:12.544854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 85/177] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:12 2022] GET /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:12.550932 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08872f9c-6943-4fad-88bc-2228822637b4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:12.582176 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67ded4-0fbb-45dc-b129-47720dd8258b None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:12.646735 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68dadf-1ecf-49e5-bc04-6caf35d9cd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:12.647691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68dadf-1ecf-49e5-bc04-6caf35d9cd80 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:12.647977 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68dadf-1ecf-49e5-bc04-6caf35d9cd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:12.648299 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68dadf-1ecf-49e5-bc04-6caf35d9cd80 None admin] PATH_INFO: `/v3/projects/3d635b2ea7e04bb9918b295d4bb24798` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:12.652486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68dadf-1ecf-49e5-bc04-6caf35d9cd80 None admin] RBAC: Authorizing `identity:get_project(project_id=3d635b2ea7e04bb9918b295d4bb24798)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:12.654129 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68dadf-1ecf-49e5-bc04-6caf35d9cd80 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:12.656061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 93/178] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:12 2022] GET /identity/v3/projects/3d635b2ea7e04bb9918b295d4bb24798 => generated 312 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:12.659754 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08872f9c-6943-4fad-88bc-2228822637b4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:12.662183 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68dadf-1ecf-49e5-bc04-6caf35d9cd80 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:12.686592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:12.699211 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6cf3f-9885-4758-86ba-7078e3fe52ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:12.700824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6cf3f-9885-4758-86ba-7078e3fe52ec None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:12.701660 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6cf3f-9885-4758-86ba-7078e3fe52ec None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:12.702182 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6cf3f-9885-4758-86ba-7078e3fe52ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:12.703229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6cf3f-9885-4758-86ba-7078e3fe52ec None admin] RBAC: Adding query filter params (role.id=639e5e5307f34a64a854cfb59086518e, scope.project.id=ace9baa6f68746d49a7c11b95f550e58, user.id=b4f363b5e16e42eea33d3a46852cf542) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:12.703768 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6cf3f-9885-4758-86ba-7078e3fe52ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:12.705923 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6cf3f-9885-4758-86ba-7078e3fe52ec None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:12.714076 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 86/179] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:12 2022] GET /identity/v3/role_assignments?user.id=b4f363b5e16e42eea33d3a46852cf542&scope.project.id=ace9baa6f68746d49a7c11b95f550e58&role.id=639e5e5307f34a64a854cfb59086518e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:12.790945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:12.793527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579afe5-8f19-4d87-9d45-14f272a9437b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:12.794078 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579afe5-8f19-4d87-9d45-14f272a9437b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:12.794553 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579afe5-8f19-4d87-9d45-14f272a9437b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:12.796772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 87/180] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:01:12.804236 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd4aa3-e7a9-4df2-86ff-b8cf227b5b5b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:12.804891 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd4aa3-e7a9-4df2-86ff-b8cf227b5b5b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:12.805339 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd4aa3-e7a9-4df2-86ff-b8cf227b5b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:12.825911 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68dadf-1ecf-49e5-bc04-6caf35d9cd80 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:12.826964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-74cd4aa3-e7a9-4df2-86ff-b8cf227b5b5b None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:12.828458 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-74cd4aa3-e7a9-4df2-86ff-b8cf227b5b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:12.902463 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d07111-9e6c-480b-ac08-b503dc3ec635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:12.903351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d07111-9e6c-480b-ac08-b503dc3ec635 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:12.903704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d07111-9e6c-480b-ac08-b503dc3ec635 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:12.904047 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d07111-9e6c-480b-ac08-b503dc3ec635 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:12.905003 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d07111-9e6c-480b-ac08-b503dc3ec635 None admin] RBAC: Adding query filter params (role.id=ae11679806844c6f8d55ce5ccb32ee8b, scope.project.id=3d635b2ea7e04bb9918b295d4bb24798, user.id=b4f363b5e16e42eea33d3a46852cf542) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:12.905384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d07111-9e6c-480b-ac08-b503dc3ec635 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:12.909177 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d07111-9e6c-480b-ac08-b503dc3ec635 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:12.922467 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 94/181] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:12 2022] GET /identity/v3/role_assignments?user.id=b4f363b5e16e42eea33d3a46852cf542&scope.project.id=3d635b2ea7e04bb9918b295d4bb24798&role.id=ae11679806844c6f8d55ce5ccb32ee8b => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:12.924570 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94383752-429e-4fc5-8603-e13a4e1ae8ec None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:12.926698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 88/182] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:12.927300 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94383752-429e-4fc5-8603-e13a4e1ae8ec None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:12.927783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94383752-429e-4fc5-8603-e13a4e1ae8ec None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:12.929476 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 95/183] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:12.935496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6d4dc-868b-4c4c-8557-c1666ad2e0e0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:12.936164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6d4dc-868b-4c4c-8557-c1666ad2e0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:12.936635 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6d4dc-868b-4c4c-8557-c1666ad2e0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:12.959376 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0ec6d4dc-868b-4c4c-8557-c1666ad2e0e0 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:12.960973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0ec6d4dc-868b-4c4c-8557-c1666ad2e0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:12.984280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94383752-429e-4fc5-8603-e13a4e1ae8ec None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:13.050125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 89/184] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:13.069646 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6d4dc-868b-4c4c-8557-c1666ad2e0e0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:13.122798 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:13.184980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6d4dc-868b-4c4c-8557-c1666ad2e0e0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:13.225393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94383752-429e-4fc5-8603-e13a4e1ae8ec None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:13.240360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e2985-0338-4589-bf1c-5b067124992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:13.241242 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e2985-0338-4589-bf1c-5b067124992d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:13.241666 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e2985-0338-4589-bf1c-5b067124992d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:13.241946 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e2985-0338-4589-bf1c-5b067124992d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:13.257765 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e2985-0338-4589-bf1c-5b067124992d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:13.271047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-909e2985-0338-4589-bf1c-5b067124992d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:13.271047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:13.271047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:13.271047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:13.271047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:13.271047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:13.271047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:13.271047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:13.271047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:13.271047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:13.271047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:13.271047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:13.271047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:13.271047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:13.271047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:13.271047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:13.272120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:13.272120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:13.272120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:13.272120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:13.272120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:13.272120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:13.272120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:13.272120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:13.272120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:13.272120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:13.272120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:13.272120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:13.272120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:13.272120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:13.272120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:13.272120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:13.272929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:13.272929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:13.272929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:13.272929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:13.272929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:13.272929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:13.272929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:13.272929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:13.272929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:13.272929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:13.272929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:13.272929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:13.272929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 90/185] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:01:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:01:13.273548 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856f722-eba4-476b-872a-d09b22babb60 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:13.275740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856f722-eba4-476b-872a-d09b22babb60 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:13.275740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856f722-eba4-476b-872a-d09b22babb60 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:13.276007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 91/186] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:13.278429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82ac18-92f6-48e0-9ebe-30d66a7781f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:13.279571 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856f722-eba4-476b-872a-d09b22babb60 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:13.279903 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82ac18-92f6-48e0-9ebe-30d66a7781f4 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:13.280195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82ac18-92f6-48e0-9ebe-30d66a7781f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:13.280471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82ac18-92f6-48e0-9ebe-30d66a7781f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:13.292553 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:13.298376 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82ac18-92f6-48e0-9ebe-30d66a7781f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:13.306249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-be82ac18-92f6-48e0-9ebe-30d66a7781f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:01:13.306249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:13.306249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:13.306249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:13.306249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:13.306249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:13.306249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:13.306249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:13.306249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:13.306249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:13.306249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:13.306249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:13.306249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:13.306249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:13.306249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:13.306249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:13.307197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:13.307197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:13.307197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:13.307197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:13.307197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:13.307197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:13.307197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:13.307197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:13.307197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:13.307197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:13.307197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:13.307197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:13.307197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:13.307197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:13.307197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:13.307197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:13.307967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:13.307967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:13.307967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:13.307967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:13.307967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:13.307967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:13.307967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:13.307967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:13.307967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:13.307967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:13.307967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:01:13.307967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:13.307967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 96/187] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:01:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:01:13.308601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6987ad4-8e78-4876-8aee-f7f2a6366fb4 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:13.308997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6987ad4-8e78-4876-8aee-f7f2a6366fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:13.309151 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6987ad4-8e78-4876-8aee-f7f2a6366fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:13.337893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-c6987ad4-8e78-4876-8aee-f7f2a6366fb4 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:13.337893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c6987ad4-8e78-4876-8aee-f7f2a6366fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:13.405855 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 97/188] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:13.406730 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6987ad4-8e78-4876-8aee-f7f2a6366fb4 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:13.424386 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856f722-eba4-476b-872a-d09b22babb60 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:13.435820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:13.470256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bcf9b-0cc4-40dc-9288-1b20f91fe862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:13.471199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bcf9b-0cc4-40dc-9288-1b20f91fe862 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:13.471725 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bcf9b-0cc4-40dc-9288-1b20f91fe862 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:13.472186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bcf9b-0cc4-40dc-9288-1b20f91fe862 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:13.473211 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bcf9b-0cc4-40dc-9288-1b20f91fe862 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:13.473722 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bcf9b-0cc4-40dc-9288-1b20f91fe862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:13.475280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bcf9b-0cc4-40dc-9288-1b20f91fe862 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:13.484527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 92/189] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:01:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:13.489756 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bcf9b-0cc4-40dc-9288-1b20f91fe862 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:13.526817 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6987ad4-8e78-4876-8aee-f7f2a6366fb4 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:13.555276 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:13.564461 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5463b3-e018-4b8b-af91-7e8e5884c58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:13.565066 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5463b3-e018-4b8b-af91-7e8e5884c58b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:13.565343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5463b3-e018-4b8b-af91-7e8e5884c58b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:13.565614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5463b3-e018-4b8b-af91-7e8e5884c58b None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:13.566395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5463b3-e018-4b8b-af91-7e8e5884c58b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:13.566701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5463b3-e018-4b8b-af91-7e8e5884c58b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:13.568080 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5463b3-e018-4b8b-af91-7e8e5884c58b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:13.577355 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 98/190] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:13.578070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5463b3-e018-4b8b-af91-7e8e5884c58b None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:13.595598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bcf9b-0cc4-40dc-9288-1b20f91fe862 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:13.629652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb1afa-939f-46c6-9b14-da3b1e5aaa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:13.630466 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb1afa-939f-46c6-9b14-da3b1e5aaa69 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:13.630745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb1afa-939f-46c6-9b14-da3b1e5aaa69 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:13.631014 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb1afa-939f-46c6-9b14-da3b1e5aaa69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:13.632178 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb1afa-939f-46c6-9b14-da3b1e5aaa69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:13.633639 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb1afa-939f-46c6-9b14-da3b1e5aaa69 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:13.635812 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 93/191] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:13.639207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb1afa-939f-46c6-9b14-da3b1e5aaa69 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:13.677798 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:13.682207 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5463b3-e018-4b8b-af91-7e8e5884c58b None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:13.715929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f07216-5ad9-4e2e-ad4f-5c62529aa080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:13.716800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f07216-5ad9-4e2e-ad4f-5c62529aa080 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:13.717082 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f07216-5ad9-4e2e-ad4f-5c62529aa080 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:13.717353 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f07216-5ad9-4e2e-ad4f-5c62529aa080 None admin] PATH_INFO: `/v3/users/a0577fd4872e4d6f8969ba9007a91542` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:13.730864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f07216-5ad9-4e2e-ad4f-5c62529aa080 None admin] RBAC: Authorizing `identity:get_user(user_id=a0577fd4872e4d6f8969ba9007a91542)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:13.732308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f07216-5ad9-4e2e-ad4f-5c62529aa080 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:13.734149 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 99/192] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:13 2022] GET /identity/v3/users/a0577fd4872e4d6f8969ba9007a91542 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:13.734803 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f07216-5ad9-4e2e-ad4f-5c62529aa080 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:13.753907 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb1afa-939f-46c6-9b14-da3b1e5aaa69 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:13.789564 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ea80d-9230-4be7-8075-de07cbc9c82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:13.791065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ea80d-9230-4be7-8075-de07cbc9c82f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:13.791485 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ea80d-9230-4be7-8075-de07cbc9c82f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:13.791919 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ea80d-9230-4be7-8075-de07cbc9c82f None admin] PATH_INFO: `/v3/users/a0577fd4872e4d6f8969ba9007a91542` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:13.793070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:13.794071 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ea80d-9230-4be7-8075-de07cbc9c82f None admin] RBAC: Authorizing `identity:get_user(user_id=a0577fd4872e4d6f8969ba9007a91542)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:13.795868 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ea80d-9230-4be7-8075-de07cbc9c82f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:13.802364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 94/193] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:13 2022] GET /identity/v3/users/a0577fd4872e4d6f8969ba9007a91542 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:13.803343 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ea80d-9230-4be7-8075-de07cbc9c82f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:13.846673 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f07216-5ad9-4e2e-ad4f-5c62529aa080 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:13.884337 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaeae64-e272-419c-a0b8-170905bd019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:13.885013 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaeae64-e272-419c-a0b8-170905bd019e None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:13.885293 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaeae64-e272-419c-a0b8-170905bd019e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:13.885564 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaeae64-e272-419c-a0b8-170905bd019e None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:13.886654 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaeae64-e272-419c-a0b8-170905bd019e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:13.887961 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaeae64-e272-419c-a0b8-170905bd019e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:13.909776 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 100/194] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 12:01:13 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:01:13.911004 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ea80d-9230-4be7-8075-de07cbc9c82f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:13.914434 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:13.923129 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaeae64-e272-419c-a0b8-170905bd019e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:13.967238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb6be5-8e32-4c07-ae1f-01c8a9eb2032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:13.969296 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb6be5-8e32-4c07-ae1f-01c8a9eb2032 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:13.969759 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb6be5-8e32-4c07-ae1f-01c8a9eb2032 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:13.970197 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb6be5-8e32-4c07-ae1f-01c8a9eb2032 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:14.052889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaeae64-e272-419c-a0b8-170905bd019e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:14.056943 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:14.061149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb6be5-8e32-4c07-ae1f-01c8a9eb2032 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:14.062827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb6be5-8e32-4c07-ae1f-01c8a9eb2032 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:14.107053 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedba237-f1e1-43c2-9443-4dbc635e7679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:14.107637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedba237-f1e1-43c2-9443-4dbc635e7679 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:14.107940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedba237-f1e1-43c2-9443-4dbc635e7679 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:14.108213 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedba237-f1e1-43c2-9443-4dbc635e7679 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:14.185583 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 95/195] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:14.191725 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb6be5-8e32-4c07-ae1f-01c8a9eb2032 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:14.194492 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:14.200949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedba237-f1e1-43c2-9443-4dbc635e7679 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:14.203035 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedba237-f1e1-43c2-9443-4dbc635e7679 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:14.311641 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb6be5-8e32-4c07-ae1f-01c8a9eb2032 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:14.339549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 101/196] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:14.345831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedba237-f1e1-43c2-9443-4dbc635e7679 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:14.349784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:14.352350 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719764e-535c-4167-8802-cf124ed93713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:14.353948 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719764e-535c-4167-8802-cf124ed93713 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:14.354324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719764e-535c-4167-8802-cf124ed93713 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:14.354662 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719764e-535c-4167-8802-cf124ed93713 None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:14.355968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719764e-535c-4167-8802-cf124ed93713 None admin] RBAC: Authorizing `identity:get_project(project_id=54b0a661962441ba8877bf383738e206)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:14.357545 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719764e-535c-4167-8802-cf124ed93713 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:14.359346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 96/197] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:14 2022] GET /identity/v3/projects/54b0a661962441ba8877bf383738e206 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:14.371004 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719764e-535c-4167-8802-cf124ed93713 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:14.463980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:14.475196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedba237-f1e1-43c2-9443-4dbc635e7679 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:14.511095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719764e-535c-4167-8802-cf124ed93713 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:14.519964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228343c-3b8f-412e-8364-65389cc35fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:14.521073 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228343c-3b8f-412e-8364-65389cc35fbe None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:14.521534 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228343c-3b8f-412e-8364-65389cc35fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:14.521982 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228343c-3b8f-412e-8364-65389cc35fbe None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:14.523420 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228343c-3b8f-412e-8364-65389cc35fbe None admin] RBAC: Authorizing `identity:get_project(project_id=54b0a661962441ba8877bf383738e206)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:14.525586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228343c-3b8f-412e-8364-65389cc35fbe None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:14.527803 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 102/198] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:14 2022] GET /identity/v3/projects/54b0a661962441ba8877bf383738e206 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:14.548622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228343c-3b8f-412e-8364-65389cc35fbe None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:14.562779 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79a503-6266-4733-a1f3-d96c79bf9685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:14.563453 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79a503-6266-4733-a1f3-d96c79bf9685 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:14.563735 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79a503-6266-4733-a1f3-d96c79bf9685 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:14.564010 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79a503-6266-4733-a1f3-d96c79bf9685 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:14.564867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79a503-6266-4733-a1f3-d96c79bf9685 None admin] RBAC: Adding query filter params (role.id=639e5e5307f34a64a854cfb59086518e, scope.project.id=54b0a661962441ba8877bf383738e206, user.id=a0577fd4872e4d6f8969ba9007a91542) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:14.565181 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79a503-6266-4733-a1f3-d96c79bf9685 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:14.568666 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79a503-6266-4733-a1f3-d96c79bf9685 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:14.581561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 97/199] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:14 2022] GET /identity/v3/role_assignments?user.id=a0577fd4872e4d6f8969ba9007a91542&scope.project.id=54b0a661962441ba8877bf383738e206&role.id=639e5e5307f34a64a854cfb59086518e => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:14.646287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:14.680570 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228343c-3b8f-412e-8364-65389cc35fbe None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:14.720194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bc42b-e7c4-46ba-8c91-189b2c0db998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:14.720927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bc42b-e7c4-46ba-8c91-189b2c0db998 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:14.721215 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bc42b-e7c4-46ba-8c91-189b2c0db998 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:14.721497 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bc42b-e7c4-46ba-8c91-189b2c0db998 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:14.722441 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bc42b-e7c4-46ba-8c91-189b2c0db998 None admin] RBAC: Adding query filter params (role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.project.id=54b0a661962441ba8877bf383738e206, user.id=a0577fd4872e4d6f8969ba9007a91542) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:14.722756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bc42b-e7c4-46ba-8c91-189b2c0db998 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:14.724224 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bc42b-e7c4-46ba-8c91-189b2c0db998 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:14.734254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 103/200] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:14 2022] GET /identity/v3/role_assignments?user.id=a0577fd4872e4d6f8969ba9007a91542&scope.project.id=54b0a661962441ba8877bf383738e206&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:14.907751 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9258-55f0-48f1-b084-376d6ed27385 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:14.908236 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9258-55f0-48f1-b084-376d6ed27385 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:14.908236 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9258-55f0-48f1-b084-376d6ed27385 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:14.909606 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 98/201] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:14.915036 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff8f9e-f1f0-4ab1-bb7e-25c269bf40b9 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:14.915607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff8f9e-f1f0-4ab1-bb7e-25c269bf40b9 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:14.916318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff8f9e-f1f0-4ab1-bb7e-25c269bf40b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:14.935206 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-5fff8f9e-f1f0-4ab1-bb7e-25c269bf40b9 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:14.936668 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5fff8f9e-f1f0-4ab1-bb7e-25c269bf40b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:15.004891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 104/202] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:15.028270 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9258-55f0-48f1-b084-376d6ed27385 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:15.153089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9258-55f0-48f1-b084-376d6ed27385 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:15.197838 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d1013-d495-4802-9f13-5c46ab476e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:15.199027 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d1013-d495-4802-9f13-5c46ab476e65 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:15.199517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d1013-d495-4802-9f13-5c46ab476e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:15.199964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d1013-d495-4802-9f13-5c46ab476e65 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:15.207143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:15.216749 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d1013-d495-4802-9f13-5c46ab476e65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:15.224720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ce9d1013-d495-4802-9f13-5c46ab476e65 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:01:15.224720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:15.224720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:15.224720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:15.224720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:15.224720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:15.224720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:15.224720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:15.224720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:15.224720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:15.224720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:15.224720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:15.224720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:15.224720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:15.224720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:15.224720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:15.225561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:15.225561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:15.225561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:15.225561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:15.225561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:15.225561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:15.225561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:15.225561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:15.225561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:15.225561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:15.225561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:15.225561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:15.225561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:15.225561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:15.225561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:15.225561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:15.226360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:15.226360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:15.226360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:15.226360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:15.226360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:15.226360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:15.226360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:15.226360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:15.226360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:15.226360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:15.226360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:01:15.226360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:15.226360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 99/203] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:15.232176 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff8f9e-f1f0-4ab1-bb7e-25c269bf40b9 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:15.326576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:15.373200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff8f9e-f1f0-4ab1-bb7e-25c269bf40b9 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:15.419319 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589e7ea-478c-4fdb-bd76-b38a495fdd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:15.419995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589e7ea-478c-4fdb-bd76-b38a495fdd13 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:15.420273 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589e7ea-478c-4fdb-bd76-b38a495fdd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:15.420542 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589e7ea-478c-4fdb-bd76-b38a495fdd13 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:15.421293 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589e7ea-478c-4fdb-bd76-b38a495fdd13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:15.421595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589e7ea-478c-4fdb-bd76-b38a495fdd13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:15.422978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589e7ea-478c-4fdb-bd76-b38a495fdd13 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:15.438372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 105/204] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:15.450552 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d1013-d495-4802-9f13-5c46ab476e65 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:15.589185 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d1013-d495-4802-9f13-5c46ab476e65 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:15.637468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07cc68-77ed-4861-9ae0-6bff7b1218ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:15.638774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07cc68-77ed-4861-9ae0-6bff7b1218ae None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:15.639265 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07cc68-77ed-4861-9ae0-6bff7b1218ae None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:15.639740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07cc68-77ed-4861-9ae0-6bff7b1218ae None admin] PATH_INFO: `/v3/users/a556370c96284547a0c2f4711c3b428d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:15.646738 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07cc68-77ed-4861-9ae0-6bff7b1218ae None admin] RBAC: Authorizing `identity:get_user(user_id=a556370c96284547a0c2f4711c3b428d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:15.648464 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07cc68-77ed-4861-9ae0-6bff7b1218ae None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:15.651322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 100/205] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:15 2022] GET /identity/v3/users/a556370c96284547a0c2f4711c3b428d => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:15.659091 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589e7ea-478c-4fdb-bd76-b38a495fdd13 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:15.811706 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589e7ea-478c-4fdb-bd76-b38a495fdd13 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:15.850345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:15.857531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64faef17-d8e7-4a9b-9ef7-4647ba312c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:15.858220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faef17-d8e7-4a9b-9ef7-4647ba312c7e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:15.858508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faef17-d8e7-4a9b-9ef7-4647ba312c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:15.858786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faef17-d8e7-4a9b-9ef7-4647ba312c7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:15.947174 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64faef17-d8e7-4a9b-9ef7-4647ba312c7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:15.948643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64faef17-d8e7-4a9b-9ef7-4647ba312c7e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:16.084725 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 106/206] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:16.090745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07cc68-77ed-4861-9ae0-6bff7b1218ae None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:16.177795 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:16.221919 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07cc68-77ed-4861-9ae0-6bff7b1218ae None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:16.262038 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde663e3-0bf1-43fe-9bcd-97267a2bf3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:16.262909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde663e3-0bf1-43fe-9bcd-97267a2bf3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:16.263195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde663e3-0bf1-43fe-9bcd-97267a2bf3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:16.263474 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde663e3-0bf1-43fe-9bcd-97267a2bf3c8 None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:16.264694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde663e3-0bf1-43fe-9bcd-97267a2bf3c8 None admin] RBAC: Authorizing `identity:get_project(project_id=ace9baa6f68746d49a7c11b95f550e58)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:16.266168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde663e3-0bf1-43fe-9bcd-97267a2bf3c8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:16.267873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 101/207] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:16 2022] GET /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:16.279116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64faef17-d8e7-4a9b-9ef7-4647ba312c7e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:16.316588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:16.418410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64faef17-d8e7-4a9b-9ef7-4647ba312c7e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:16.453789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87684c3e-0029-482e-931c-ebb1f88865d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:16.454483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87684c3e-0029-482e-931c-ebb1f88865d9 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:16.454811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87684c3e-0029-482e-931c-ebb1f88865d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:16.455090 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87684c3e-0029-482e-931c-ebb1f88865d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:16.455929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87684c3e-0029-482e-931c-ebb1f88865d9 None admin] RBAC: Adding query filter params (role.id=89c1404610d74d74bdd3ea913c3de5ba, scope.project.id=ace9baa6f68746d49a7c11b95f550e58, user.id=a556370c96284547a0c2f4711c3b428d) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:16.456238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87684c3e-0029-482e-931c-ebb1f88865d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:16.457677 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87684c3e-0029-482e-931c-ebb1f88865d9 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:16.463637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 107/208] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:16 2022] GET /identity/v3/role_assignments?user.id=a556370c96284547a0c2f4711c3b428d&scope.project.id=ace9baa6f68746d49a7c11b95f550e58&role.id=89c1404610d74d74bdd3ea913c3de5ba => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:16.469573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f01469-8bb6-49c1-917e-84d2f1d44592 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:16.469872 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f01469-8bb6-49c1-917e-84d2f1d44592 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:16.470185 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f01469-8bb6-49c1-917e-84d2f1d44592 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:16.471633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 102/209] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:16.487763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b26f84-0f7a-4341-b83b-12536c1e4133 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:16.488069 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b26f84-0f7a-4341-b83b-12536c1e4133 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:16.488317 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b26f84-0f7a-4341-b83b-12536c1e4133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:16.512077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-42b26f84-0f7a-4341-b83b-12536c1e4133 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:16.513284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-42b26f84-0f7a-4341-b83b-12536c1e4133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:16.592471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 108/210] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:16.639753 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f01469-8bb6-49c1-917e-84d2f1d44592 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:16.772130 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f01469-8bb6-49c1-917e-84d2f1d44592 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:16.807049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdae4f-1ed5-4a2d-9c40-b595ed3e6ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:16.807863 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdae4f-1ed5-4a2d-9c40-b595ed3e6ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:16.808148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdae4f-1ed5-4a2d-9c40-b595ed3e6ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:16.808422 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdae4f-1ed5-4a2d-9c40-b595ed3e6ae5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:16.814386 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:16.819471 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdae4f-1ed5-4a2d-9c40-b595ed3e6ae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:16.827970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-47cdae4f-1ed5-4a2d-9c40-b595ed3e6ae5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:16.827970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:16.827970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:16.827970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:16.827970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:16.827970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:16.827970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:16.827970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:16.827970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:16.827970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:16.827970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:16.827970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:16.827970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:16.827970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:16.827970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:16.827970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:16.828857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:16.828857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:16.828857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:16.828857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:16.828857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:16.828857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:16.828857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:16.828857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:16.828857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:16.828857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:16.828857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:16.828857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:16.828857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:16.828857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:16.828857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:16.828857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:16.829649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:16.829649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:16.829649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:16.829649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:16.829649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:16.829649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:16.829649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:16.829649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:16.829649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:16.829649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:16.829649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:16.829649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:16.833174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 103/211] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:16.838802 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b26f84-0f7a-4341-b83b-12536c1e4133 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:16.865483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:16.868341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ad8df-23aa-4bad-8a6d-2fc571162f88 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:16.869306 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ad8df-23aa-4bad-8a6d-2fc571162f88 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:16.869642 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ad8df-23aa-4bad-8a6d-2fc571162f88 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:16.871248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 104/212] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:16.876846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf19e9-9e66-478e-8700-ccde39d29ca0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:16.877434 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf19e9-9e66-478e-8700-ccde39d29ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:16.877910 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf19e9-9e66-478e-8700-ccde39d29ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:16.899884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f2bf19e9-9e66-478e-8700-ccde39d29ca0 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:16.901646 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f2bf19e9-9e66-478e-8700-ccde39d29ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:16.970544 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b26f84-0f7a-4341-b83b-12536c1e4133 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:16.988359 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 105/213] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:01:17.013909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf19e9-9e66-478e-8700-ccde39d29ca0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:17.025557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edd94d-faea-425c-bb3a-1d84e1badcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:17.026996 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edd94d-faea-425c-bb3a-1d84e1badcd8 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:17.027509 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edd94d-faea-425c-bb3a-1d84e1badcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:17.028005 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edd94d-faea-425c-bb3a-1d84e1badcd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:17.028967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edd94d-faea-425c-bb3a-1d84e1badcd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:17.029473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edd94d-faea-425c-bb3a-1d84e1badcd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:17.031272 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edd94d-faea-425c-bb3a-1d84e1badcd8 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:17.042993 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 109/214] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:17.048311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edd94d-faea-425c-bb3a-1d84e1badcd8 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:17.135895 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf19e9-9e66-478e-8700-ccde39d29ca0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:17.148572 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:17.162438 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:17.171749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edd94d-faea-425c-bb3a-1d84e1badcd8 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:17.182492 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53656384-b39b-427d-8ec9-d7ab1e40bd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:17.184069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53656384-b39b-427d-8ec9-d7ab1e40bd65 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:17.184561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53656384-b39b-427d-8ec9-d7ab1e40bd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:17.185490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53656384-b39b-427d-8ec9-d7ab1e40bd65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:17.187202 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53656384-b39b-427d-8ec9-d7ab1e40bd65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:17.189902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53656384-b39b-427d-8ec9-d7ab1e40bd65 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:17.194143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 106/215] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:17.199555 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53656384-b39b-427d-8ec9-d7ab1e40bd65 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:17.211057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3580e9a-8d9f-4012-909f-ac7cd5e76420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:17.211936 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3580e9a-8d9f-4012-909f-ac7cd5e76420 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:17.212217 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3580e9a-8d9f-4012-909f-ac7cd5e76420 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:17.213024 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3580e9a-8d9f-4012-909f-ac7cd5e76420 None admin] PATH_INFO: `/v3/users/95be81eab03b4ae8bc7cc292f3611b12` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:17.227795 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3580e9a-8d9f-4012-909f-ac7cd5e76420 None admin] RBAC: Authorizing `identity:get_user(user_id=95be81eab03b4ae8bc7cc292f3611b12)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:17.229877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3580e9a-8d9f-4012-909f-ac7cd5e76420 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:17.231786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 110/216] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:17 2022] GET /identity/v3/users/95be81eab03b4ae8bc7cc292f3611b12 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:17.233083 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db00aac-f78f-477a-b384-36d99363367a None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:17.233363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db00aac-f78f-477a-b384-36d99363367a None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:17.233648 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db00aac-f78f-477a-b384-36d99363367a None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:17.235039 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 111/217] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:17.239526 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db00aac-f78f-477a-b384-36d99363367a None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:17.316290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53656384-b39b-427d-8ec9-d7ab1e40bd65 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:17.347451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db00aac-f78f-477a-b384-36d99363367a None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:17.352221 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e6b18-c19b-4460-a617-8a0a76d9601c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:17.353048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e6b18-c19b-4460-a617-8a0a76d9601c None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:17.354139 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e6b18-c19b-4460-a617-8a0a76d9601c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:17.354414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e6b18-c19b-4460-a617-8a0a76d9601c None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:17.355123 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e6b18-c19b-4460-a617-8a0a76d9601c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:17.356580 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e6b18-c19b-4460-a617-8a0a76d9601c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:17.377474 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 107/218] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 12:01:17 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:01:17.378750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace6d2e-f3dc-448e-9e23-2c09033ac688 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:17.379055 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace6d2e-f3dc-448e-9e23-2c09033ac688 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:17.379310 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace6d2e-f3dc-448e-9e23-2c09033ac688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:17.396677 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439c536-68cc-4794-b0fa-3a28dfa6f862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:17.397671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439c536-68cc-4794-b0fa-3a28dfa6f862 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:17.398133 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9ace6d2e-f3dc-448e-9e23-2c09033ac688 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:17.398376 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439c536-68cc-4794-b0fa-3a28dfa6f862 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:17.398844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439c536-68cc-4794-b0fa-3a28dfa6f862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:17.399391 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9ace6d2e-f3dc-448e-9e23-2c09033ac688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:17.413371 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:17.451194 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:17.484310 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 108/219] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:17.485019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439c536-68cc-4794-b0fa-3a28dfa6f862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:17.486042 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859a0e4-3bcd-487b-886e-450339afe713 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:17.486339 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859a0e4-3bcd-487b-886e-450339afe713 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:17.486553 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439c536-68cc-4794-b0fa-3a28dfa6f862 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:17.486649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859a0e4-3bcd-487b-886e-450339afe713 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:17.488084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 109/220] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:17.493182 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b7775-72e8-4202-9766-3f277bddad6e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:17.493471 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b7775-72e8-4202-9766-3f277bddad6e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:17.493792 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b7775-72e8-4202-9766-3f277bddad6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:17.517811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-990b7775-72e8-4202-9766-3f277bddad6e None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:17.519324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-990b7775-72e8-4202-9766-3f277bddad6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:17.599347 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 110/221] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:01:17.600130 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b7775-72e8-4202-9766-3f277bddad6e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:17.620062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 112/222] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:17.621048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439c536-68cc-4794-b0fa-3a28dfa6f862 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:17.682748 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:17.728376 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b7775-72e8-4202-9766-3f277bddad6e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:17.736142 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:17.759639 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439c536-68cc-4794-b0fa-3a28dfa6f862 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:17.769152 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0fbd2-2356-4a37-94f8-fa273e0e55a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:17.770265 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0fbd2-2356-4a37-94f8-fa273e0e55a7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:17.770718 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0fbd2-2356-4a37-94f8-fa273e0e55a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:17.771143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0fbd2-2356-4a37-94f8-fa273e0e55a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:17.782385 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0fbd2-2356-4a37-94f8-fa273e0e55a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:17.790700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d1e0fbd2-2356-4a37-94f8-fa273e0e55a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:01:17.790700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:17.790700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:17.790700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:17.790700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:17.790700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:17.790700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:17.790700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:17.790700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:17.790700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:17.790700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:17.790700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:17.790700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:17.790700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:17.790700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:17.790700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:17.791833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:17.791833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:17.791833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:17.791833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:17.791833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:17.791833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:17.791833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:17.791833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:17.791833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:17.791833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:17.791833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:17.791833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:17.791833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:17.791833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:17.791833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:17.791833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:17.792584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:17.792584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:17.792584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:17.792584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:17.792584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:17.792584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:17.792584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:17.792584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:17.792584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:17.792584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:17.792584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:01:17.792584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:17.794984 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 111/223] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:01:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:17.796075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0fbd2-2356-4a37-94f8-fa273e0e55a7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:17.802708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add83ba1-5555-454b-adb2-8d4888465612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:17.803525 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add83ba1-5555-454b-adb2-8d4888465612 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:17.803803 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add83ba1-5555-454b-adb2-8d4888465612 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:17.804072 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add83ba1-5555-454b-adb2-8d4888465612 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:17.822702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add83ba1-5555-454b-adb2-8d4888465612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:17.834862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-add83ba1-5555-454b-adb2-8d4888465612 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:17.834862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:17.834862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:17.834862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:17.834862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:17.834862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:17.834862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:17.834862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:17.834862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:17.834862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:17.834862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:17.834862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:17.834862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:17.834862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:17.834862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:17.834862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:17.835756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:17.835756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:17.835756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:17.835756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:17.835756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:17.835756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:17.835756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:17.835756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:17.835756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:17.835756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:17.835756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:17.835756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:17.835756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:17.835756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:17.835756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:17.835756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:17.836539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:17.836539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:17.836539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:17.836539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:17.836539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:17.836539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:17.836539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:17.836539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:17.836539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:17.836539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:17.836539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:17.836539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:17.839700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 113/224] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:01:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:01:17.840731 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add83ba1-5555-454b-adb2-8d4888465612 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:17.935156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0fbd2-2356-4a37-94f8-fa273e0e55a7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:17.963955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add83ba1-5555-454b-adb2-8d4888465612 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:17.965855 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:17.982426 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153416e-2856-4c96-a5f7-915384bf4b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:17.983588 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153416e-2856-4c96-a5f7-915384bf4b51 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:17.983967 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153416e-2856-4c96-a5f7-915384bf4b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:17.984598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153416e-2856-4c96-a5f7-915384bf4b51 None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:17.986260 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153416e-2856-4c96-a5f7-915384bf4b51 None admin] RBAC: Authorizing `identity:get_project(project_id=54b0a661962441ba8877bf383738e206)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:17.987832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153416e-2856-4c96-a5f7-915384bf4b51 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:17.997060 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 112/225] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:17 2022] GET /identity/v3/projects/54b0a661962441ba8877bf383738e206 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:17.997060 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153416e-2856-4c96-a5f7-915384bf4b51 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:18.014444 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43481b-9393-45b2-8b34-99aa5e4830bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:18.015123 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43481b-9393-45b2-8b34-99aa5e4830bc None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:18.015411 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43481b-9393-45b2-8b34-99aa5e4830bc None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:18.015691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43481b-9393-45b2-8b34-99aa5e4830bc None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:18.016453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43481b-9393-45b2-8b34-99aa5e4830bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:18.016761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43481b-9393-45b2-8b34-99aa5e4830bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:18.018186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43481b-9393-45b2-8b34-99aa5e4830bc None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:18.026980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 114/226] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:18.027819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43481b-9393-45b2-8b34-99aa5e4830bc None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:18.041496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:18.117441 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153416e-2856-4c96-a5f7-915384bf4b51 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:18.155922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867766ec-632f-45a5-9f0c-474d06d33279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:18.156989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867766ec-632f-45a5-9f0c-474d06d33279 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:18.157278 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867766ec-632f-45a5-9f0c-474d06d33279 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:18.157561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867766ec-632f-45a5-9f0c-474d06d33279 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:18.158506 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867766ec-632f-45a5-9f0c-474d06d33279 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:18.158825 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867766ec-632f-45a5-9f0c-474d06d33279 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:18.160217 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867766ec-632f-45a5-9f0c-474d06d33279 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:18.161678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43481b-9393-45b2-8b34-99aa5e4830bc None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:18.175471 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 113/227] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:01:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:18.175471 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867766ec-632f-45a5-9f0c-474d06d33279 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:18.209710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4833f2f-f290-48bd-b7e2-41681463f3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:18.210582 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4833f2f-f290-48bd-b7e2-41681463f3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:18.210759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4833f2f-f290-48bd-b7e2-41681463f3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:18.211042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4833f2f-f290-48bd-b7e2-41681463f3d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:18.211887 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4833f2f-f290-48bd-b7e2-41681463f3d5 None admin] RBAC: Adding query filter params (role.id=ae11679806844c6f8d55ce5ccb32ee8b, scope.project.id=54b0a661962441ba8877bf383738e206, user.id=95be81eab03b4ae8bc7cc292f3611b12) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:18.212204 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4833f2f-f290-48bd-b7e2-41681463f3d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:18.213679 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4833f2f-f290-48bd-b7e2-41681463f3d5 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:18.226033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 115/228] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:18 2022] GET /identity/v3/role_assignments?user.id=95be81eab03b4ae8bc7cc292f3611b12&scope.project.id=54b0a661962441ba8877bf383738e206&role.id=ae11679806844c6f8d55ce5ccb32ee8b => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:18.226033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4833f2f-f290-48bd-b7e2-41681463f3d5 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:18.290532 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:18.353545 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:18.363795 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867766ec-632f-45a5-9f0c-474d06d33279 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:18.425649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851f866-6be6-41a5-8992-8a8c38c5bddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:18.426153 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4833f2f-f290-48bd-b7e2-41681463f3d5 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:18.427158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851f866-6be6-41a5-8992-8a8c38c5bddb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:18.427639 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851f866-6be6-41a5-8992-8a8c38c5bddb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:18.428107 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851f866-6be6-41a5-8992-8a8c38c5bddb None admin] PATH_INFO: `/v3/users/a0577fd4872e4d6f8969ba9007a91542` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:18.430580 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851f866-6be6-41a5-8992-8a8c38c5bddb None admin] RBAC: Authorizing `identity:get_user(user_id=a0577fd4872e4d6f8969ba9007a91542)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:18.432830 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851f866-6be6-41a5-8992-8a8c38c5bddb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:18.434751 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 114/229] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:18 2022] GET /identity/v3/users/a0577fd4872e4d6f8969ba9007a91542 => generated 283 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:18.441990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851f866-6be6-41a5-8992-8a8c38c5bddb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:18.495918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16213a4f-41db-478e-846a-acc4af7add98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:18.496807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16213a4f-41db-478e-846a-acc4af7add98 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:18.497087 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16213a4f-41db-478e-846a-acc4af7add98 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:18.497362 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16213a4f-41db-478e-846a-acc4af7add98 None admin] PATH_INFO: `/v3/users/a0577fd4872e4d6f8969ba9007a91542` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:18.498790 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16213a4f-41db-478e-846a-acc4af7add98 None admin] RBAC: Authorizing `identity:get_user(user_id=a0577fd4872e4d6f8969ba9007a91542)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:18.500244 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16213a4f-41db-478e-846a-acc4af7add98 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:18.501885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 116/230] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:18 2022] GET /identity/v3/users/a0577fd4872e4d6f8969ba9007a91542 => generated 283 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:18.515272 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16213a4f-41db-478e-846a-acc4af7add98 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:18.640139 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851f866-6be6-41a5-8992-8a8c38c5bddb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:18.682352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:18.685808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16213a4f-41db-478e-846a-acc4af7add98 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:18.700108 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ec792-9441-43bb-9837-9d4705adeb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:18.700980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ec792-9441-43bb-9837-9d4705adeb85 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:18.701258 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ec792-9441-43bb-9837-9d4705adeb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:18.701531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ec792-9441-43bb-9837-9d4705adeb85 None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:18.703839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ec792-9441-43bb-9837-9d4705adeb85 None admin] RBAC: Authorizing `identity:get_project(project_id=54b0a661962441ba8877bf383738e206)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:18.705294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ec792-9441-43bb-9837-9d4705adeb85 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:18.707979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 115/231] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:18 2022] GET /identity/v3/projects/54b0a661962441ba8877bf383738e206 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:18.714487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ec792-9441-43bb-9837-9d4705adeb85 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:18.755661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b3eb1-4a6a-496f-a986-cfb07ad4f4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:18.756503 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b3eb1-4a6a-496f-a986-cfb07ad4f4bf None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:18.756778 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b3eb1-4a6a-496f-a986-cfb07ad4f4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:18.757045 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b3eb1-4a6a-496f-a986-cfb07ad4f4bf None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:18.758378 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b3eb1-4a6a-496f-a986-cfb07ad4f4bf None admin] RBAC: Authorizing `identity:get_project(project_id=54b0a661962441ba8877bf383738e206)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:18.759863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b3eb1-4a6a-496f-a986-cfb07ad4f4bf None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:18.762763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 117/232] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:18 2022] GET /identity/v3/projects/54b0a661962441ba8877bf383738e206 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:18.769200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b3eb1-4a6a-496f-a986-cfb07ad4f4bf None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:18.773191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:18.896684 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ec792-9441-43bb-9837-9d4705adeb85 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:18.943791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b3eb1-4a6a-496f-a986-cfb07ad4f4bf None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:18.956563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f50938-bb9c-44c8-b071-c6a5a4bd4cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:18.957454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f50938-bb9c-44c8-b071-c6a5a4bd4cb6 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:18.957731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f50938-bb9c-44c8-b071-c6a5a4bd4cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:18.958018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f50938-bb9c-44c8-b071-c6a5a4bd4cb6 None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206/users/a0577fd4872e4d6f8969ba9007a91542/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:18.961246 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f50938-bb9c-44c8-b071-c6a5a4bd4cb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=54b0a661962441ba8877bf383738e206, user_id=a0577fd4872e4d6f8969ba9007a91542, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:18.963254 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f50938-bb9c-44c8-b071-c6a5a4bd4cb6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:18.986053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 116/233] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:01:18 2022] PUT /identity/v3/projects/54b0a661962441ba8877bf383738e206/users/a0577fd4872e4d6f8969ba9007a91542/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:01:18.996646 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d03c2-379a-45b8-9e68-97ff2d2f1738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:18.997606 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d03c2-379a-45b8-9e68-97ff2d2f1738 None admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:18.997889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d03c2-379a-45b8-9e68-97ff2d2f1738 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:18.998191 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d03c2-379a-45b8-9e68-97ff2d2f1738 None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206/users/a0577fd4872e4d6f8969ba9007a91542/roles/639e5e5307f34a64a854cfb59086518e` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:19.000472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d03c2-379a-45b8-9e68-97ff2d2f1738 None admin] RBAC: Authorizing `identity:create_grant(project_id=54b0a661962441ba8877bf383738e206, user_id=a0577fd4872e4d6f8969ba9007a91542, role_id=639e5e5307f34a64a854cfb59086518e)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:19.001980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d03c2-379a-45b8-9e68-97ff2d2f1738 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:19.019022 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 118/234] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:01:18 2022] PUT /identity/v3/projects/54b0a661962441ba8877bf383738e206/users/a0577fd4872e4d6f8969ba9007a91542/roles/639e5e5307f34a64a854cfb59086518e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:01:19.730149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63cb5d-5c3f-4846-b06c-f6510ee220ac None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:19.730662 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63cb5d-5c3f-4846-b06c-f6510ee220ac None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:19.730752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63cb5d-5c3f-4846-b06c-f6510ee220ac None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:19.732339 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 117/235] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:19.739676 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709956a4-ef66-4717-8e13-2f854ae250ba None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:19.740099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709956a4-ef66-4717-8e13-2f854ae250ba None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:19.740278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709956a4-ef66-4717-8e13-2f854ae250ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:19.766128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-709956a4-ef66-4717-8e13-2f854ae250ba None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:19.767441 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-709956a4-ef66-4717-8e13-2f854ae250ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:19.790335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:19.842832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 119/236] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:19.852129 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ae838-c003-4977-bb89-6bfcf8bc80d9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:19.852417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ae838-c003-4977-bb89-6bfcf8bc80d9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:19.852693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ae838-c003-4977-bb89-6bfcf8bc80d9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:19.854620 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 118/237] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:19.859770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0eff4-27a7-41d3-925f-2c97554602c3 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:19.860058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0eff4-27a7-41d3-925f-2c97554602c3 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:19.860334 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0eff4-27a7-41d3-925f-2c97554602c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:19.878302 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ae838-c003-4977-bb89-6bfcf8bc80d9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:19.878932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-a3f0eff4-27a7-41d3-925f-2c97554602c3 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:19.880116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a3f0eff4-27a7-41d3-925f-2c97554602c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:19.991983 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 120/238] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:20.025651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:20.036592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ae838-c003-4977-bb89-6bfcf8bc80d9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:20.047226 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0eff4-27a7-41d3-925f-2c97554602c3 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:20.076288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f150e-b4bd-4f68-a982-c494310df85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:20.077641 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f150e-b4bd-4f68-a982-c494310df85f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:20.078074 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f150e-b4bd-4f68-a982-c494310df85f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:20.078369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f150e-b4bd-4f68-a982-c494310df85f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:20.100978 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f150e-b4bd-4f68-a982-c494310df85f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:20.118103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7d3f150e-b4bd-4f68-a982-c494310df85f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:01:20.118103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:20.118103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:20.118103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:20.118103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:20.118103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:20.118103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:20.118103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:20.118103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:20.118103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:20.118103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:20.118103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:20.118103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:20.118103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:20.118103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:20.118103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:20.119547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:20.119547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:20.119547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:20.119547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:20.119547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:20.119547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:20.119547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:20.119547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:20.119547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:20.119547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:20.119547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:20.119547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:20.119547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:20.119547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:20.119547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:20.119547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:20.120290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:20.120290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:20.120290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:20.120290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:20.120290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:20.120290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:20.120290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:20.120290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:20.120290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:20.120290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:20.120290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:01:20.120290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:20.120290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 119/239] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:20.127125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f150e-b4bd-4f68-a982-c494310df85f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:20.155187 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:20.188168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0eff4-27a7-41d3-925f-2c97554602c3 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:20.257032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd0e40-69bc-4a4a-9e7f-a95df0a737e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:20.257746 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd0e40-69bc-4a4a-9e7f-a95df0a737e7 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:20.258037 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd0e40-69bc-4a4a-9e7f-a95df0a737e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:20.260538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd0e40-69bc-4a4a-9e7f-a95df0a737e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:20.263475 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd0e40-69bc-4a4a-9e7f-a95df0a737e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:20.267515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd0e40-69bc-4a4a-9e7f-a95df0a737e7 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:20.269363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 121/240] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:20.286826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd0e40-69bc-4a4a-9e7f-a95df0a737e7 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:20.325581 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f150e-b4bd-4f68-a982-c494310df85f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:20.384704 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74775c59-e510-403d-9281-33e1e67af7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:20.385431 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74775c59-e510-403d-9281-33e1e67af7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:20.385721 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74775c59-e510-403d-9281-33e1e67af7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:20.386011 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74775c59-e510-403d-9281-33e1e67af7e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:20.386777 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74775c59-e510-403d-9281-33e1e67af7e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:20.387085 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74775c59-e510-403d-9281-33e1e67af7e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:20.388614 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74775c59-e510-403d-9281-33e1e67af7e3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:20.402137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 120/241] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:20.415025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74775c59-e510-403d-9281-33e1e67af7e3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:20.420717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd0e40-69bc-4a4a-9e7f-a95df0a737e7 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:20.462932 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:20.490726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90ed6e-132b-413c-9935-9db94602c191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:20.491424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90ed6e-132b-413c-9935-9db94602c191 None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:20.491887 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90ed6e-132b-413c-9935-9db94602c191 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:20.492182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90ed6e-132b-413c-9935-9db94602c191 None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:20.492889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90ed6e-132b-413c-9935-9db94602c191 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:20.494438 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90ed6e-132b-413c-9935-9db94602c191 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:20.552633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74775c59-e510-403d-9281-33e1e67af7e3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:20.553327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 122/242] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 12:01:20 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:01:20.635314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9113813-278f-4a46-9a35-9a4f6f4e1477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:20.636225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9113813-278f-4a46-9a35-9a4f6f4e1477 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:20.636505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9113813-278f-4a46-9a35-9a4f6f4e1477 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:20.636774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9113813-278f-4a46-9a35-9a4f6f4e1477 None admin] PATH_INFO: `/v3/users/3d28a4e3373f40a29d4b12509744707a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:20.664882 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9113813-278f-4a46-9a35-9a4f6f4e1477 None admin] RBAC: Authorizing `identity:get_user(user_id=3d28a4e3373f40a29d4b12509744707a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:20.666736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9113813-278f-4a46-9a35-9a4f6f4e1477 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:20.668509 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 121/243] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:20 2022] GET /identity/v3/users/3d28a4e3373f40a29d4b12509744707a => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:20.674350 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90ed6e-132b-413c-9935-9db94602c191 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:20.685863 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f21311-1b53-4721-a393-5cd7ec058079 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:20.686215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f21311-1b53-4721-a393-5cd7ec058079 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:20.686445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f21311-1b53-4721-a393-5cd7ec058079 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:20.688046 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 122/244] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:20.694325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bf1c4-339b-4935-9996-f9f6992638e6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:20.695340 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:20.696188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bf1c4-339b-4935-9996-f9f6992638e6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:20.696476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bf1c4-339b-4935-9996-f9f6992638e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:20.721501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-063bf1c4-339b-4935-9996-f9f6992638e6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:20.723138 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-063bf1c4-339b-4935-9996-f9f6992638e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:20.812097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 123/245] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:01:20.836748 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bf1c4-339b-4935-9996-f9f6992638e6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:20.839908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:20.851846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90ed6e-132b-413c-9935-9db94602c191 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:20.899913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6a59e-797a-4109-9f4c-1e611dd5c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:20.901974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6a59e-797a-4109-9f4c-1e611dd5c5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:20.902444 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6a59e-797a-4109-9f4c-1e611dd5c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:20.902889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6a59e-797a-4109-9f4c-1e611dd5c5e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:20.968494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bf1c4-339b-4935-9996-f9f6992638e6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:20.997425 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6a59e-797a-4109-9f4c-1e611dd5c5e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:20.998985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6a59e-797a-4109-9f4c-1e611dd5c5e9 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:21.010974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:21.013426 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d620e36-342a-4eb2-a2ac-fd03eb4555e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:21.014800 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d620e36-342a-4eb2-a2ac-fd03eb4555e5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:21.015284 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d620e36-342a-4eb2-a2ac-fd03eb4555e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:21.015764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d620e36-342a-4eb2-a2ac-fd03eb4555e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:21.034030 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d620e36-342a-4eb2-a2ac-fd03eb4555e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:21.046188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7d620e36-342a-4eb2-a2ac-fd03eb4555e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:21.046188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:21.046188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:21.046188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:21.046188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:21.046188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:21.046188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:21.046188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:21.046188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:21.046188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:21.046188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:21.046188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:21.046188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:21.046188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:21.046188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:21.046188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:21.047346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:21.047346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:21.047346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:21.047346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:21.047346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:21.047346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:21.047346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:21.047346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:21.047346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:21.047346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:21.047346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:21.047346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:21.047346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:21.047346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:21.047346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:21.047346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:21.048301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:21.048301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:21.048301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:21.048301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:21.048301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:21.048301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:21.048301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:21.048301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:21.048301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:21.048301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:21.048301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:21.048301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:21.050343 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 124/246] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:01:21.059837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d620e36-342a-4eb2-a2ac-fd03eb4555e5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:21.145410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 123/247] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:21.152029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6a59e-797a-4109-9f4c-1e611dd5c5e9 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:21.153147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:21.207423 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d620e36-342a-4eb2-a2ac-fd03eb4555e5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:21.254193 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d222655-4180-44ad-9b03-44bd30ab7e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:21.255177 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d222655-4180-44ad-9b03-44bd30ab7e81 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:21.255620 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d222655-4180-44ad-9b03-44bd30ab7e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:21.256095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d222655-4180-44ad-9b03-44bd30ab7e81 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:21.256978 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d222655-4180-44ad-9b03-44bd30ab7e81 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:21.257883 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d222655-4180-44ad-9b03-44bd30ab7e81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:21.259890 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d222655-4180-44ad-9b03-44bd30ab7e81 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:21.271374 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 125/248] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:21.279753 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d222655-4180-44ad-9b03-44bd30ab7e81 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:21.292076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6a59e-797a-4109-9f4c-1e611dd5c5e9 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:21.306112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:21.335955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb38bf-3a0d-43d5-811d-7ad945ad7297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:21.337198 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb38bf-3a0d-43d5-811d-7ad945ad7297 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:21.338371 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb38bf-3a0d-43d5-811d-7ad945ad7297 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:21.338880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb38bf-3a0d-43d5-811d-7ad945ad7297 None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:21.340360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb38bf-3a0d-43d5-811d-7ad945ad7297 None admin] RBAC: Authorizing `identity:get_project(project_id=54b0a661962441ba8877bf383738e206)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:21.342095 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb38bf-3a0d-43d5-811d-7ad945ad7297 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:21.344168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 124/249] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:21 2022] GET /identity/v3/projects/54b0a661962441ba8877bf383738e206 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:21.350333 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb38bf-3a0d-43d5-811d-7ad945ad7297 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:21.408481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d222655-4180-44ad-9b03-44bd30ab7e81 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:21.464166 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:21.491214 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb38bf-3a0d-43d5-811d-7ad945ad7297 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:21.504315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a5823-4688-4b21-9e4e-acf3a7b40bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:21.505639 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a5823-4688-4b21-9e4e-acf3a7b40bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:21.506154 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a5823-4688-4b21-9e4e-acf3a7b40bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:21.506636 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a5823-4688-4b21-9e4e-acf3a7b40bc3 None admin] PATH_INFO: `/v3/users/95be81eab03b4ae8bc7cc292f3611b12` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:21.510789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a5823-4688-4b21-9e4e-acf3a7b40bc3 None admin] RBAC: Authorizing `identity:get_user(user_id=95be81eab03b4ae8bc7cc292f3611b12)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:21.512257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a5823-4688-4b21-9e4e-acf3a7b40bc3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:21.513920 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 126/250] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:21 2022] GET /identity/v3/users/95be81eab03b4ae8bc7cc292f3611b12 => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:21.515148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e63c0-3957-4a2c-9070-53d2d3ea234c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:21.515427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e63c0-3957-4a2c-9070-53d2d3ea234c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:21.515703 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e63c0-3957-4a2c-9070-53d2d3ea234c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:21.516935 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 127/251] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:21.523415 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49528fc9-3793-4f93-9d0d-cdeb7caeb3e8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:21.523647 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49528fc9-3793-4f93-9d0d-cdeb7caeb3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:21.523888 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49528fc9-3793-4f93-9d0d-cdeb7caeb3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:21.532391 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf3468-92d5-43aa-8bb1-791604214c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:21.533351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf3468-92d5-43aa-8bb1-791604214c9b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:21.533853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf3468-92d5-43aa-8bb1-791604214c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:21.534355 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf3468-92d5-43aa-8bb1-791604214c9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:21.535408 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf3468-92d5-43aa-8bb1-791604214c9b None admin] RBAC: Adding query filter params (role.id=89c1404610d74d74bdd3ea913c3de5ba, scope.project.id=54b0a661962441ba8877bf383738e206, user.id=3d28a4e3373f40a29d4b12509744707a) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:21.535925 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf3468-92d5-43aa-8bb1-791604214c9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:21.537557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf3468-92d5-43aa-8bb1-791604214c9b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:21.545758 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 125/252] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:21 2022] GET /identity/v3/role_assignments?user.id=3d28a4e3373f40a29d4b12509744707a&scope.project.id=54b0a661962441ba8877bf383738e206&role.id=89c1404610d74d74bdd3ea913c3de5ba => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:21.546950 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf3468-92d5-43aa-8bb1-791604214c9b None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:21.563148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-49528fc9-3793-4f93-9d0d-cdeb7caeb3e8 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:21.564433 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-49528fc9-3793-4f93-9d0d-cdeb7caeb3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:21.600940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:21.677524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf3468-92d5-43aa-8bb1-791604214c9b None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:21.722191 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408bbc1-b90f-459a-ad0f-2dae28d82b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:21.723426 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408bbc1-b90f-459a-ad0f-2dae28d82b00 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:21.723911 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408bbc1-b90f-459a-ad0f-2dae28d82b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:21.724385 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408bbc1-b90f-459a-ad0f-2dae28d82b00 None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:21.725910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408bbc1-b90f-459a-ad0f-2dae28d82b00 None admin] RBAC: Authorizing `identity:get_project(project_id=54b0a661962441ba8877bf383738e206)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:21.728197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408bbc1-b90f-459a-ad0f-2dae28d82b00 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:21.730875 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 126/253] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:21 2022] GET /identity/v3/projects/54b0a661962441ba8877bf383738e206 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:21.732558 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f81c8-974a-4f1f-8e43-ec15cef7214f None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:21.733045 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f81c8-974a-4f1f-8e43-ec15cef7214f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:21.733543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f81c8-974a-4f1f-8e43-ec15cef7214f None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:21.735832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 127/254] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:21.736908 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f81c8-974a-4f1f-8e43-ec15cef7214f None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:21.742968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 128/255] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:21.744832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf5f57-cd9f-4bc2-b05d-f4917b213470 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:21.745121 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf5f57-cd9f-4bc2-b05d-f4917b213470 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:21.745397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf5f57-cd9f-4bc2-b05d-f4917b213470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:21.780357 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0bdf5f57-cd9f-4bc2-b05d-f4917b213470 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:21.781613 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0bdf5f57-cd9f-4bc2-b05d-f4917b213470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:21.865752 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f81c8-974a-4f1f-8e43-ec15cef7214f None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:21.879472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:21.887726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 129/256] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:21.888362 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf5f57-cd9f-4bc2-b05d-f4917b213470 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:21.912604 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d109ca-9c6e-48a9-9934-71d477c350fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:21.913840 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d109ca-9c6e-48a9-9934-71d477c350fc None admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:21.914347 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d109ca-9c6e-48a9-9934-71d477c350fc None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:21.914865 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d109ca-9c6e-48a9-9934-71d477c350fc None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206/users/95be81eab03b4ae8bc7cc292f3611b12/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:21.917345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d109ca-9c6e-48a9-9934-71d477c350fc None admin] RBAC: Authorizing `identity:create_grant(project_id=54b0a661962441ba8877bf383738e206, user_id=95be81eab03b4ae8bc7cc292f3611b12, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:21.919026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d109ca-9c6e-48a9-9934-71d477c350fc None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:21.934862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 128/257] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:01:21 2022] PUT /identity/v3/projects/54b0a661962441ba8877bf383738e206/users/95be81eab03b4ae8bc7cc292f3611b12/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:01:21.936152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d109ca-9c6e-48a9-9934-71d477c350fc None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:21.992641 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:22.067271 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d109ca-9c6e-48a9-9934-71d477c350fc None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:22.077875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf5f57-cd9f-4bc2-b05d-f4917b213470 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:22.106204 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe9c34-041e-4748-8fdc-f70c40f65228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:22.107256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe9c34-041e-4748-8fdc-f70c40f65228 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:22.107639 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe9c34-041e-4748-8fdc-f70c40f65228 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:22.108009 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe9c34-041e-4748-8fdc-f70c40f65228 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:22.120492 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe9c34-041e-4748-8fdc-f70c40f65228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:22.128539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-acbe9c34-041e-4748-8fdc-f70c40f65228 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:01:22.128539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:22.128539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:22.128539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:22.128539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:22.128539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:22.128539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:22.128539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:22.128539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:22.128539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:22.128539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:22.128539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:22.128539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:22.128539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:22.128539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:22.128539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:22.129483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:22.129483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:22.129483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:22.129483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:22.129483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:22.129483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:22.129483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:22.129483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:22.129483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:22.129483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:22.129483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:22.129483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:22.129483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:22.129483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:22.129483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:22.129483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:22.130280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:22.130280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:22.130280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:22.130280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:22.130280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:22.130280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:22.130280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:22.130280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:22.130280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:22.130280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:22.130280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:01:22.130280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:22.131998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 129/258] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:01:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:22.137642 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20e67c-a5ba-41ac-8861-aef480aa0abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:22.138577 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20e67c-a5ba-41ac-8861-aef480aa0abc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:22.139077 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20e67c-a5ba-41ac-8861-aef480aa0abc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:22.140066 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe9c34-041e-4748-8fdc-f70c40f65228 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:22.148970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20e67c-a5ba-41ac-8861-aef480aa0abc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:22.171375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20e67c-a5ba-41ac-8861-aef480aa0abc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:22.183222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-be20e67c-a5ba-41ac-8861-aef480aa0abc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:22.183222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:22.183222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:22.183222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:22.183222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:22.183222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:22.183222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:22.183222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:22.183222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:22.183222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:22.183222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:22.183222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:22.183222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:22.183222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:22.183222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:22.183222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:22.184145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:22.184145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:22.184145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:22.184145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:22.184145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:22.184145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:22.184145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:22.184145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:22.184145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:22.184145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:22.184145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:22.184145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:22.184145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:22.184145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:22.184145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:22.184145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:22.184942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:22.184942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:22.184942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:22.184942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:22.184942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:22.184942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:22.184942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:22.184942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:22.184942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:22.184942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:22.184942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:22.184942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:22.184942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 130/259] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:01:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:22.195036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20e67c-a5ba-41ac-8861-aef480aa0abc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:22.200398 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:22.333896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe9c34-041e-4748-8fdc-f70c40f65228 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:22.362872 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20e67c-a5ba-41ac-8861-aef480aa0abc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:22.386346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:22.401828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b65b32-008f-4dc3-9958-3b0d5d7072da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:22.402552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b65b32-008f-4dc3-9958-3b0d5d7072da None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:22.402848 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b65b32-008f-4dc3-9958-3b0d5d7072da None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:22.403113 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b65b32-008f-4dc3-9958-3b0d5d7072da None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:22.403866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b65b32-008f-4dc3-9958-3b0d5d7072da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:22.404174 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b65b32-008f-4dc3-9958-3b0d5d7072da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:22.408736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b65b32-008f-4dc3-9958-3b0d5d7072da None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:22.425817 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 130/260] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:22.428044 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262d811-3538-4984-9ad9-31c905ec66d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:22.428538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262d811-3538-4984-9ad9-31c905ec66d6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:22.428820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262d811-3538-4984-9ad9-31c905ec66d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:22.429093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262d811-3538-4984-9ad9-31c905ec66d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:22.429852 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262d811-3538-4984-9ad9-31c905ec66d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:22.430195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262d811-3538-4984-9ad9-31c905ec66d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:22.432230 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262d811-3538-4984-9ad9-31c905ec66d6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:22.434436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b65b32-008f-4dc3-9958-3b0d5d7072da None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:22.448440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 131/261] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:01:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:22.453910 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262d811-3538-4984-9ad9-31c905ec66d6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:22.537659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:22.550585 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b65b32-008f-4dc3-9958-3b0d5d7072da None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:22.586839 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f209d8-8fe6-4b3c-9afb-1567a6da326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:22.588641 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f209d8-8fe6-4b3c-9afb-1567a6da326d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:22.589058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f209d8-8fe6-4b3c-9afb-1567a6da326d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:22.589468 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f209d8-8fe6-4b3c-9afb-1567a6da326d None admin] PATH_INFO: `/v3/users/a0577fd4872e4d6f8969ba9007a91542` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:22.590850 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f209d8-8fe6-4b3c-9afb-1567a6da326d None admin] RBAC: Authorizing `identity:get_user(user_id=a0577fd4872e4d6f8969ba9007a91542)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:22.592439 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f209d8-8fe6-4b3c-9afb-1567a6da326d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:22.594255 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 131/262] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:22 2022] GET /identity/v3/users/a0577fd4872e4d6f8969ba9007a91542 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:22.606950 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f209d8-8fe6-4b3c-9afb-1567a6da326d None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:22.671025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262d811-3538-4984-9ad9-31c905ec66d6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:22.741515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5612f5-e2a2-4f82-9fdb-8887fe66ef54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:22.742682 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5612f5-e2a2-4f82-9fdb-8887fe66ef54 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:22.744080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5612f5-e2a2-4f82-9fdb-8887fe66ef54 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:22.749768 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5612f5-e2a2-4f82-9fdb-8887fe66ef54 None admin] PATH_INFO: `/v3/users/a0577fd4872e4d6f8969ba9007a91542` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:22.751224 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5612f5-e2a2-4f82-9fdb-8887fe66ef54 None admin] RBAC: Authorizing `identity:get_user(user_id=a0577fd4872e4d6f8969ba9007a91542)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:22.752824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5612f5-e2a2-4f82-9fdb-8887fe66ef54 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:22.756967 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 132/263] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:22 2022] GET /identity/v3/users/a0577fd4872e4d6f8969ba9007a91542 => generated 283 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:22.762584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5612f5-e2a2-4f82-9fdb-8887fe66ef54 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:22.805048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f209d8-8fe6-4b3c-9afb-1567a6da326d None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:22.848003 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:22.874029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbd7f8-a685-4c4b-a10f-098ae6e9248d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:22.875939 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbd7f8-a685-4c4b-a10f-098ae6e9248d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:22.876498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbd7f8-a685-4c4b-a10f-098ae6e9248d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:22.877547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbd7f8-a685-4c4b-a10f-098ae6e9248d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:22.935662 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:22.980171 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5612f5-e2a2-4f82-9fdb-8887fe66ef54 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:22.986820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbd7f8-a685-4c4b-a10f-098ae6e9248d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:22.988544 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbd7f8-a685-4c4b-a10f-098ae6e9248d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:23.065828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a483b1-3c40-4881-a567-a19e531a1cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:23.066202 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a483b1-3c40-4881-a567-a19e531a1cce None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:23.066487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a483b1-3c40-4881-a567-a19e531a1cce None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:23.066758 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a483b1-3c40-4881-a567-a19e531a1cce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:23.100974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 132/264] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 12:01:23.106707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbd7f8-a685-4c4b-a10f-098ae6e9248d None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:23.209128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:23.211747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a483b1-3c40-4881-a567-a19e531a1cce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:23.213298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a483b1-3c40-4881-a567-a19e531a1cce None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:23.266437 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:23.278888 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbd7f8-a685-4c4b-a10f-098ae6e9248d None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:23.327445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 133/265] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 12:01:23.331322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a483b1-3c40-4881-a567-a19e531a1cce None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:23.357755 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c12c24-6c24-40be-8908-1e61d76b7e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:23.358730 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c12c24-6c24-40be-8908-1e61d76b7e98 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:23.359012 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c12c24-6c24-40be-8908-1e61d76b7e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:23.359285 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c12c24-6c24-40be-8908-1e61d76b7e98 None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:23.360789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c12c24-6c24-40be-8908-1e61d76b7e98 None admin] RBAC: Authorizing `identity:get_project(project_id=54b0a661962441ba8877bf383738e206)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:23.362275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c12c24-6c24-40be-8908-1e61d76b7e98 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:23.364689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 133/266] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:23 2022] GET /identity/v3/projects/54b0a661962441ba8877bf383738e206 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:23.371003 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c12c24-6c24-40be-8908-1e61d76b7e98 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:23.505943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a483b1-3c40-4881-a567-a19e531a1cce None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:23.560195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c12c24-6c24-40be-8908-1e61d76b7e98 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:23.562707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c88f8e-fa52-4b18-b793-d0659b59442e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:23.563600 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c88f8e-fa52-4b18-b793-d0659b59442e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:23.563886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c88f8e-fa52-4b18-b793-d0659b59442e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:23.564166 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c88f8e-fa52-4b18-b793-d0659b59442e None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:23.565421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c88f8e-fa52-4b18-b793-d0659b59442e None admin] RBAC: Authorizing `identity:get_project(project_id=54b0a661962441ba8877bf383738e206)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:23.566940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c88f8e-fa52-4b18-b793-d0659b59442e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:23.568978 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 134/267] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:23 2022] GET /identity/v3/projects/54b0a661962441ba8877bf383738e206 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:23.579017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c88f8e-fa52-4b18-b793-d0659b59442e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:23.592421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:23.605665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:23.620244 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e49db-edf3-460d-8ab7-762e3e518ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:23.620924 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e49db-edf3-460d-8ab7-762e3e518ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:23.626412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e49db-edf3-460d-8ab7-762e3e518ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:23.626701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e49db-edf3-460d-8ab7-762e3e518ab8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:23.627591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e49db-edf3-460d-8ab7-762e3e518ab8 None admin] RBAC: Adding query filter params (role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.project.id=54b0a661962441ba8877bf383738e206, user.id=a0577fd4872e4d6f8969ba9007a91542) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:23.627911 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e49db-edf3-460d-8ab7-762e3e518ab8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:23.629366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e49db-edf3-460d-8ab7-762e3e518ab8 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:23.636091 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 134/268] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:23 2022] GET /identity/v3/role_assignments?user.id=a0577fd4872e4d6f8969ba9007a91542&scope.project.id=54b0a661962441ba8877bf383738e206&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:23.724310 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c88f8e-fa52-4b18-b793-d0659b59442e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:23.762094 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba29623-def4-4054-a6db-a1c2d473e698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:23.762765 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba29623-def4-4054-a6db-a1c2d473e698 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:23.763048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba29623-def4-4054-a6db-a1c2d473e698 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:23.763324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba29623-def4-4054-a6db-a1c2d473e698 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:23.764177 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba29623-def4-4054-a6db-a1c2d473e698 None admin] RBAC: Adding query filter params (role.id=639e5e5307f34a64a854cfb59086518e, scope.project.id=54b0a661962441ba8877bf383738e206, user.id=a0577fd4872e4d6f8969ba9007a91542) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:23.764494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba29623-def4-4054-a6db-a1c2d473e698 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:23.765952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba29623-def4-4054-a6db-a1c2d473e698 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:23.772693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 135/269] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:23 2022] GET /identity/v3/role_assignments?user.id=a0577fd4872e4d6f8969ba9007a91542&scope.project.id=54b0a661962441ba8877bf383738e206&role.id=639e5e5307f34a64a854cfb59086518e => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:24.062991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38682714-b9af-49ec-ab65-156353301ce8 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:24.063680 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38682714-b9af-49ec-ab65-156353301ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:24.063680 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38682714-b9af-49ec-ab65-156353301ce8 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:24.065175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 135/270] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:24.070545 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0db95a-f014-45f4-99bd-ff8b4843e10c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:24.071073 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0db95a-f014-45f4-99bd-ff8b4843e10c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:24.071073 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0db95a-f014-45f4-99bd-ff8b4843e10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:24.098096 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-dd0db95a-f014-45f4-99bd-ff8b4843e10c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:24.099272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dd0db95a-f014-45f4-99bd-ff8b4843e10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:24.182191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 136/271] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:01:24.205983 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38682714-b9af-49ec-ab65-156353301ce8 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:24.236114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0186aa-c9f8-4f4a-9ddb-bb1aaab91785 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:24.236412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0186aa-c9f8-4f4a-9ddb-bb1aaab91785 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:24.236679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0186aa-c9f8-4f4a-9ddb-bb1aaab91785 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:24.238092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 137/272] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:24.244030 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d223cb-6a95-4f58-ab04-c2c89aca4c9b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:24.244319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d223cb-6a95-4f58-ab04-c2c89aca4c9b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:24.244598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d223cb-6a95-4f58-ab04-c2c89aca4c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:24.253085 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:24.269501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e2d223cb-6a95-4f58-ab04-c2c89aca4c9b None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:24.271279 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e2d223cb-6a95-4f58-ab04-c2c89aca4c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:24.338800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38682714-b9af-49ec-ab65-156353301ce8 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:24.343807 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 138/273] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:01:24.345128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e56f0f-a32e-42f3-b560-41ca2a4f3c96 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:24.345411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e56f0f-a32e-42f3-b560-41ca2a4f3c96 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:24.345681 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e56f0f-a32e-42f3-b560-41ca2a4f3c96 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:24.350032 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 139/274] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:24.352125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe19f0-be6f-4794-9776-f0851332863c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:24.352405 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe19f0-be6f-4794-9776-f0851332863c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:24.352676 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe19f0-be6f-4794-9776-f0851332863c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:24.371631 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d7fe19f0-be6f-4794-9776-f0851332863c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:24.372796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d7fe19f0-be6f-4794-9776-f0851332863c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:24.382627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b6b04-8abf-447d-8c24-35e49ccbf189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:24.383427 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b6b04-8abf-447d-8c24-35e49ccbf189 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:24.383713 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b6b04-8abf-447d-8c24-35e49ccbf189 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:24.383990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b6b04-8abf-447d-8c24-35e49ccbf189 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:24.395471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b6b04-8abf-447d-8c24-35e49ccbf189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:24.403967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-f32b6b04-8abf-447d-8c24-35e49ccbf189 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:24.403967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:24.403967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:24.403967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:24.403967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:24.403967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:24.403967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:24.403967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:24.403967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:24.403967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:24.403967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:24.403967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:24.403967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:24.403967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:24.403967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:24.403967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:24.404823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:24.404823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:24.404823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:24.404823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:24.404823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:24.404823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:24.404823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:24.404823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:24.404823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:24.404823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:24.404823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:24.404823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:24.404823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:24.404823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:24.404823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:24.404823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:24.405601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:24.405601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:24.405601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:24.405601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:24.405601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:24.405601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:24.405601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:24.405601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:24.405601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:24.405601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:24.405601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:24.405601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:24.405601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 136/275] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:24.406352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b6b04-8abf-447d-8c24-35e49ccbf189 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:24.454167 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 140/276] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:01:24.455073 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe19f0-be6f-4794-9776-f0851332863c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:24.471381 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:24.527148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:24.532748 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b6b04-8abf-447d-8c24-35e49ccbf189 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:24.565702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5736c2-6987-4c22-aaf9-366bea201b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:24.566522 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5736c2-6987-4c22-aaf9-366bea201b84 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:24.566806 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5736c2-6987-4c22-aaf9-366bea201b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:24.566952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe19f0-be6f-4794-9776-f0851332863c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:24.567077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5736c2-6987-4c22-aaf9-366bea201b84 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:24.577802 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5736c2-6987-4c22-aaf9-366bea201b84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:24.585429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-ca5736c2-6987-4c22-aaf9-366bea201b84 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:01:24.585429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:24.585429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:24.585429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:24.585429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:24.585429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:24.585429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:24.585429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:24.585429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:24.585429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:24.585429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:24.585429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:24.585429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:24.585429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:24.585429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:24.585429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:24.586531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:24.586531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:24.586531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:24.586531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:24.586531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:24.586531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:24.586531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:24.586531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:24.586531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:24.586531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:24.586531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:24.586531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:24.586531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:24.586531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:24.586531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:24.586531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:24.590918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:24.590918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:24.590918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:24.590918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:24.590918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:24.590918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:24.590918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:24.590918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:24.590918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:24.590918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:24.590918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:01:24.590918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:24.590918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 137/277] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:24.590918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5736c2-6987-4c22-aaf9-366bea201b84 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:24.608205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85edd7-49d9-45d5-8f7b-3300eaf30c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:24.608961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85edd7-49d9-45d5-8f7b-3300eaf30c40 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:24.609245 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85edd7-49d9-45d5-8f7b-3300eaf30c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:24.609521 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85edd7-49d9-45d5-8f7b-3300eaf30c40 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:24.610318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85edd7-49d9-45d5-8f7b-3300eaf30c40 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:24.610791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85edd7-49d9-45d5-8f7b-3300eaf30c40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:24.612193 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85edd7-49d9-45d5-8f7b-3300eaf30c40 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:24.624662 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 141/278] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:24.624662 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85edd7-49d9-45d5-8f7b-3300eaf30c40 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:24.698671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5736c2-6987-4c22-aaf9-366bea201b84 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:24.709861 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:24.728895 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85edd7-49d9-45d5-8f7b-3300eaf30c40 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:24.736254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae779a1d-4ea8-41ec-99e4-ea30d77ebbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:24.737065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae779a1d-4ea8-41ec-99e4-ea30d77ebbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:24.737352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae779a1d-4ea8-41ec-99e4-ea30d77ebbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:24.737637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae779a1d-4ea8-41ec-99e4-ea30d77ebbb9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:24.738865 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae779a1d-4ea8-41ec-99e4-ea30d77ebbb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:24.740324 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae779a1d-4ea8-41ec-99e4-ea30d77ebbb9 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:24.741971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 138/279] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:24.741971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae779a1d-4ea8-41ec-99e4-ea30d77ebbb9 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:24.760682 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:24.770636 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a83fb2-0652-4982-b8eb-c45203bd6ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:24.771332 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a83fb2-0652-4982-b8eb-c45203bd6ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:24.771608 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a83fb2-0652-4982-b8eb-c45203bd6ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:24.771876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a83fb2-0652-4982-b8eb-c45203bd6ae8 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:24.772612 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a83fb2-0652-4982-b8eb-c45203bd6ae8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:24.772912 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a83fb2-0652-4982-b8eb-c45203bd6ae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:24.774328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a83fb2-0652-4982-b8eb-c45203bd6ae8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:24.786990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 142/280] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:24.786990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a83fb2-0652-4982-b8eb-c45203bd6ae8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:24.854037 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae779a1d-4ea8-41ec-99e4-ea30d77ebbb9 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:24.888096 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf5fbe-7c04-43e2-8bb7-8874741a8efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:24.888989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf5fbe-7c04-43e2-8bb7-8874741a8efe None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:24.889258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf5fbe-7c04-43e2-8bb7-8874741a8efe None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:24.889532 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf5fbe-7c04-43e2-8bb7-8874741a8efe None admin] PATH_INFO: `/v3/users/480779cf1ca443e29a0c5764d0e6cd2a` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:24.892000 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a83fb2-0652-4982-b8eb-c45203bd6ae8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:24.903069 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf5fbe-7c04-43e2-8bb7-8874741a8efe None admin] RBAC: Authorizing `identity:get_user(user_id=480779cf1ca443e29a0c5764d0e6cd2a)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:24.904571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf5fbe-7c04-43e2-8bb7-8874741a8efe None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:24.906299 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 139/281] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:24 2022] GET /identity/v3/users/480779cf1ca443e29a0c5764d0e6cd2a => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:24.910979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf5fbe-7c04-43e2-8bb7-8874741a8efe None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:24.925391 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ce0ce-75dd-4a6c-9d8f-c8e96da54835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:24.926086 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ce0ce-75dd-4a6c-9d8f-c8e96da54835 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:24.926366 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ce0ce-75dd-4a6c-9d8f-c8e96da54835 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:24.926640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ce0ce-75dd-4a6c-9d8f-c8e96da54835 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:24.927338 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ce0ce-75dd-4a6c-9d8f-c8e96da54835 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:24.928771 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ce0ce-75dd-4a6c-9d8f-c8e96da54835 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:24.947564 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:24.951341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 143/282] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 12:01:24 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:01:24.951341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691e979-a626-4e5d-ae7d-7ab8aa7881e4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:24.951341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691e979-a626-4e5d-ae7d-7ab8aa7881e4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:24.951341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691e979-a626-4e5d-ae7d-7ab8aa7881e4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:24.951341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 144/283] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:24.951341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691e979-a626-4e5d-ae7d-7ab8aa7881e4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:25.013269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:25.025509 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf5fbe-7c04-43e2-8bb7-8874741a8efe None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:25.063567 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82319b99-b837-491c-b558-ef4f0295347e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:25.064455 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82319b99-b837-491c-b558-ef4f0295347e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:25.064741 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82319b99-b837-491c-b558-ef4f0295347e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:25.065020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82319b99-b837-491c-b558-ef4f0295347e None admin] PATH_INFO: `/v3/users/3d28a4e3373f40a29d4b12509744707a` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:25.066410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82319b99-b837-491c-b558-ef4f0295347e None admin] RBAC: Authorizing `identity:get_user(user_id=3d28a4e3373f40a29d4b12509744707a)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:25.067935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82319b99-b837-491c-b558-ef4f0295347e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:25.069676 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 140/284] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:24 2022] GET /identity/v3/users/3d28a4e3373f40a29d4b12509744707a => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:25.070967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d95d11-9f6b-408e-8f42-6027525d1d7b None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:25.071278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d95d11-9f6b-408e-8f42-6027525d1d7b None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:25.071554 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d95d11-9f6b-408e-8f42-6027525d1d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:25.082347 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691e979-a626-4e5d-ae7d-7ab8aa7881e4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:25.090792 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-18d95d11-9f6b-408e-8f42-6027525d1d7b None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:25.092033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-18d95d11-9f6b-408e-8f42-6027525d1d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:25.126072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30a0e2-7103-41cc-880f-b238e4455860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:25.126717 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30a0e2-7103-41cc-880f-b238e4455860 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:25.126997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30a0e2-7103-41cc-880f-b238e4455860 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:25.127271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30a0e2-7103-41cc-880f-b238e4455860 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:25.128115 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30a0e2-7103-41cc-880f-b238e4455860 None admin] RBAC: Adding query filter params (role.id=ae11679806844c6f8d55ce5ccb32ee8b, user.id=480779cf1ca443e29a0c5764d0e6cd2a, scope.system=all) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:25.128417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30a0e2-7103-41cc-880f-b238e4455860 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:25.129978 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30a0e2-7103-41cc-880f-b238e4455860 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:25.135380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 145/285] 10.222.0.48 () {56 vars in 1308 bytes} [Mon Jul 25 12:01:24 2022] GET /identity/v3/role_assignments?user.id=480779cf1ca443e29a0c5764d0e6cd2a&scope.system=all&role.id=ae11679806844c6f8d55ce5ccb32ee8b => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:25.136145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30a0e2-7103-41cc-880f-b238e4455860 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:25.174078 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 141/286] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:25.198624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d95d11-9f6b-408e-8f42-6027525d1d7b None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:25.247931 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:25.275124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30a0e2-7103-41cc-880f-b238e4455860 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:25.287720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:25.325156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9b3a1-b61b-4ecd-a3e2-deb45f2db32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:25.326122 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9b3a1-b61b-4ecd-a3e2-deb45f2db32d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:25.326407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9b3a1-b61b-4ecd-a3e2-deb45f2db32d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:25.326677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9b3a1-b61b-4ecd-a3e2-deb45f2db32d None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:25.327892 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9b3a1-b61b-4ecd-a3e2-deb45f2db32d None admin] RBAC: Authorizing `identity:get_project(project_id=54b0a661962441ba8877bf383738e206)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:25.329338 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9b3a1-b61b-4ecd-a3e2-deb45f2db32d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:25.331074 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 146/287] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:25 2022] GET /identity/v3/projects/54b0a661962441ba8877bf383738e206 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:25.337954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9b3a1-b61b-4ecd-a3e2-deb45f2db32d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:25.341779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d95d11-9f6b-408e-8f42-6027525d1d7b None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:25.388063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cafde-ac77-45a3-8970-8570b520e905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:25.388798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cafde-ac77-45a3-8970-8570b520e905 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:25.389085 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cafde-ac77-45a3-8970-8570b520e905 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:25.389740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cafde-ac77-45a3-8970-8570b520e905 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:25.418655 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cafde-ac77-45a3-8970-8570b520e905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:25.426628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-9d7cafde-ac77-45a3-8970-8570b520e905 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:25.426628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:25.426628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:25.426628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:25.426628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:25.426628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:25.426628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:25.426628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:25.426628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:25.426628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:25.426628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:25.426628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:25.426628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:25.426628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:25.426628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:25.426628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:25.427675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:25.427675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:25.427675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:25.427675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:25.427675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:25.427675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:25.427675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:25.427675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:25.427675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:25.427675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:25.427675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:25.427675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:25.427675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:25.427675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:25.427675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:25.427675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:25.428630 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:25.428630 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:25.428630 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:25.428630 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:25.428630 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:25.428630 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:25.428630 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:25.428630 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:25.428630 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:25.428630 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:25.428630 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:25.428630 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:25.435281 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 142/288] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:25.446363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cafde-ac77-45a3-8970-8570b520e905 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:25.481505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9b3a1-b61b-4ecd-a3e2-deb45f2db32d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:25.573828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:25.581348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cafde-ac77-45a3-8970-8570b520e905 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:25.599267 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d714f-5236-4db5-861a-8426529f6e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:25.600176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d714f-5236-4db5-861a-8426529f6e9c None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:25.600455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d714f-5236-4db5-861a-8426529f6e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:25.600729 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d714f-5236-4db5-861a-8426529f6e9c None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206/users/3d28a4e3373f40a29d4b12509744707a/roles/89c1404610d74d74bdd3ea913c3de5ba` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:25.607359 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d714f-5236-4db5-861a-8426529f6e9c None admin] RBAC: Authorizing `identity:create_grant(project_id=54b0a661962441ba8877bf383738e206, user_id=3d28a4e3373f40a29d4b12509744707a, role_id=89c1404610d74d74bdd3ea913c3de5ba)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:25.608845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d714f-5236-4db5-861a-8426529f6e9c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:25.622145 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1475eb-8a40-4e30-9d82-3989b0fcc1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:25.622882 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1475eb-8a40-4e30-9d82-3989b0fcc1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:25.623221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1475eb-8a40-4e30-9d82-3989b0fcc1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:25.623594 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1475eb-8a40-4e30-9d82-3989b0fcc1b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:25.624404 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1475eb-8a40-4e30-9d82-3989b0fcc1b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:25.624954 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1475eb-8a40-4e30-9d82-3989b0fcc1b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:25.626519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1475eb-8a40-4e30-9d82-3989b0fcc1b9 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:25.636867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 143/289] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:25.642074 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1475eb-8a40-4e30-9d82-3989b0fcc1b9 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:25.656233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 147/290] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:01:25 2022] PUT /identity/v3/projects/54b0a661962441ba8877bf383738e206/users/3d28a4e3373f40a29d4b12509744707a/roles/89c1404610d74d74bdd3ea913c3de5ba => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:01:25.782857 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1475eb-8a40-4e30-9d82-3989b0fcc1b9 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:25.839699 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a78d9-bf73-497e-b9d8-5431731b8625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:25.840620 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a78d9-bf73-497e-b9d8-5431731b8625 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:25.840907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a78d9-bf73-497e-b9d8-5431731b8625 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:25.841186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a78d9-bf73-497e-b9d8-5431731b8625 None admin] PATH_INFO: `/v3/users/95be81eab03b4ae8bc7cc292f3611b12` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:25.842584 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a78d9-bf73-497e-b9d8-5431731b8625 None admin] RBAC: Authorizing `identity:get_user(user_id=95be81eab03b4ae8bc7cc292f3611b12)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:25.844177 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a78d9-bf73-497e-b9d8-5431731b8625 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:25.846153 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 144/291] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:25 2022] GET /identity/v3/users/95be81eab03b4ae8bc7cc292f3611b12 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:25.851547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d714f-5236-4db5-861a-8426529f6e9c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:25.897798 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:25.972193 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d714f-5236-4db5-861a-8426529f6e9c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:26.013539 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093367b9-392c-47de-92af-1846dcad5b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:26.014235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093367b9-392c-47de-92af-1846dcad5b69 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:26.014524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093367b9-392c-47de-92af-1846dcad5b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:26.014803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093367b9-392c-47de-92af-1846dcad5b69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:26.105538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093367b9-392c-47de-92af-1846dcad5b69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:26.107789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093367b9-392c-47de-92af-1846dcad5b69 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:26.159154 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:26.245801 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 148/292] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:26.251383 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a78d9-bf73-497e-b9d8-5431731b8625 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:26.297436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:26.401414 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a78d9-bf73-497e-b9d8-5431731b8625 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:26.438333 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ad8e3-bf3b-4ffd-afac-3da9d5920317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:26.439131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ad8e3-bf3b-4ffd-afac-3da9d5920317 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:26.439417 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ad8e3-bf3b-4ffd-afac-3da9d5920317 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:26.439697 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ad8e3-bf3b-4ffd-afac-3da9d5920317 None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:26.440935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ad8e3-bf3b-4ffd-afac-3da9d5920317 None admin] RBAC: Authorizing `identity:get_project(project_id=54b0a661962441ba8877bf383738e206)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:26.442431 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ad8e3-bf3b-4ffd-afac-3da9d5920317 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:26.444174 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 145/293] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:26 2022] GET /identity/v3/projects/54b0a661962441ba8877bf383738e206 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:26.450680 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093367b9-392c-47de-92af-1846dcad5b69 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:26.580412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093367b9-392c-47de-92af-1846dcad5b69 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:26.633468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff04dd-169b-4b91-bf36-a7ce5e0cef9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:26.634164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff04dd-169b-4b91-bf36-a7ce5e0cef9f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:26.634498 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff04dd-169b-4b91-bf36-a7ce5e0cef9f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:26.634778 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff04dd-169b-4b91-bf36-a7ce5e0cef9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:26.635621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff04dd-169b-4b91-bf36-a7ce5e0cef9f None admin] RBAC: Adding query filter params (role.id=ae11679806844c6f8d55ce5ccb32ee8b, scope.project.id=54b0a661962441ba8877bf383738e206, user.id=95be81eab03b4ae8bc7cc292f3611b12) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:26.635936 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff04dd-169b-4b91-bf36-a7ce5e0cef9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:26.637385 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff04dd-169b-4b91-bf36-a7ce5e0cef9f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:26.643275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:26.646752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 149/294] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:26 2022] GET /identity/v3/role_assignments?user.id=95be81eab03b4ae8bc7cc292f3611b12&scope.project.id=54b0a661962441ba8877bf383738e206&role.id=ae11679806844c6f8d55ce5ccb32ee8b => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:27.487581 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3758ea-75c0-4a84-a40d-8aac966102e4 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:27.488069 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3758ea-75c0-4a84-a40d-8aac966102e4 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:27.488173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3758ea-75c0-4a84-a40d-8aac966102e4 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:27.489746 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 146/295] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:27.491426 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520577f4-ef22-4f65-822d-1b85d22cd7db None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:27.491805 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520577f4-ef22-4f65-822d-1b85d22cd7db None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:27.491973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520577f4-ef22-4f65-822d-1b85d22cd7db None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:27.493426 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 150/296] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:27.497505 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d180b2d-90eb-461c-a89d-f743f391fc25 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:27.497788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d180b2d-90eb-461c-a89d-f743f391fc25 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:27.498117 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d180b2d-90eb-461c-a89d-f743f391fc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:27.499318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f24271-3256-468a-9c0f-2028c775fd0c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:27.499703 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f24271-3256-468a-9c0f-2028c775fd0c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:27.499983 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f24271-3256-468a-9c0f-2028c775fd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:27.516367 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-7d180b2d-90eb-461c-a89d-f743f391fc25 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:27.517564 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-7d180b2d-90eb-461c-a89d-f743f391fc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:27.521735 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f0f24271-3256-468a-9c0f-2028c775fd0c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:27.522919 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f0f24271-3256-468a-9c0f-2028c775fd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:27.589678 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 151/297] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:27.591026 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852af4a-533e-417c-84a4-27cff5453335 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:27.591313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852af4a-533e-417c-84a4-27cff5453335 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:27.591584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852af4a-533e-417c-84a4-27cff5453335 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:27.593114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 152/298] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:27.594142 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 147/299] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:27.603874 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5132d-0673-4167-8b95-4a3e8405fbd2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:27.604190 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5132d-0673-4167-8b95-4a3e8405fbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:27.607005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5132d-0673-4167-8b95-4a3e8405fbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:27.616744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d180b2d-90eb-461c-a89d-f743f391fc25 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:27.623181 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-80a5132d-0673-4167-8b95-4a3e8405fbd2 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:27.624353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-80a5132d-0673-4167-8b95-4a3e8405fbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:27.643474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:27.698058 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 153/300] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:01:27.703322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5132d-0673-4167-8b95-4a3e8405fbd2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:27.729853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d180b2d-90eb-461c-a89d-f743f391fc25 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:27.769421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:27.770099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0de2a-6806-452d-9e2f-341f21235924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:27.770912 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0de2a-6806-452d-9e2f-341f21235924 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:27.771412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0de2a-6806-452d-9e2f-341f21235924 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:27.771412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0de2a-6806-452d-9e2f-341f21235924 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:27.782556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0de2a-6806-452d-9e2f-341f21235924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:27.790389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-0ea0de2a-6806-452d-9e2f-341f21235924 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:01:27.790389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:27.790389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:27.790389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:27.790389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:27.790389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:27.790389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:27.790389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:27.790389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:27.790389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:27.790389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:27.790389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:27.790389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:27.790389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:27.790389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:27.790389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:27.792110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:27.792110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:27.792110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:27.792110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:27.792110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:27.792110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:27.792110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:27.792110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:27.792110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:27.792110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:27.792110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:27.792110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:27.792110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:27.792110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:27.792110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:27.792110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:27.792867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:27.792867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:27.792867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:27.792867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:27.792867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:27.792867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:27.792867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:27.792867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:27.792867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:27.792867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:27.792867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:01:27.792867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:27.797306 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 148/301] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:01:27.798177 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0de2a-6806-452d-9e2f-341f21235924 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:27.815757 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5132d-0673-4167-8b95-4a3e8405fbd2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:27.850572 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1606d-22be-494d-aa49-dd8b8ab51caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:27.851483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1606d-22be-494d-aa49-dd8b8ab51caa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:27.851764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1606d-22be-494d-aa49-dd8b8ab51caa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:27.852038 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1606d-22be-494d-aa49-dd8b8ab51caa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:27.865899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1606d-22be-494d-aa49-dd8b8ab51caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:27.875986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-62a1606d-22be-494d-aa49-dd8b8ab51caa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:27.875986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:27.875986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:27.875986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:27.875986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:27.875986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:27.875986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:27.875986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:27.875986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:27.875986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:27.875986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:27.875986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:27.875986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:27.875986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:27.875986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:27.875986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:27.876839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:27.876839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:27.876839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:27.876839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:27.876839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:27.876839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:27.876839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:27.876839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:27.876839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:27.876839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:27.876839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:27.876839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:27.876839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:27.876839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:27.876839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:27.876839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:27.877594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:27.877594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:27.877594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:27.877594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:27.877594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:27.877594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:27.877594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:27.877594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:27.877594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:27.877594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:27.877594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:27.877594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:27.878688 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 154/302] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:27.878688 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1606d-22be-494d-aa49-dd8b8ab51caa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:27.888750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:27.909532 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0de2a-6806-452d-9e2f-341f21235924 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:27.950535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f82a11-474f-4def-8ecf-a80487cfe278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:27.951334 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f82a11-474f-4def-8ecf-a80487cfe278 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:27.951617 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f82a11-474f-4def-8ecf-a80487cfe278 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:27.951890 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f82a11-474f-4def-8ecf-a80487cfe278 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:27.953075 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f82a11-474f-4def-8ecf-a80487cfe278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:27.954678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f82a11-474f-4def-8ecf-a80487cfe278 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:27.956346 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 149/303] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:27.957114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f82a11-474f-4def-8ecf-a80487cfe278 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:27.998253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1606d-22be-494d-aa49-dd8b8ab51caa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:28.024033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:28.039238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acbd88-0c3a-4afe-91a0-0390d4c6c4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:28.040084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acbd88-0c3a-4afe-91a0-0390d4c6c4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:28.040314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acbd88-0c3a-4afe-91a0-0390d4c6c4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:28.040615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acbd88-0c3a-4afe-91a0-0390d4c6c4b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:28.041620 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acbd88-0c3a-4afe-91a0-0390d4c6c4b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:28.042215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acbd88-0c3a-4afe-91a0-0390d4c6c4b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:28.043591 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acbd88-0c3a-4afe-91a0-0390d4c6c4b3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:28.052554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 155/304] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:28.053257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acbd88-0c3a-4afe-91a0-0390d4c6c4b3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:28.070431 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f82a11-474f-4def-8ecf-a80487cfe278 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:28.106483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc97b5e-a35f-4130-bb17-37319a7b3ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:28.107436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc97b5e-a35f-4130-bb17-37319a7b3ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:28.107745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc97b5e-a35f-4130-bb17-37319a7b3ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:28.108100 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc97b5e-a35f-4130-bb17-37319a7b3ca8 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:28.108774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc97b5e-a35f-4130-bb17-37319a7b3ca8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:28.109081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc97b5e-a35f-4130-bb17-37319a7b3ca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:28.110478 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc97b5e-a35f-4130-bb17-37319a7b3ca8 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:28.119407 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 150/305] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:28.120200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc97b5e-a35f-4130-bb17-37319a7b3ca8 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:28.136359 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:28.170963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acbd88-0c3a-4afe-91a0-0390d4c6c4b3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:28.203188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d5c48-7db4-423d-97f1-503cdd76220f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:28.203854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d5c48-7db4-423d-97f1-503cdd76220f None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:28.204133 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d5c48-7db4-423d-97f1-503cdd76220f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:28.204414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d5c48-7db4-423d-97f1-503cdd76220f None admin] PATH_INFO: `/v3/groups` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:28.205092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d5c48-7db4-423d-97f1-503cdd76220f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:28.206570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d5c48-7db4-423d-97f1-503cdd76220f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:28.221026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc97b5e-a35f-4130-bb17-37319a7b3ca8 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:28.221595 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 156/306] 10.222.0.48 () {60 vars in 1134 bytes} [Mon Jul 25 12:01:28 2022] POST /identity/v3/groups => generated 229 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:01:28.222467 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d5c48-7db4-423d-97f1-503cdd76220f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:28.272005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:28.277986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723414f-a137-4318-8d15-c82cfaf32707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:28.279230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723414f-a137-4318-8d15-c82cfaf32707 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:28.279540 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723414f-a137-4318-8d15-c82cfaf32707 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:28.279859 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723414f-a137-4318-8d15-c82cfaf32707 None admin] PATH_INFO: `/v3/users/ce4408e3d31c40e79eaa28be58502324` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:28.300131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723414f-a137-4318-8d15-c82cfaf32707 None admin] RBAC: Authorizing `identity:get_user(user_id=ce4408e3d31c40e79eaa28be58502324)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:28.302104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723414f-a137-4318-8d15-c82cfaf32707 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:28.309662 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 151/307] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:28 2022] GET /identity/v3/users/ce4408e3d31c40e79eaa28be58502324 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:28.309662 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6591ab-3fca-44bc-acb1-ae1118c374e9 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:28.309662 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6591ab-3fca-44bc-acb1-ae1118c374e9 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:28.309662 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6591ab-3fca-44bc-acb1-ae1118c374e9 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:28.309662 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 152/308] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:28.314154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6591ab-3fca-44bc-acb1-ae1118c374e9 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:28.339849 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d5c48-7db4-423d-97f1-503cdd76220f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:28.379364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b497c-25e6-48f7-97ba-a1c29a8ba057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:28.380212 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b497c-25e6-48f7-97ba-a1c29a8ba057 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:28.380500 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b497c-25e6-48f7-97ba-a1c29a8ba057 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:28.380774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b497c-25e6-48f7-97ba-a1c29a8ba057 None admin] PATH_INFO: `/v3/users/480779cf1ca443e29a0c5764d0e6cd2a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:28.381975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b497c-25e6-48f7-97ba-a1c29a8ba057 None admin] RBAC: Authorizing `identity:get_user(user_id=480779cf1ca443e29a0c5764d0e6cd2a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:28.383449 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b497c-25e6-48f7-97ba-a1c29a8ba057 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:28.390036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 157/309] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:28 2022] GET /identity/v3/users/480779cf1ca443e29a0c5764d0e6cd2a => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:28.390036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70024-29d5-475d-b4e0-1a6285a7b321 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:28.390036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70024-29d5-475d-b4e0-1a6285a7b321 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:28.390036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70024-29d5-475d-b4e0-1a6285a7b321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:28.399801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:28.407819 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8af70024-29d5-475d-b4e0-1a6285a7b321 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:28.409033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8af70024-29d5-475d-b4e0-1a6285a7b321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:28.435049 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6591ab-3fca-44bc-acb1-ae1118c374e9 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:28.473498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9395e8-e474-4447-abee-5c10af0dcff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:28.474201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9395e8-e474-4447-abee-5c10af0dcff3 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:28.474479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9395e8-e474-4447-abee-5c10af0dcff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:28.474752 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9395e8-e474-4447-abee-5c10af0dcff3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:28.475585 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9395e8-e474-4447-abee-5c10af0dcff3 None admin] RBAC: Adding query filter params (role.id=89c1404610d74d74bdd3ea913c3de5ba, user.id=ce4408e3d31c40e79eaa28be58502324, scope.system=all) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:28.475896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9395e8-e474-4447-abee-5c10af0dcff3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:28.477333 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9395e8-e474-4447-abee-5c10af0dcff3 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:28.482547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 153/310] 10.222.0.48 () {56 vars in 1308 bytes} [Mon Jul 25 12:01:28 2022] GET /identity/v3/role_assignments?user.id=ce4408e3d31c40e79eaa28be58502324&scope.system=all&role.id=89c1404610d74d74bdd3ea913c3de5ba => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:28.483305 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9395e8-e474-4447-abee-5c10af0dcff3 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:28.485807 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 158/311] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:28.511166 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af70024-29d5-475d-b4e0-1a6285a7b321 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:28.561002 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:28.623968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9395e8-e474-4447-abee-5c10af0dcff3 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:28.638213 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af70024-29d5-475d-b4e0-1a6285a7b321 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:28.671196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cd61a-78ac-49a8-90b5-967c4295a48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:28.672065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cd61a-78ac-49a8-90b5-967c4295a48c None admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:28.672343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cd61a-78ac-49a8-90b5-967c4295a48c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:28.672611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cd61a-78ac-49a8-90b5-967c4295a48c None admin] PATH_INFO: `/v3/system/users/480779cf1ca443e29a0c5764d0e6cd2a/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:28.674759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cd61a-78ac-49a8-90b5-967c4295a48c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=480779cf1ca443e29a0c5764d0e6cd2a, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:28.676146 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cd61a-78ac-49a8-90b5-967c4295a48c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:28.677726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:28.690306 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 154/312] 10.222.0.48 () {58 vars in 1334 bytes} [Mon Jul 25 12:01:28 2022] PUT /identity/v3/system/users/480779cf1ca443e29a0c5764d0e6cd2a/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:01:28.692551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47c27f-3065-4b5e-8c5e-facc7797b785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:28.693688 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47c27f-3065-4b5e-8c5e-facc7797b785 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:28.694273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47c27f-3065-4b5e-8c5e-facc7797b785 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:28.694810 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47c27f-3065-4b5e-8c5e-facc7797b785 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:28.708902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47c27f-3065-4b5e-8c5e-facc7797b785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:28.717724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2f47c27f-3065-4b5e-8c5e-facc7797b785 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:01:28.717724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:28.717724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:28.717724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:28.717724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:28.717724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:28.717724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:28.717724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:28.717724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:28.717724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:28.717724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:28.717724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:28.717724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:28.717724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:28.717724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:28.717724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:28.718706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:28.718706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:28.718706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:28.718706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:28.718706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:28.718706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:28.718706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:28.718706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:28.718706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:28.718706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:28.718706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:28.718706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:28.718706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:28.718706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:28.718706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:28.718706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:28.719691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:28.719691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:28.719691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:28.719691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:28.719691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:28.719691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:28.719691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:28.719691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:28.719691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:28.719691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:28.719691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:01:28.719691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:28.719691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 159/313] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:28.725232 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cd61a-78ac-49a8-90b5-967c4295a48c None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:28.848744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cd61a-78ac-49a8-90b5-967c4295a48c None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:28.884848 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53899993-95b0-496d-aae5-d9cbf039abdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:28.885581 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53899993-95b0-496d-aae5-d9cbf039abdb None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:28.885871 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53899993-95b0-496d-aae5-d9cbf039abdb None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:28.886180 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53899993-95b0-496d-aae5-d9cbf039abdb None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:28.886942 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53899993-95b0-496d-aae5-d9cbf039abdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:28.887250 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53899993-95b0-496d-aae5-d9cbf039abdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:28.888635 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53899993-95b0-496d-aae5-d9cbf039abdb None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:28.897862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 155/314] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:28.903517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47c27f-3065-4b5e-8c5e-facc7797b785 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:29.004002 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:29.010710 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47c27f-3065-4b5e-8c5e-facc7797b785 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:29.045959 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ecb39-9d10-418b-830f-21da66f409e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:29.046919 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ecb39-9d10-418b-830f-21da66f409e1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:29.047204 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ecb39-9d10-418b-830f-21da66f409e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:29.047476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ecb39-9d10-418b-830f-21da66f409e1 None admin] PATH_INFO: `/v3/users/3d28a4e3373f40a29d4b12509744707a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:29.048696 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ecb39-9d10-418b-830f-21da66f409e1 None admin] RBAC: Authorizing `identity:get_user(user_id=3d28a4e3373f40a29d4b12509744707a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:29.050178 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ecb39-9d10-418b-830f-21da66f409e1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:29.052132 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 160/315] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:28 2022] GET /identity/v3/users/3d28a4e3373f40a29d4b12509744707a => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:29.058364 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53899993-95b0-496d-aae5-d9cbf039abdb None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:29.121186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:29.164605 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53899993-95b0-496d-aae5-d9cbf039abdb None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:29.200960 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e77c6-fb12-41e2-bfe3-55d0991aaf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:29.201621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e77c6-fb12-41e2-bfe3-55d0991aaf91 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:29.201906 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e77c6-fb12-41e2-bfe3-55d0991aaf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:29.202229 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e77c6-fb12-41e2-bfe3-55d0991aaf91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:29.271868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e77c6-fb12-41e2-bfe3-55d0991aaf91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:29.273343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e77c6-fb12-41e2-bfe3-55d0991aaf91 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:29.332339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:29.375792 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 156/316] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:29.383253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ecb39-9d10-418b-830f-21da66f409e1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:29.495705 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ecb39-9d10-418b-830f-21da66f409e1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:29.531277 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92495410-70a6-4649-9335-ddccec875b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:29.532832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92495410-70a6-4649-9335-ddccec875b9c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:29.533342 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92495410-70a6-4649-9335-ddccec875b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:29.533832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92495410-70a6-4649-9335-ddccec875b9c None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:29.535308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92495410-70a6-4649-9335-ddccec875b9c None admin] RBAC: Authorizing `identity:get_project(project_id=54b0a661962441ba8877bf383738e206)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:29.537069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92495410-70a6-4649-9335-ddccec875b9c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:29.539293 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 161/317] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:29 2022] GET /identity/v3/projects/54b0a661962441ba8877bf383738e206 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:29.546044 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e77c6-fb12-41e2-bfe3-55d0991aaf91 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:29.651901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e77c6-fb12-41e2-bfe3-55d0991aaf91 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:29.686704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd506c1a-8253-497c-8f45-1876fe26098f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:29.687354 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd506c1a-8253-497c-8f45-1876fe26098f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:29.687685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd506c1a-8253-497c-8f45-1876fe26098f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:29.687959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd506c1a-8253-497c-8f45-1876fe26098f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:29.688838 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd506c1a-8253-497c-8f45-1876fe26098f None admin] RBAC: Adding query filter params (role.id=89c1404610d74d74bdd3ea913c3de5ba, scope.project.id=54b0a661962441ba8877bf383738e206, user.id=3d28a4e3373f40a29d4b12509744707a) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:29.689149 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd506c1a-8253-497c-8f45-1876fe26098f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:29.690629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd506c1a-8253-497c-8f45-1876fe26098f None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:29.697501 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 157/318] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:29 2022] GET /identity/v3/role_assignments?user.id=3d28a4e3373f40a29d4b12509744707a&scope.project.id=54b0a661962441ba8877bf383738e206&role.id=89c1404610d74d74bdd3ea913c3de5ba => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:30.352169 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144beacd-1d87-41f4-9a7f-2350e61b1560 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:30.352464 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144beacd-1d87-41f4-9a7f-2350e61b1560 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:30.352745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144beacd-1d87-41f4-9a7f-2350e61b1560 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:30.354741 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 162/319] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:30.359880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5bf45-4472-4960-9e56-62b81f229b03 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:30.360174 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5bf45-4472-4960-9e56-62b81f229b03 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:30.360453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5bf45-4472-4960-9e56-62b81f229b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:30.378872 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-cae5bf45-4472-4960-9e56-62b81f229b03 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:30.380075 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-cae5bf45-4472-4960-9e56-62b81f229b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:30.398559 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:30.452520 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 158/320] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:30.474048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144beacd-1d87-41f4-9a7f-2350e61b1560 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:30.512952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:30.533343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f00c2-2c20-4cc8-95b2-82fe3a2acbc1 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:30.533970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f00c2-2c20-4cc8-95b2-82fe3a2acbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:30.534304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f00c2-2c20-4cc8-95b2-82fe3a2acbc1 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:30.536547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 159/321] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:01:30.541969 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deae69-6a6e-423d-aded-c9c2c9419855 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:30.542284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deae69-6a6e-423d-aded-c9c2c9419855 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:30.542564 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deae69-6a6e-423d-aded-c9c2c9419855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:30.560564 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-59deae69-6a6e-423d-aded-c9c2c9419855 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:30.561746 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-59deae69-6a6e-423d-aded-c9c2c9419855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:30.583261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144beacd-1d87-41f4-9a7f-2350e61b1560 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:30.619787 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b10632-db65-4951-b0df-82b1dd718553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:30.620510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b10632-db65-4951-b0df-82b1dd718553 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:30.620789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b10632-db65-4951-b0df-82b1dd718553 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:30.621069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b10632-db65-4951-b0df-82b1dd718553 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:30.622272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b10632-db65-4951-b0df-82b1dd718553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:30.623721 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b10632-db65-4951-b0df-82b1dd718553 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:30.625344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 163/322] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:30.630722 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b10632-db65-4951-b0df-82b1dd718553 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:30.635806 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 160/323] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:01:30.657620 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deae69-6a6e-423d-aded-c9c2c9419855 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:30.732404 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b10632-db65-4951-b0df-82b1dd718553 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:30.734688 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:30.751039 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:30.766512 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deae69-6a6e-423d-aded-c9c2c9419855 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:30.767142 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17988471-dae4-4029-af79-abdf831e0253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:30.767912 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17988471-dae4-4029-af79-abdf831e0253 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:30.768080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17988471-dae4-4029-af79-abdf831e0253 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:30.768351 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17988471-dae4-4029-af79-abdf831e0253 None admin] PATH_INFO: `/v3/groups` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:30.769039 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17988471-dae4-4029-af79-abdf831e0253 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:30.770494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17988471-dae4-4029-af79-abdf831e0253 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:30.785125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 164/324] 10.222.0.48 () {60 vars in 1134 bytes} [Mon Jul 25 12:01:30 2022] POST /identity/v3/groups => generated 226 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:01:30.786535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823c188-0df6-4bb6-bd3d-300b29ee27ca None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:30.786821 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823c188-0df6-4bb6-bd3d-300b29ee27ca None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:30.787093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823c188-0df6-4bb6-bd3d-300b29ee27ca None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:30.788340 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 165/325] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:30.794884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16298994-f419-43f0-a9f6-86d2c8cfcaf3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:30.795223 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16298994-f419-43f0-a9f6-86d2c8cfcaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:30.795500 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16298994-f419-43f0-a9f6-86d2c8cfcaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:30.811921 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607866aa-c1c1-451a-a6af-6e3c41b4bbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:30.812747 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607866aa-c1c1-451a-a6af-6e3c41b4bbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:30.813027 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607866aa-c1c1-451a-a6af-6e3c41b4bbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:30.813297 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607866aa-c1c1-451a-a6af-6e3c41b4bbf0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:30.815045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-16298994-f419-43f0-a9f6-86d2c8cfcaf3 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:30.816281 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-16298994-f419-43f0-a9f6-86d2c8cfcaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:30.825630 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607866aa-c1c1-451a-a6af-6e3c41b4bbf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:30.833744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-607866aa-c1c1-451a-a6af-6e3c41b4bbf0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:01:30.833744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:30.833744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:30.833744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:30.833744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:30.833744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:30.833744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:30.833744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:30.833744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:30.833744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:30.833744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:30.833744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:30.833744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:30.833744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:30.833744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:30.833744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:30.834753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:30.834753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:30.834753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:30.834753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:30.834753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:30.834753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:30.834753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:30.834753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:30.834753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:30.834753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:30.834753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:30.834753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:30.834753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:30.834753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:30.834753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:30.834753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:30.835524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:30.835524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:30.835524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:30.835524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:30.835524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:30.835524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:30.835524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:30.835524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:30.835524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:30.835524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:30.835524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:01:30.835524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:30.835524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 161/326] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:01:30.841830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607866aa-c1c1-451a-a6af-6e3c41b4bbf0 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:30.906301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 166/327] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:30.922806 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16298994-f419-43f0-a9f6-86d2c8cfcaf3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:30.956838 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607866aa-c1c1-451a-a6af-6e3c41b4bbf0 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:30.995148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0cfc2-bf2f-4a6f-90ba-0b7ec615beef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:30.995829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0cfc2-bf2f-4a6f-90ba-0b7ec615beef None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:30.996116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0cfc2-bf2f-4a6f-90ba-0b7ec615beef None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:30.996391 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0cfc2-bf2f-4a6f-90ba-0b7ec615beef None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:30.997153 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0cfc2-bf2f-4a6f-90ba-0b7ec615beef None admin] RBAC: Adding query filter params (name=reader) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:30.997465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0cfc2-bf2f-4a6f-90ba-0b7ec615beef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:30.998880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0cfc2-bf2f-4a6f-90ba-0b7ec615beef None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:31.008957 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 162/328] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:31.014431 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0cfc2-bf2f-4a6f-90ba-0b7ec615beef None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:31.030043 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:31.030466 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:31.040012 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16298994-f419-43f0-a9f6-86d2c8cfcaf3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:31.087575 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99003c61-dc1a-461c-b253-a46a903391ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:31.088875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99003c61-dc1a-461c-b253-a46a903391ed None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:31.089155 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99003c61-dc1a-461c-b253-a46a903391ed None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:31.089426 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99003c61-dc1a-461c-b253-a46a903391ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:31.105782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99003c61-dc1a-461c-b253-a46a903391ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:31.114159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-99003c61-dc1a-461c-b253-a46a903391ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:31.114159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:31.114159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:31.114159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:31.114159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:31.114159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:31.114159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:31.114159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:31.114159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:31.114159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:31.114159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:31.114159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:31.114159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:31.114159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:31.114159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:31.114159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:31.115035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:31.115035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:31.115035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:31.115035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:31.115035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:31.115035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:31.115035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:31.115035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:31.115035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:31.115035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:31.115035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:31.115035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:31.115035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:31.115035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:31.115035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:31.115035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:31.115828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:31.115828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:31.115828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:31.115828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:31.115828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:31.115828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:31.115828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:31.115828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:31.115828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:31.115828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:31.115828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:31.115828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:31.115828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 167/329] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:01:31.121150 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99003c61-dc1a-461c-b253-a46a903391ed None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:31.143438 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0cfc2-bf2f-4a6f-90ba-0b7ec615beef None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:31.183925 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad796517-ed9c-477c-af87-97d7159fd424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:31.184734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad796517-ed9c-477c-af87-97d7159fd424 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:31.185015 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad796517-ed9c-477c-af87-97d7159fd424 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:31.185287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad796517-ed9c-477c-af87-97d7159fd424 None admin] PATH_INFO: `/v3/users/ce4408e3d31c40e79eaa28be58502324` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:31.186547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad796517-ed9c-477c-af87-97d7159fd424 None admin] RBAC: Authorizing `identity:get_user(user_id=ce4408e3d31c40e79eaa28be58502324)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:31.188027 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad796517-ed9c-477c-af87-97d7159fd424 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:31.189862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 163/330] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:31 2022] GET /identity/v3/users/ce4408e3d31c40e79eaa28be58502324 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:31.195157 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad796517-ed9c-477c-af87-97d7159fd424 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:31.246685 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99003c61-dc1a-461c-b253-a46a903391ed None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:31.287712 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970eccc-5cfd-478c-80b4-5b2e1d7c22a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:31.288914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970eccc-5cfd-478c-80b4-5b2e1d7c22a0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:31.289430 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970eccc-5cfd-478c-80b4-5b2e1d7c22a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:31.290885 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970eccc-5cfd-478c-80b4-5b2e1d7c22a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:31.292125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970eccc-5cfd-478c-80b4-5b2e1d7c22a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:31.292657 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970eccc-5cfd-478c-80b4-5b2e1d7c22a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:31.294379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970eccc-5cfd-478c-80b4-5b2e1d7c22a0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:31.297337 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:31.308936 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 168/331] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:31.314460 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970eccc-5cfd-478c-80b4-5b2e1d7c22a0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:31.332851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad796517-ed9c-477c-af87-97d7159fd424 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:31.337063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:31.371151 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13275d-332d-400b-8eed-8d610f6ad6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:31.372464 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13275d-332d-400b-8eed-8d610f6ad6a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:31.372971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13275d-332d-400b-8eed-8d610f6ad6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:31.373450 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13275d-332d-400b-8eed-8d610f6ad6a2 None admin] PATH_INFO: `/v3/system/users/ce4408e3d31c40e79eaa28be58502324/roles/89c1404610d74d74bdd3ea913c3de5ba` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:31.375203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13275d-332d-400b-8eed-8d610f6ad6a2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ce4408e3d31c40e79eaa28be58502324, role_id=89c1404610d74d74bdd3ea913c3de5ba)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:31.376849 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13275d-332d-400b-8eed-8d610f6ad6a2 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:31.387579 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 164/332] 10.222.0.48 () {58 vars in 1334 bytes} [Mon Jul 25 12:01:31 2022] PUT /identity/v3/system/users/ce4408e3d31c40e79eaa28be58502324/roles/89c1404610d74d74bdd3ea913c3de5ba => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:01:31.456964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970eccc-5cfd-478c-80b4-5b2e1d7c22a0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:31.502841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb607ac0-e3a0-4936-b82a-b0f5719f69c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:31.504542 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb607ac0-e3a0-4936-b82a-b0f5719f69c9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:31.505066 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb607ac0-e3a0-4936-b82a-b0f5719f69c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:31.505579 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb607ac0-e3a0-4936-b82a-b0f5719f69c9 None admin] PATH_INFO: `/v3/users/480779cf1ca443e29a0c5764d0e6cd2a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:31.509034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb607ac0-e3a0-4936-b82a-b0f5719f69c9 None admin] RBAC: Authorizing `identity:get_user(user_id=480779cf1ca443e29a0c5764d0e6cd2a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:31.512129 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb607ac0-e3a0-4936-b82a-b0f5719f69c9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:31.514467 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 169/333] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:31 2022] GET /identity/v3/users/480779cf1ca443e29a0c5764d0e6cd2a => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:31.520285 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13275d-332d-400b-8eed-8d610f6ad6a2 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:31.646945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13275d-332d-400b-8eed-8d610f6ad6a2 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:31.683795 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356138e-50d7-4c82-a5ae-1034a11fb823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:31.684556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356138e-50d7-4c82-a5ae-1034a11fb823 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:31.684723 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356138e-50d7-4c82-a5ae-1034a11fb823 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:31.684981 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356138e-50d7-4c82-a5ae-1034a11fb823 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:31.685831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356138e-50d7-4c82-a5ae-1034a11fb823 None admin] RBAC: Adding query filter params (role.id=ae11679806844c6f8d55ce5ccb32ee8b, user.id=480779cf1ca443e29a0c5764d0e6cd2a, scope.system=all) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:31.686174 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356138e-50d7-4c82-a5ae-1034a11fb823 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:31.687611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356138e-50d7-4c82-a5ae-1034a11fb823 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:31.693014 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:31.703780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 165/334] 10.222.0.48 () {56 vars in 1308 bytes} [Mon Jul 25 12:01:31 2022] GET /identity/v3/role_assignments?user.id=480779cf1ca443e29a0c5764d0e6cd2a&scope.system=all&role.id=ae11679806844c6f8d55ce5ccb32ee8b => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:33.277203 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a3406-e904-4fea-8b13-df2e8c101ff2 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:33.277704 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a3406-e904-4fea-8b13-df2e8c101ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:33.277778 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a3406-e904-4fea-8b13-df2e8c101ff2 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:33.279174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 170/335] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:33.284922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dd568-408f-4c7b-a618-96d1f1150e2a None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:33.285330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dd568-408f-4c7b-a618-96d1f1150e2a None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:33.285499 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dd568-408f-4c7b-a618-96d1f1150e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:33.304068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-125dd568-408f-4c7b-a618-96d1f1150e2a None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:33.305449 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-125dd568-408f-4c7b-a618-96d1f1150e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:33.327870 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c625c-6890-4091-aa1c-5ed6da0abfe3 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:33.328173 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c625c-6890-4091-aa1c-5ed6da0abfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:33.328420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c625c-6890-4091-aa1c-5ed6da0abfe3 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:33.329804 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 171/336] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:01:33.335276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9d816-c026-4775-998f-c07558e85869 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:33.335565 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9d816-c026-4775-998f-c07558e85869 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:33.335850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9d816-c026-4775-998f-c07558e85869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:33.375051 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9dc9d816-c026-4775-998f-c07558e85869 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:33.376269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9dc9d816-c026-4775-998f-c07558e85869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:33.391797 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 166/337] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:33.435209 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dd568-408f-4c7b-a618-96d1f1150e2a None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:33.487677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 172/338] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:33.530512 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9d816-c026-4775-998f-c07558e85869 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:33.566384 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:33.584459 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dd568-408f-4c7b-a618-96d1f1150e2a None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:33.631714 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:33.646713 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e1fa7-2cf8-4bd3-ac4c-e4f6cad97656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:33.647560 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e1fa7-2cf8-4bd3-ac4c-e4f6cad97656 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:33.647848 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e1fa7-2cf8-4bd3-ac4c-e4f6cad97656 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:33.648129 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e1fa7-2cf8-4bd3-ac4c-e4f6cad97656 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:33.664704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e1fa7-2cf8-4bd3-ac4c-e4f6cad97656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:33.673770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-497e1fa7-2cf8-4bd3-ac4c-e4f6cad97656 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:33.673770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:33.673770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:33.673770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:33.673770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:33.673770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:33.673770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:33.673770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:33.673770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:33.673770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:33.673770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:33.673770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:33.673770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:33.673770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:33.673770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:33.673770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:33.674678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:33.674678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:33.674678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:33.674678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:33.674678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:33.674678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:33.674678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:33.674678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:33.674678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:33.674678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:33.674678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:33.674678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:33.674678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:33.674678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:33.674678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:33.674678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:33.675442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:33.675442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:33.675442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:33.675442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:33.675442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:33.675442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:33.675442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:33.675442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:33.675442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:33.675442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:33.675442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:33.675442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:33.679423 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 167/339] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:01:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:33.685631 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e1fa7-2cf8-4bd3-ac4c-e4f6cad97656 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:33.706515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9d816-c026-4775-998f-c07558e85869 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:33.787373 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3a60c-ae0a-497f-bb68-04e3f0424491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:33.788538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3a60c-ae0a-497f-bb68-04e3f0424491 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:33.789042 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3a60c-ae0a-497f-bb68-04e3f0424491 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:33.789513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3a60c-ae0a-497f-bb68-04e3f0424491 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:33.816063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3a60c-ae0a-497f-bb68-04e3f0424491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:33.825775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5cf3a60c-ae0a-497f-bb68-04e3f0424491 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:33.825775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:33.825775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:33.825775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:33.825775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:33.825775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:33.825775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:33.825775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:33.825775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:33.825775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:33.825775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:33.825775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:33.825775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:33.825775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:33.825775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:33.825775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:33.826706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:33.826706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:33.826706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:33.826706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:33.826706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:33.826706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:33.826706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:33.826706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:33.826706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:33.826706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:33.826706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:33.826706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:33.826706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:33.826706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:33.826706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:33.826706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:33.827476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:33.827476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:33.827476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:33.827476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:33.827476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:33.827476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:33.827476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:33.827476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:33.827476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:33.827476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:33.827476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:33.827476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:33.835825 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 173/340] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:33.843292 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3a60c-ae0a-497f-bb68-04e3f0424491 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:33.884873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e1fa7-2cf8-4bd3-ac4c-e4f6cad97656 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:33.958572 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:33.980791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf6eaa-50d1-4a40-9d20-18b45aa095bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:33.981834 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf6eaa-50d1-4a40-9d20-18b45aa095bd None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:33.982348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf6eaa-50d1-4a40-9d20-18b45aa095bd None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:33.982830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf6eaa-50d1-4a40-9d20-18b45aa095bd None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:33.983822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf6eaa-50d1-4a40-9d20-18b45aa095bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:33.984329 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf6eaa-50d1-4a40-9d20-18b45aa095bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:33.985922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf6eaa-50d1-4a40-9d20-18b45aa095bd None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:33.994034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3a60c-ae0a-497f-bb68-04e3f0424491 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:34.005019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 168/341] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:01:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:34.006722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d625a-87cc-45c9-a13e-97a7f6b83673 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:34.007220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d625a-87cc-45c9-a13e-97a7f6b83673 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:34.007700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d625a-87cc-45c9-a13e-97a7f6b83673 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:34.009147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 169/342] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:34.014868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d625a-87cc-45c9-a13e-97a7f6b83673 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:34.028628 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78c04c-c38d-433e-a0b5-f8c396b5aeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:34.029302 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78c04c-c38d-433e-a0b5-f8c396b5aeed None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:34.029581 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78c04c-c38d-433e-a0b5-f8c396b5aeed None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:34.029853 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78c04c-c38d-433e-a0b5-f8c396b5aeed None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:34.038102 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78c04c-c38d-433e-a0b5-f8c396b5aeed None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:34.038102 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78c04c-c38d-433e-a0b5-f8c396b5aeed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:34.038102 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78c04c-c38d-433e-a0b5-f8c396b5aeed None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:34.046554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 174/343] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:34.047902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c741a4-177d-46c7-bb96-f3e1540002db None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:34.048189 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c741a4-177d-46c7-bb96-f3e1540002db None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:34.048463 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c741a4-177d-46c7-bb96-f3e1540002db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:34.068880 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-00c741a4-177d-46c7-bb96-f3e1540002db None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:34.070092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-00c741a4-177d-46c7-bb96-f3e1540002db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:34.121793 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:34.143699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 175/344] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:34.144637 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c741a4-177d-46c7-bb96-f3e1540002db None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:34.218458 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:34.255371 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c741a4-177d-46c7-bb96-f3e1540002db None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:34.257306 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d625a-87cc-45c9-a13e-97a7f6b83673 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:34.293505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f27c9-3d89-449d-8021-8d2fa0e9b9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:34.294161 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f27c9-3d89-449d-8021-8d2fa0e9b9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:34.294377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f27c9-3d89-449d-8021-8d2fa0e9b9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:34.294648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f27c9-3d89-449d-8021-8d2fa0e9b9e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:34.329107 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ccec9-ade9-4411-915a-11369909cc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:34.331113 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ccec9-ade9-4411-915a-11369909cc5d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:34.331400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ccec9-ade9-4411-915a-11369909cc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:34.331672 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ccec9-ade9-4411-915a-11369909cc5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:34.430719 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f27c9-3d89-449d-8021-8d2fa0e9b9e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:34.434669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f27c9-3d89-449d-8021-8d2fa0e9b9e9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:34.466219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ccec9-ade9-4411-915a-11369909cc5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:34.469560 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ccec9-ade9-4411-915a-11369909cc5d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:34.550445 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:34.578703 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:34.605518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 170/345] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:34.606703 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ccec9-ade9-4411-915a-11369909cc5d None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:34.626130 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 176/346] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:34.627779 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779e15b-7f34-4812-a5b8-037ed7d5f733 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:34.628218 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779e15b-7f34-4812-a5b8-037ed7d5f733 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:34.628640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779e15b-7f34-4812-a5b8-037ed7d5f733 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:34.630102 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 177/347] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:34.630926 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779e15b-7f34-4812-a5b8-037ed7d5f733 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:34.745870 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ccec9-ade9-4411-915a-11369909cc5d None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:34.761716 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779e15b-7f34-4812-a5b8-037ed7d5f733 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:34.786091 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57510209-b6ff-4348-a973-87d69ca5c0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:34.787126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57510209-b6ff-4348-a973-87d69ca5c0da None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:34.787557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57510209-b6ff-4348-a973-87d69ca5c0da None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:34.787998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57510209-b6ff-4348-a973-87d69ca5c0da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:34.799147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57510209-b6ff-4348-a973-87d69ca5c0da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:34.804530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1afd0a-8eaf-454e-a16b-4605cc9093dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:34.805409 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1afd0a-8eaf-454e-a16b-4605cc9093dc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:34.805694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1afd0a-8eaf-454e-a16b-4605cc9093dc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:34.805966 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1afd0a-8eaf-454e-a16b-4605cc9093dc None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:34.807749 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1afd0a-8eaf-454e-a16b-4605cc9093dc None admin] RBAC: Authorizing `identity:get_project(project_id=ace9baa6f68746d49a7c11b95f550e58)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:34.809279 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1afd0a-8eaf-454e-a16b-4605cc9093dc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:34.811205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 178/348] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:34 2022] GET /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:34.811686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-57510209-b6ff-4348-a973-87d69ca5c0da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:01:34.811686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:34.811686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:34.811686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:34.811686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:34.811686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:34.811686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:34.811686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:34.811686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:34.811686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:34.811686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:34.811686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:34.811686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:34.811686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:34.811686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:34.811686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:34.812876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:34.812876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:34.812876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:34.812876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:34.812876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:34.812876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:34.812876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:34.812876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:34.812876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:34.812876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:34.812876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:34.812876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:34.812876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:34.812876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:34.812876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:34.812876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:34.813909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:34.813909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:34.813909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:34.813909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:34.813909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:34.813909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:34.813909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:34.813909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:34.813909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:34.813909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:34.813909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:01:34.813909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:34.813909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 171/349] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:34.813909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57510209-b6ff-4348-a973-87d69ca5c0da None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:34.815867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a715bd2-1258-4df6-ae7a-786a2678a499 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:34.816277 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a715bd2-1258-4df6-ae7a-786a2678a499 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:34.817743 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a715bd2-1258-4df6-ae7a-786a2678a499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:34.831952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:34.842686 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7a715bd2-1258-4df6-ae7a-786a2678a499 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:34.844094 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7a715bd2-1258-4df6-ae7a-786a2678a499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:34.880022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:34.933435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 179/350] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:34.934664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a715bd2-1258-4df6-ae7a-786a2678a499 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:34.939700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57510209-b6ff-4348-a973-87d69ca5c0da None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:34.975899 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37d63d-7bf2-464a-b56b-72be562fe397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:34.976771 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37d63d-7bf2-464a-b56b-72be562fe397 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:34.977053 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37d63d-7bf2-464a-b56b-72be562fe397 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:34.977328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37d63d-7bf2-464a-b56b-72be562fe397 None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:34.979109 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37d63d-7bf2-464a-b56b-72be562fe397 None admin] RBAC: Authorizing `identity:get_project(project_id=ace9baa6f68746d49a7c11b95f550e58)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:34.980567 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37d63d-7bf2-464a-b56b-72be562fe397 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:34.986023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 172/351] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:34 2022] GET /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:34.986023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37d63d-7bf2-464a-b56b-72be562fe397 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:35.050253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a715bd2-1258-4df6-ae7a-786a2678a499 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:35.069785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:35.095132 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90232543-3d7d-49c6-9e37-a37887d2b671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:35.095817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90232543-3d7d-49c6-9e37-a37887d2b671 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:35.096097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90232543-3d7d-49c6-9e37-a37887d2b671 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:35.096368 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90232543-3d7d-49c6-9e37-a37887d2b671 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:35.097122 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90232543-3d7d-49c6-9e37-a37887d2b671 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:35.097431 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90232543-3d7d-49c6-9e37-a37887d2b671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:35.098837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90232543-3d7d-49c6-9e37-a37887d2b671 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:35.099827 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37d63d-7bf2-464a-b56b-72be562fe397 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:35.110963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 180/352] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:35.112655 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90232543-3d7d-49c6-9e37-a37887d2b671 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:35.144995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05da47e-42ff-4aa8-9fc5-3ac4ffac67eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:35.144995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05da47e-42ff-4aa8-9fc5-3ac4ffac67eb None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:35.144995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05da47e-42ff-4aa8-9fc5-3ac4ffac67eb None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:35.144995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05da47e-42ff-4aa8-9fc5-3ac4ffac67eb None admin] PATH_INFO: `/v3/groups/358ad776e6bd4b4aa89eedce06cf830a` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:35.149833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:35.154040 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05da47e-42ff-4aa8-9fc5-3ac4ffac67eb None admin] RBAC: Authorizing `identity:get_group(group_id=358ad776e6bd4b4aa89eedce06cf830a)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:35.155632 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05da47e-42ff-4aa8-9fc5-3ac4ffac67eb None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:35.157810 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 173/353] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 12:01:34 2022] GET /identity/v3/groups/358ad776e6bd4b4aa89eedce06cf830a => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:35.158618 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05da47e-42ff-4aa8-9fc5-3ac4ffac67eb None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:35.246122 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90232543-3d7d-49c6-9e37-a37887d2b671 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:35.289038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05da47e-42ff-4aa8-9fc5-3ac4ffac67eb None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:35.295480 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6cec6-7421-4d6b-b6e7-2be39692da4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:35.296865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6cec6-7421-4d6b-b6e7-2be39692da4e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:35.297147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6cec6-7421-4d6b-b6e7-2be39692da4e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:35.297420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6cec6-7421-4d6b-b6e7-2be39692da4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:35.310047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6cec6-7421-4d6b-b6e7-2be39692da4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:35.317930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-caa6cec6-7421-4d6b-b6e7-2be39692da4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:35.317930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:35.317930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:35.317930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:35.317930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:35.317930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:35.317930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:35.317930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:35.317930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:35.317930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:35.317930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:35.317930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:35.317930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:35.317930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:35.317930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:35.317930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:35.319001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:35.319001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:35.319001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:35.319001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:35.319001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:35.319001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:35.319001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:35.319001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:35.319001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:35.319001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:35.319001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:35.319001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:35.319001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:35.319001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:35.319001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:35.319001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:35.320054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:35.320054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:35.320054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:35.320054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:35.320054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:35.320054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:35.320054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:35.320054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:35.320054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:35.320054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:35.320054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:35.320054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:35.320054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 181/354] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:35.320922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c88b57-d617-4cb6-bd4c-c7d8f85c0ff0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:35.320922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c88b57-d617-4cb6-bd4c-c7d8f85c0ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:35.321102 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c88b57-d617-4cb6-bd4c-c7d8f85c0ff0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:35.322703 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 182/355] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:35.323396 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c88b57-d617-4cb6-bd4c-c7d8f85c0ff0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:35.335601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169233d-657d-4d03-b034-60fe7e6041b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:35.338355 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169233d-657d-4d03-b034-60fe7e6041b1 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:35.338884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169233d-657d-4d03-b034-60fe7e6041b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:35.339354 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169233d-657d-4d03-b034-60fe7e6041b1 None admin] PATH_INFO: `/v3/groups/358ad776e6bd4b4aa89eedce06cf830a` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:35.340718 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169233d-657d-4d03-b034-60fe7e6041b1 None admin] RBAC: Authorizing `identity:get_group(group_id=358ad776e6bd4b4aa89eedce06cf830a)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:35.342195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169233d-657d-4d03-b034-60fe7e6041b1 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:35.344150 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 174/356] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 12:01:35 2022] GET /identity/v3/groups/358ad776e6bd4b4aa89eedce06cf830a => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:35.345075 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169233d-657d-4d03-b034-60fe7e6041b1 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:35.359195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:35.455511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:35.478973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c88b57-d617-4cb6-bd4c-c7d8f85c0ff0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:35.483954 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169233d-657d-4d03-b034-60fe7e6041b1 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:35.521261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafc5c0-3574-481e-83d0-74087144801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:35.522195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafc5c0-3574-481e-83d0-74087144801e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:35.522478 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafc5c0-3574-481e-83d0-74087144801e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:35.522749 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafc5c0-3574-481e-83d0-74087144801e None admin] PATH_INFO: `/v3/users/ce4408e3d31c40e79eaa28be58502324` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:35.524138 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafc5c0-3574-481e-83d0-74087144801e None admin] RBAC: Authorizing `identity:get_user(user_id=ce4408e3d31c40e79eaa28be58502324)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:35.525885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762c8fe-d32a-4252-b654-499582e0b5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:35.526154 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafc5c0-3574-481e-83d0-74087144801e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:35.526947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762c8fe-d32a-4252-b654-499582e0b5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:35.527436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762c8fe-d32a-4252-b654-499582e0b5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:35.527775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 183/357] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:01:35 2022] GET /identity/v3/users/ce4408e3d31c40e79eaa28be58502324 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:35.527972 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762c8fe-d32a-4252-b654-499582e0b5b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:35.528908 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762c8fe-d32a-4252-b654-499582e0b5b3 None admin] RBAC: Adding query filter params (group.id=358ad776e6bd4b4aa89eedce06cf830a, role.id=639e5e5307f34a64a854cfb59086518e, scope.project.id=ace9baa6f68746d49a7c11b95f550e58) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:35.529076 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafc5c0-3574-481e-83d0-74087144801e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:35.529226 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762c8fe-d32a-4252-b654-499582e0b5b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:35.531710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762c8fe-d32a-4252-b654-499582e0b5b3 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:35.537959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 175/358] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 12:01:35 2022] GET /identity/v3/role_assignments?group.id=358ad776e6bd4b4aa89eedce06cf830a&scope.project.id=ace9baa6f68746d49a7c11b95f550e58&role.id=639e5e5307f34a64a854cfb59086518e => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:35.539484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706f89b-235b-43c1-ab3a-7f23e73863e1 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:35.539953 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706f89b-235b-43c1-ab3a-7f23e73863e1 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:35.540451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706f89b-235b-43c1-ab3a-7f23e73863e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:35.563301 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-7706f89b-235b-43c1-ab3a-7f23e73863e1 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:35.564939 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-7706f89b-235b-43c1-ab3a-7f23e73863e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:35.643946 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 176/359] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:35.645317 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706f89b-235b-43c1-ab3a-7f23e73863e1 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:35.648330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:35.684244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafc5c0-3574-481e-83d0-74087144801e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:35.728004 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f0c05-2c16-4d8c-84eb-fcb503573419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:35.729018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f0c05-2c16-4d8c-84eb-fcb503573419 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:35.729429 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f0c05-2c16-4d8c-84eb-fcb503573419 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:35.729824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f0c05-2c16-4d8c-84eb-fcb503573419 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:35.730738 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f0c05-2c16-4d8c-84eb-fcb503573419 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:35.731277 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f0c05-2c16-4d8c-84eb-fcb503573419 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:35.732795 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f0c05-2c16-4d8c-84eb-fcb503573419 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:35.743864 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 184/360] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:35.745254 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f0c05-2c16-4d8c-84eb-fcb503573419 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:35.764862 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:35.783149 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706f89b-235b-43c1-ab3a-7f23e73863e1 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:35.825726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1973c6-b957-4dbd-a17b-9b9b95ff3503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:35.826371 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1973c6-b957-4dbd-a17b-9b9b95ff3503 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:35.826655 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1973c6-b957-4dbd-a17b-9b9b95ff3503 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:35.826932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1973c6-b957-4dbd-a17b-9b9b95ff3503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:35.828035 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1973c6-b957-4dbd-a17b-9b9b95ff3503 None admin] RBAC: Adding query filter params (group.id=358ad776e6bd4b4aa89eedce06cf830a, role.id=ae11679806844c6f8d55ce5ccb32ee8b, scope.project.id=ace9baa6f68746d49a7c11b95f550e58) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:35.828151 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1973c6-b957-4dbd-a17b-9b9b95ff3503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:35.829739 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1973c6-b957-4dbd-a17b-9b9b95ff3503 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:35.836676 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 177/361] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 12:01:35 2022] GET /identity/v3/role_assignments?group.id=358ad776e6bd4b4aa89eedce06cf830a&scope.project.id=ace9baa6f68746d49a7c11b95f550e58&role.id=ae11679806844c6f8d55ce5ccb32ee8b => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:35.837601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1973c6-b957-4dbd-a17b-9b9b95ff3503 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:35.874996 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f0c05-2c16-4d8c-84eb-fcb503573419 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:35.920922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:35.923512 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce84a6-a286-44de-a41b-8fdb64800be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:35.924206 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce84a6-a286-44de-a41b-8fdb64800be0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:35.924815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce84a6-a286-44de-a41b-8fdb64800be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:35.925099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce84a6-a286-44de-a41b-8fdb64800be0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:35.926116 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce84a6-a286-44de-a41b-8fdb64800be0 None admin] RBAC: Adding query filter params (role.id=89c1404610d74d74bdd3ea913c3de5ba, user.id=ce4408e3d31c40e79eaa28be58502324, scope.system=all) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:35.926827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce84a6-a286-44de-a41b-8fdb64800be0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:35.930070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce84a6-a286-44de-a41b-8fdb64800be0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:35.949208 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 185/362] 10.222.0.48 () {56 vars in 1308 bytes} [Mon Jul 25 12:01:35 2022] GET /identity/v3/role_assignments?user.id=ce4408e3d31c40e79eaa28be58502324&scope.system=all&role.id=89c1404610d74d74bdd3ea913c3de5ba => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:35.954885 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e40cb-7bc6-432c-967d-0e3892bfcd83 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:35.955220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e40cb-7bc6-432c-967d-0e3892bfcd83 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:35.956846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e40cb-7bc6-432c-967d-0e3892bfcd83 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:35.960459 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 186/363] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:35.961374 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e40cb-7bc6-432c-967d-0e3892bfcd83 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:35.984345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1973c6-b957-4dbd-a17b-9b9b95ff3503 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:36.048690 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e697960-1948-4910-8c56-7d4fe9a47dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:36.049594 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e697960-1948-4910-8c56-7d4fe9a47dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:36.049883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e697960-1948-4910-8c56-7d4fe9a47dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:36.050185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e697960-1948-4910-8c56-7d4fe9a47dd7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:36.071424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e697960-1948-4910-8c56-7d4fe9a47dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:36.081945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-7e697960-1948-4910-8c56-7d4fe9a47dd7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:36.081945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:36.081945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:36.081945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:36.081945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:36.081945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:36.081945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:36.081945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:36.081945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:36.081945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:36.081945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:36.081945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:36.081945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:36.081945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:36.081945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:36.081945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:36.082955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:36.082955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:36.082955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:36.082955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:36.082955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:36.082955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:36.082955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:36.082955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:36.082955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:36.082955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:36.082955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:36.082955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:36.082955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:36.082955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:36.082955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:36.082955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:36.083765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:36.083765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:36.083765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:36.083765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:36.083765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:36.083765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:36.083765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:36.083765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:36.083765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:36.083765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:36.083765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:36.083765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:36.085054 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 178/364] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:01:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:36.085260 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e53c50-4d2f-4318-b929-0b92bc886b11 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:36.085500 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e53c50-4d2f-4318-b929-0b92bc886b11 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:36.085732 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e53c50-4d2f-4318-b929-0b92bc886b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:36.109013 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-42e53c50-4d2f-4318-b929-0b92bc886b11 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:36.111223 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-42e53c50-4d2f-4318-b929-0b92bc886b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:36.115945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:36.153133 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e40cb-7bc6-432c-967d-0e3892bfcd83 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:36.194338 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd088750-f559-4e7e-84a9-3f468cd6c3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:36.194924 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd088750-f559-4e7e-84a9-3f468cd6c3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:36.195207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd088750-f559-4e7e-84a9-3f468cd6c3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:36.195486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd088750-f559-4e7e-84a9-3f468cd6c3d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:36.206097 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 179/365] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:36.207224 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e53c50-4d2f-4318-b929-0b92bc886b11 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:36.270969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd088750-f559-4e7e-84a9-3f468cd6c3d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:36.276393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd088750-f559-4e7e-84a9-3f468cd6c3d2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:36.286863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:36.360949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e53c50-4d2f-4318-b929-0b92bc886b11 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:36.378446 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:36.410305 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce87ef9-b3a0-4a9a-9a38-ee81ac27ff7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:36.411027 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce87ef9-b3a0-4a9a-9a38-ee81ac27ff7c None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:36.411317 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce87ef9-b3a0-4a9a-9a38-ee81ac27ff7c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:36.411595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce87ef9-b3a0-4a9a-9a38-ee81ac27ff7c None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:36.412354 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce87ef9-b3a0-4a9a-9a38-ee81ac27ff7c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:36.412663 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce87ef9-b3a0-4a9a-9a38-ee81ac27ff7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:36.414126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce87ef9-b3a0-4a9a-9a38-ee81ac27ff7c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:36.418294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 187/366] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:36.419494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd088750-f559-4e7e-84a9-3f468cd6c3d2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:36.428624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 180/367] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:01:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:36.429734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce87ef9-b3a0-4a9a-9a38-ee81ac27ff7c None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:36.553214 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd088750-f559-4e7e-84a9-3f468cd6c3d2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:36.573629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce87ef9-b3a0-4a9a-9a38-ee81ac27ff7c None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:36.592908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c7296-7e85-4295-a916-554da0ca4c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:36.594079 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c7296-7e85-4295-a916-554da0ca4c52 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:36.594567 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c7296-7e85-4295-a916-554da0ca4c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:36.595030 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c7296-7e85-4295-a916-554da0ca4c52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:36.595142 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:36.607987 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c7296-7e85-4295-a916-554da0ca4c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:36.615039 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e0f6f-9a03-4ba9-9487-dc4d76cad7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:36.616091 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e0f6f-9a03-4ba9-9487-dc4d76cad7ce None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:36.616518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e0f6f-9a03-4ba9-9487-dc4d76cad7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:36.616934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e0f6f-9a03-4ba9-9487-dc4d76cad7ce None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:36.617421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7d2c7296-7e85-4295-a916-554da0ca4c52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:01:36.617421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:36.617421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:36.617421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:36.617421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:36.617421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:36.617421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:36.617421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:36.617421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:36.617421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:36.617421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:36.617421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:36.617421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:36.617421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:36.617421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:36.617421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:36.618493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:36.618493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:36.618493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:36.618493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:36.618493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:36.618493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:36.618493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:36.618493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:36.618493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:36.618493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:36.618493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:36.618493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:36.618493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:36.618493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:36.618493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:36.618493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:36.619494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:36.619494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:36.619494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:36.619494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:36.619494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:36.619494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:36.619494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:36.619494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:36.619494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:36.619494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:36.619494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:01:36.619494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:36.621216 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e0f6f-9a03-4ba9-9487-dc4d76cad7ce None admin] RBAC: Authorizing `identity:get_project(project_id=54b0a661962441ba8877bf383738e206)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:36.622872 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e0f6f-9a03-4ba9-9487-dc4d76cad7ce None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:36.624793 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 181/369] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:36 2022] GET /identity/v3/projects/54b0a661962441ba8877bf383738e206 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:36.625031 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 188/369] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:01:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:36.625953 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e0f6f-9a03-4ba9-9487-dc4d76cad7ce None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:36.630053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c7296-7e85-4295-a916-554da0ca4c52 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:36.668294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:36.755666 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c7296-7e85-4295-a916-554da0ca4c52 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:36.756638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e0f6f-9a03-4ba9-9487-dc4d76cad7ce None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:36.796288 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1a9f5-9047-4952-9e57-8b935325fcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:36.798651 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1a9f5-9047-4952-9e57-8b935325fcac None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:36.799313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1a9f5-9047-4952-9e57-8b935325fcac None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:36.799894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1a9f5-9047-4952-9e57-8b935325fcac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:36.806034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe095a-83ec-477f-a906-df2d9f0dd731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:36.807261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe095a-83ec-477f-a906-df2d9f0dd731 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:36.807550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe095a-83ec-477f-a906-df2d9f0dd731 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:36.807830 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe095a-83ec-477f-a906-df2d9f0dd731 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:36.808597 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe095a-83ec-477f-a906-df2d9f0dd731 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:36.808906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe095a-83ec-477f-a906-df2d9f0dd731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:36.810336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe095a-83ec-477f-a906-df2d9f0dd731 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:36.827165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 189/370] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:36.827165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe095a-83ec-477f-a906-df2d9f0dd731 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:36.887760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:36.901266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1a9f5-9047-4952-9e57-8b935325fcac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:36.903050 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1a9f5-9047-4952-9e57-8b935325fcac None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:36.953028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:36.956918 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe095a-83ec-477f-a906-df2d9f0dd731 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:37.004130 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadcf8b-5a01-457c-8126-7303db9f37b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:37.005004 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadcf8b-5a01-457c-8126-7303db9f37b5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:37.005287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadcf8b-5a01-457c-8126-7303db9f37b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:37.005559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadcf8b-5a01-457c-8126-7303db9f37b5 None admin] PATH_INFO: `/v3/groups/358ad776e6bd4b4aa89eedce06cf830a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:37.007362 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadcf8b-5a01-457c-8126-7303db9f37b5 None admin] RBAC: Authorizing `identity:get_group(group_id=358ad776e6bd4b4aa89eedce06cf830a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:37.008756 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadcf8b-5a01-457c-8126-7303db9f37b5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:37.011937 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 190/371] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 12:01:36 2022] GET /identity/v3/groups/358ad776e6bd4b4aa89eedce06cf830a => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:37.012985 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadcf8b-5a01-457c-8126-7303db9f37b5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:37.038686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 182/372] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:37.039555 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1a9f5-9047-4952-9e57-8b935325fcac None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:37.147488 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadcf8b-5a01-457c-8126-7303db9f37b5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:37.158363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:37.175522 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1a9f5-9047-4952-9e57-8b935325fcac None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:37.198732 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9ecf3-c2d0-4286-9991-2e80d2a7bd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:37.199397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9ecf3-c2d0-4286-9991-2e80d2a7bd00 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:37.199684 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9ecf3-c2d0-4286-9991-2e80d2a7bd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:37.199961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9ecf3-c2d0-4286-9991-2e80d2a7bd00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:37.214481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb9def-fa73-4e4a-9abd-43f78a1a4463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:37.215394 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb9def-fa73-4e4a-9abd-43f78a1a4463 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:37.215886 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb9def-fa73-4e4a-9abd-43f78a1a4463 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:37.216313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb9def-fa73-4e4a-9abd-43f78a1a4463 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:37.217355 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb9def-fa73-4e4a-9abd-43f78a1a4463 None admin] RBAC: Adding query filter params (group.id=358ad776e6bd4b4aa89eedce06cf830a, role.id=ae11679806844c6f8d55ce5ccb32ee8b, scope.project.id=54b0a661962441ba8877bf383738e206) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:37.217844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb9def-fa73-4e4a-9abd-43f78a1a4463 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:37.219455 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb9def-fa73-4e4a-9abd-43f78a1a4463 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:37.225853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 183/373] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 12:01:37 2022] GET /identity/v3/role_assignments?group.id=358ad776e6bd4b4aa89eedce06cf830a&scope.project.id=54b0a661962441ba8877bf383738e206&role.id=ae11679806844c6f8d55ce5ccb32ee8b => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:37.226891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb9def-fa73-4e4a-9abd-43f78a1a4463 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:37.242850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:37.316651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9ecf3-c2d0-4286-9991-2e80d2a7bd00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:37.318433 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9ecf3-c2d0-4286-9991-2e80d2a7bd00 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:37.434364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 191/374] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:37.439960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9ecf3-c2d0-4286-9991-2e80d2a7bd00 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:37.459941 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb9def-fa73-4e4a-9abd-43f78a1a4463 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:37.506640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:37.542256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846fefb-3d52-4f07-ab80-67b55f0a640b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:37.543138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846fefb-3d52-4f07-ab80-67b55f0a640b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:37.543421 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846fefb-3d52-4f07-ab80-67b55f0a640b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:37.543696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846fefb-3d52-4f07-ab80-67b55f0a640b None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:37.546402 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846fefb-3d52-4f07-ab80-67b55f0a640b None admin] RBAC: Authorizing `identity:get_project(project_id=54b0a661962441ba8877bf383738e206)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:37.547856 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846fefb-3d52-4f07-ab80-67b55f0a640b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:37.548038 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9ecf3-c2d0-4286-9991-2e80d2a7bd00 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:37.549877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 184/375] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:37 2022] GET /identity/v3/projects/54b0a661962441ba8877bf383738e206 => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:37.558986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846fefb-3d52-4f07-ab80-67b55f0a640b None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:37.590978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:37.595468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023f90f-f30f-4115-92b5-965cc0a4455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:37.596407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023f90f-f30f-4115-92b5-965cc0a4455b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:37.596695 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023f90f-f30f-4115-92b5-965cc0a4455b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:37.596969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023f90f-f30f-4115-92b5-965cc0a4455b None admin] PATH_INFO: `/v3/projects/41f6b44ea8df423598fdb5ab7cad5172` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:37.598459 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023f90f-f30f-4115-92b5-965cc0a4455b None admin] RBAC: Authorizing `identity:get_project(project_id=41f6b44ea8df423598fdb5ab7cad5172)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:37.599909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023f90f-f30f-4115-92b5-965cc0a4455b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:37.603215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 192/376] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:37 2022] GET /identity/v3/projects/41f6b44ea8df423598fdb5ab7cad5172 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:37.610980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023f90f-f30f-4115-92b5-965cc0a4455b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:37.711326 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846fefb-3d52-4f07-ab80-67b55f0a640b None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:37.756645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe791ca-3e4f-4de5-80f0-f4c9b3c3a949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:37.758133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe791ca-3e4f-4de5-80f0-f4c9b3c3a949 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:37.759377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe791ca-3e4f-4de5-80f0-f4c9b3c3a949 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:37.760686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe791ca-3e4f-4de5-80f0-f4c9b3c3a949 None admin] PATH_INFO: `/v3/groups/358ad776e6bd4b4aa89eedce06cf830a` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:37.764859 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe791ca-3e4f-4de5-80f0-f4c9b3c3a949 None admin] RBAC: Authorizing `identity:get_group(group_id=358ad776e6bd4b4aa89eedce06cf830a)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:37.767402 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe791ca-3e4f-4de5-80f0-f4c9b3c3a949 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:37.771965 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 185/377] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 12:01:37 2022] GET /identity/v3/groups/358ad776e6bd4b4aa89eedce06cf830a => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:37.775021 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe791ca-3e4f-4de5-80f0-f4c9b3c3a949 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:37.800582 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023f90f-f30f-4115-92b5-965cc0a4455b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:37.854996 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:37.860847 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7d8da-25e2-467a-b70b-b5a2e702b165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:37.866023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7d8da-25e2-467a-b70b-b5a2e702b165 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:37.866023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7d8da-25e2-467a-b70b-b5a2e702b165 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:37.866023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7d8da-25e2-467a-b70b-b5a2e702b165 None admin] PATH_INFO: `/v3/groups/ae8cab256b624789b0784665e084bf12` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:37.871244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7d8da-25e2-467a-b70b-b5a2e702b165 None admin] RBAC: Authorizing `identity:get_group(group_id=ae8cab256b624789b0784665e084bf12)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:37.872879 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7d8da-25e2-467a-b70b-b5a2e702b165 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:37.877283 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 193/378] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 12:01:37 2022] GET /identity/v3/groups/ae8cab256b624789b0784665e084bf12 => generated 229 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:37.884950 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7d8da-25e2-467a-b70b-b5a2e702b165 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:37.970371 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:37.997315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe791ca-3e4f-4de5-80f0-f4c9b3c3a949 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:38.042153 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734c31a-100c-4d93-b6fb-59ed4dbd5852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:38.043184 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734c31a-100c-4d93-b6fb-59ed4dbd5852 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:38.043700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734c31a-100c-4d93-b6fb-59ed4dbd5852 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:38.044194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734c31a-100c-4d93-b6fb-59ed4dbd5852 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:38.045149 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734c31a-100c-4d93-b6fb-59ed4dbd5852 None admin] RBAC: Adding query filter params (group.id=358ad776e6bd4b4aa89eedce06cf830a, role.id=639e5e5307f34a64a854cfb59086518e, scope.project.id=54b0a661962441ba8877bf383738e206) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:38.045537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734c31a-100c-4d93-b6fb-59ed4dbd5852 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:38.047151 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734c31a-100c-4d93-b6fb-59ed4dbd5852 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:38.049211 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7d8da-25e2-467a-b70b-b5a2e702b165 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:38.055858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 186/379] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 12:01:37 2022] GET /identity/v3/role_assignments?group.id=358ad776e6bd4b4aa89eedce06cf830a&scope.project.id=54b0a661962441ba8877bf383738e206&role.id=639e5e5307f34a64a854cfb59086518e => generated 260 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:38.057935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded597fe-ac5d-4388-9d80-bd285ef352d6 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:38.058325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded597fe-ac5d-4388-9d80-bd285ef352d6 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:38.058672 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded597fe-ac5d-4388-9d80-bd285ef352d6 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:38.066385 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 187/380] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:38.067962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8eba1-d8bc-410d-a5a8-2b1e21dcf874 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:38.068324 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8eba1-d8bc-410d-a5a8-2b1e21dcf874 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:38.068674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8eba1-d8bc-410d-a5a8-2b1e21dcf874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:38.099504 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41742731-7be2-4e49-bec1-a72266d64d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:38.100541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41742731-7be2-4e49-bec1-a72266d64d10 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:38.101016 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41742731-7be2-4e49-bec1-a72266d64d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:38.101477 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41742731-7be2-4e49-bec1-a72266d64d10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:38.102555 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41742731-7be2-4e49-bec1-a72266d64d10 None admin] RBAC: Adding query filter params (group.id=ae8cab256b624789b0784665e084bf12, role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.project.id=41f6b44ea8df423598fdb5ab7cad5172) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:38.103085 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41742731-7be2-4e49-bec1-a72266d64d10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:38.108529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41742731-7be2-4e49-bec1-a72266d64d10 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:38.111771 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-85b8eba1-d8bc-410d-a5a8-2b1e21dcf874 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:38.114353 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-85b8eba1-d8bc-410d-a5a8-2b1e21dcf874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:38.126292 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 194/381] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 12:01:37 2022] GET /identity/v3/role_assignments?group.id=ae8cab256b624789b0784665e084bf12&scope.project.id=41f6b44ea8df423598fdb5ab7cad5172&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:38.201321 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 188/382] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:38.242852 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41742731-7be2-4e49-bec1-a72266d64d10 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:38.319949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:38.373639 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41742731-7be2-4e49-bec1-a72266d64d10 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:38.415216 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f83193-dfb5-4918-b0e6-74cf13c3a683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:38.417212 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f83193-dfb5-4918-b0e6-74cf13c3a683 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:38.417703 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f83193-dfb5-4918-b0e6-74cf13c3a683 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:38.418175 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f83193-dfb5-4918-b0e6-74cf13c3a683 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:38.433103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f83193-dfb5-4918-b0e6-74cf13c3a683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:38.433483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70529202-b08d-442a-8099-d63d59791908 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:38.433770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70529202-b08d-442a-8099-d63d59791908 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:38.434095 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70529202-b08d-442a-8099-d63d59791908 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:38.435543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 189/383] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:01:38.442465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-08f83193-dfb5-4918-b0e6-74cf13c3a683 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:38.442465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:38.442465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:38.442465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:38.442465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:38.442465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:38.442465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:38.442465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:38.442465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:38.442465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:38.442465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:38.442465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:38.442465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:38.442465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:38.442465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:38.442465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:38.443694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:38.443694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:38.443694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:38.443694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:38.443694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:38.443694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:38.443694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:38.443694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:38.443694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:38.443694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:38.443694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:38.443694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:38.443694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:38.443694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:38.443694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:38.443694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:38.444490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:38.444490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:38.444490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:38.444490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:38.444490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:38.444490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:38.444490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:38.444490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:38.444490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:38.444490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:38.444490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:38.444490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:38.446843 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 195/384] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:01:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:38.447005 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d506a45-5eb1-4c15-8cbc-545b6516c19d None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:38.450023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d506a45-5eb1-4c15-8cbc-545b6516c19d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:38.450023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d506a45-5eb1-4c15-8cbc-545b6516c19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:38.452224 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f83193-dfb5-4918-b0e6-74cf13c3a683 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:38.477876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-9d506a45-5eb1-4c15-8cbc-545b6516c19d None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:38.480437 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-9d506a45-5eb1-4c15-8cbc-545b6516c19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:38.619555 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f83193-dfb5-4918-b0e6-74cf13c3a683 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:38.644584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:38.646167 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 190/385] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:38.665506 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31322cd-2b3a-4454-a403-6ccac339bb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:38.670731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31322cd-2b3a-4454-a403-6ccac339bb18 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:38.670731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31322cd-2b3a-4454-a403-6ccac339bb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:38.670731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31322cd-2b3a-4454-a403-6ccac339bb18 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:38.670731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31322cd-2b3a-4454-a403-6ccac339bb18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:38.670731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31322cd-2b3a-4454-a403-6ccac339bb18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:38.670731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31322cd-2b3a-4454-a403-6ccac339bb18 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:38.679069 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d506a45-5eb1-4c15-8cbc-545b6516c19d None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:38.684612 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 196/386] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:01:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:38.689643 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31322cd-2b3a-4454-a403-6ccac339bb18 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:38.697778 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:38.800172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d506a45-5eb1-4c15-8cbc-545b6516c19d None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:38.840863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9de29-98d9-4d0b-8838-ce20eed72697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:38.842154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9de29-98d9-4d0b-8838-ce20eed72697 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:38.842634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9de29-98d9-4d0b-8838-ce20eed72697 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:38.843355 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9de29-98d9-4d0b-8838-ce20eed72697 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:38.855640 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9de29-98d9-4d0b-8838-ce20eed72697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:38.864743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-62c9de29-98d9-4d0b-8838-ce20eed72697 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:38.864743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:38.864743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:38.864743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:38.864743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:38.864743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:38.864743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:38.864743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:38.864743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:38.864743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:38.864743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:38.864743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:38.864743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:38.864743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:38.864743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:38.864743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:38.865727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:38.865727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:38.865727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:38.865727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:38.865727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:38.865727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:38.865727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:38.865727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:38.865727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:38.865727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:38.865727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:38.865727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:38.865727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:38.865727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:38.865727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:38.865727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:38.866537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:38.866537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:38.866537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:38.866537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:38.866537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:38.866537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:38.866537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:38.866537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:38.866537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:38.866537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:38.866537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:38.866537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:38.877169 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 191/387] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:01:38.878513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9de29-98d9-4d0b-8838-ce20eed72697 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:38.891957 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31322cd-2b3a-4454-a403-6ccac339bb18 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:38.959173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:38.973382 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de787d-8727-4937-838e-0cbdf0d2ed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:38.974293 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de787d-8727-4937-838e-0cbdf0d2ed1b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:38.974575 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de787d-8727-4937-838e-0cbdf0d2ed1b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:38.974850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de787d-8727-4937-838e-0cbdf0d2ed1b None admin] PATH_INFO: `/v3/groups/358ad776e6bd4b4aa89eedce06cf830a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:38.976029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de787d-8727-4937-838e-0cbdf0d2ed1b None admin] RBAC: Authorizing `identity:get_group(group_id=358ad776e6bd4b4aa89eedce06cf830a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:38.977504 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de787d-8727-4937-838e-0cbdf0d2ed1b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:38.979515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 197/388] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 12:01:38 2022] GET /identity/v3/groups/358ad776e6bd4b4aa89eedce06cf830a => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:38.985471 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de787d-8727-4937-838e-0cbdf0d2ed1b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:39.005262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9de29-98d9-4d0b-8838-ce20eed72697 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:39.042076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd72c58-0cbe-41c2-8b4a-f62c14703d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:39.043963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd72c58-0cbe-41c2-8b4a-f62c14703d8f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:39.044467 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd72c58-0cbe-41c2-8b4a-f62c14703d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:39.044966 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd72c58-0cbe-41c2-8b4a-f62c14703d8f None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:39.045932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd72c58-0cbe-41c2-8b4a-f62c14703d8f None admin] RBAC: Adding query filter params (name=member) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:39.046466 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd72c58-0cbe-41c2-8b4a-f62c14703d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:39.048619 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd72c58-0cbe-41c2-8b4a-f62c14703d8f None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:39.058923 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 192/389] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:39.064682 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd72c58-0cbe-41c2-8b4a-f62c14703d8f None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:39.075071 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:39.188818 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de787d-8727-4937-838e-0cbdf0d2ed1b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:39.217965 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd72c58-0cbe-41c2-8b4a-f62c14703d8f None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:39.230612 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae95835-b54f-45c1-88cf-64ad2049d430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:39.231814 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae95835-b54f-45c1-88cf-64ad2049d430 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:39.232398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae95835-b54f-45c1-88cf-64ad2049d430 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:39.232897 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae95835-b54f-45c1-88cf-64ad2049d430 None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:39.235337 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae95835-b54f-45c1-88cf-64ad2049d430 None admin] RBAC: Authorizing `identity:get_project(project_id=ace9baa6f68746d49a7c11b95f550e58)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:39.237071 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae95835-b54f-45c1-88cf-64ad2049d430 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:39.239454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 198/390] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:38 2022] GET /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:39.247266 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae95835-b54f-45c1-88cf-64ad2049d430 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:39.281023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:39.294762 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36502a03-dafa-4286-bf65-ea5b80cf0bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:39.295627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36502a03-dafa-4286-bf65-ea5b80cf0bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:39.295917 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36502a03-dafa-4286-bf65-ea5b80cf0bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:39.296195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36502a03-dafa-4286-bf65-ea5b80cf0bc5 None admin] PATH_INFO: `/v3/groups/358ad776e6bd4b4aa89eedce06cf830a` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:39.297467 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36502a03-dafa-4286-bf65-ea5b80cf0bc5 None admin] RBAC: Authorizing `identity:get_group(group_id=358ad776e6bd4b4aa89eedce06cf830a)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:39.298936 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36502a03-dafa-4286-bf65-ea5b80cf0bc5 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:39.300886 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 193/391] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 12:01:39 2022] GET /identity/v3/groups/358ad776e6bd4b4aa89eedce06cf830a => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:39.305926 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36502a03-dafa-4286-bf65-ea5b80cf0bc5 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:39.377055 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae95835-b54f-45c1-88cf-64ad2049d430 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:39.398418 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:39.414566 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b07272-c027-4280-b9d7-253efefd0f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:39.416675 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b07272-c027-4280-b9d7-253efefd0f40 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:39.417252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b07272-c027-4280-b9d7-253efefd0f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:39.417721 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b07272-c027-4280-b9d7-253efefd0f40 None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58/groups/358ad776e6bd4b4aa89eedce06cf830a/roles/639e5e5307f34a64a854cfb59086518e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:39.420740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b07272-c027-4280-b9d7-253efefd0f40 None admin] RBAC: Authorizing `identity:create_grant(project_id=ace9baa6f68746d49a7c11b95f550e58, group_id=358ad776e6bd4b4aa89eedce06cf830a, role_id=639e5e5307f34a64a854cfb59086518e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:39.423032 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b07272-c027-4280-b9d7-253efefd0f40 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:39.447483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 199/392] 10.222.0.48 () {58 vars in 1442 bytes} [Mon Jul 25 12:01:39 2022] PUT /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58/groups/358ad776e6bd4b4aa89eedce06cf830a/roles/639e5e5307f34a64a854cfb59086518e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:01:39.496709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36502a03-dafa-4286-bf65-ea5b80cf0bc5 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:39.558825 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c300ea5-a030-493e-b967-55763bfcd4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:39.559721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c300ea5-a030-493e-b967-55763bfcd4cf None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:39.560006 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c300ea5-a030-493e-b967-55763bfcd4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:39.560284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c300ea5-a030-493e-b967-55763bfcd4cf None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:39.561607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c300ea5-a030-493e-b967-55763bfcd4cf None admin] RBAC: Authorizing `identity:get_project(project_id=ace9baa6f68746d49a7c11b95f550e58)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:39.563075 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c300ea5-a030-493e-b967-55763bfcd4cf None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:39.565104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 194/393] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:39 2022] GET /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:39.570840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b07272-c027-4280-b9d7-253efefd0f40 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:39.697802 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b07272-c027-4280-b9d7-253efefd0f40 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:39.736618 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21910233-1d4d-4129-86ab-bb010ee4bf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:39.737512 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21910233-1d4d-4129-86ab-bb010ee4bf38 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:39.737790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21910233-1d4d-4129-86ab-bb010ee4bf38 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:39.738093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21910233-1d4d-4129-86ab-bb010ee4bf38 None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58/groups/358ad776e6bd4b4aa89eedce06cf830a/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:39.740078 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21910233-1d4d-4129-86ab-bb010ee4bf38 None admin] RBAC: Authorizing `identity:create_grant(project_id=ace9baa6f68746d49a7c11b95f550e58, group_id=358ad776e6bd4b4aa89eedce06cf830a, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:39.741563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21910233-1d4d-4129-86ab-bb010ee4bf38 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:39.759212 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 200/394] 10.222.0.48 () {58 vars in 1442 bytes} [Mon Jul 25 12:01:39 2022] PUT /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58/groups/358ad776e6bd4b4aa89eedce06cf830a/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:01:39.927808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a30184-b5b0-47b4-b90b-62a1d202e1e0 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:39.928220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a30184-b5b0-47b4-b90b-62a1d202e1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:39.928398 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a30184-b5b0-47b4-b90b-62a1d202e1e0 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:39.929779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 195/395] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:39.936092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477e97d-0faa-495c-9943-076f0b4af4d6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:39.936384 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477e97d-0faa-495c-9943-076f0b4af4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:39.936667 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477e97d-0faa-495c-9943-076f0b4af4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:39.957507 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a477e97d-0faa-495c-9943-076f0b4af4d6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:39.958728 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a477e97d-0faa-495c-9943-076f0b4af4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:39.990783 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:40.031730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 201/396] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:40.057819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a30184-b5b0-47b4-b90b-62a1d202e1e0 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:40.151966 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:40.201364 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a30184-b5b0-47b4-b90b-62a1d202e1e0 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:40.242801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a174e-f093-4b61-925e-dc9cf158310a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:40.244522 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a174e-f093-4b61-925e-dc9cf158310a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:40.245024 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a174e-f093-4b61-925e-dc9cf158310a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:40.245487 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a174e-f093-4b61-925e-dc9cf158310a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:40.263289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a174e-f093-4b61-925e-dc9cf158310a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:40.271422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-836a174e-f093-4b61-925e-dc9cf158310a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:40.271422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:40.271422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:40.271422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:40.271422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:40.271422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:40.271422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:40.271422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:40.271422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:40.271422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:40.271422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:40.271422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:40.271422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:40.271422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:40.271422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:40.271422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:40.272286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:40.272286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:40.272286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:40.272286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:40.272286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:40.272286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:40.272286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:40.272286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:40.272286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:40.272286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:40.272286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:40.272286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:40.272286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:40.272286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:40.272286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:40.272286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:40.273032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:40.273032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:40.273032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:40.273032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:40.273032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:40.273032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:40.273032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:40.273032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:40.273032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:40.273032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:40.273032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:40.273032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:40.279444 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 196/397] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:40.285482 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477e97d-0faa-495c-9943-076f0b4af4d6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:40.412261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477e97d-0faa-495c-9943-076f0b4af4d6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:40.453521 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c3826-f955-4200-a821-61a98cabbe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:40.454308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c3826-f955-4200-a821-61a98cabbe82 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:40.454511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c3826-f955-4200-a821-61a98cabbe82 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:40.454789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c3826-f955-4200-a821-61a98cabbe82 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:40.455544 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c3826-f955-4200-a821-61a98cabbe82 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:40.455850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c3826-f955-4200-a821-61a98cabbe82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:40.457238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c3826-f955-4200-a821-61a98cabbe82 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:40.467190 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 202/398] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:40.475113 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a174e-f093-4b61-925e-dc9cf158310a None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:40.588756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a174e-f093-4b61-925e-dc9cf158310a None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:40.618725 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:40.625165 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24673e4c-2637-4a52-8372-5f60d0ec450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:40.626549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24673e4c-2637-4a52-8372-5f60d0ec450d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:40.626830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24673e4c-2637-4a52-8372-5f60d0ec450d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:40.627103 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24673e4c-2637-4a52-8372-5f60d0ec450d None admin] PATH_INFO: `/v3/groups/358ad776e6bd4b4aa89eedce06cf830a` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:40.628301 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24673e4c-2637-4a52-8372-5f60d0ec450d None admin] RBAC: Authorizing `identity:get_group(group_id=358ad776e6bd4b4aa89eedce06cf830a)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:40.629813 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24673e4c-2637-4a52-8372-5f60d0ec450d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:40.631822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 197/399] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 12:01:40 2022] GET /identity/v3/groups/358ad776e6bd4b4aa89eedce06cf830a => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:40.636904 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c3826-f955-4200-a821-61a98cabbe82 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:40.687391 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:40.716396 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a94eae-ea2b-40cf-9abd-e93c7cc33393 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:40.717030 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a94eae-ea2b-40cf-9abd-e93c7cc33393 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:40.717508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a94eae-ea2b-40cf-9abd-e93c7cc33393 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:40.722828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 198/400] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:40.724275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0ee46-1841-4afd-a5eb-c5dca466f89c None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:40.724831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0ee46-1841-4afd-a5eb-c5dca466f89c None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:40.725393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0ee46-1841-4afd-a5eb-c5dca466f89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:40.764880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-98e0ee46-1841-4afd-a5eb-c5dca466f89c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:40.767294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-98e0ee46-1841-4afd-a5eb-c5dca466f89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:40.803500 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c3826-f955-4200-a821-61a98cabbe82 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:40.858898 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465bc04-2553-492b-a2e6-fcb48995339d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:40.859702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465bc04-2553-492b-a2e6-fcb48995339d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:40.859987 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465bc04-2553-492b-a2e6-fcb48995339d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:40.860263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465bc04-2553-492b-a2e6-fcb48995339d None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:40.862764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465bc04-2553-492b-a2e6-fcb48995339d None admin] RBAC: Authorizing `identity:get_project(project_id=54b0a661962441ba8877bf383738e206)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:40.864444 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465bc04-2553-492b-a2e6-fcb48995339d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:40.866705 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 203/401] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:40 2022] GET /identity/v3/projects/54b0a661962441ba8877bf383738e206 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:40.871986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465bc04-2553-492b-a2e6-fcb48995339d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:40.880355 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 199/402] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:40.910483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e05b9-6642-4954-8ded-06f028db4521 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:40.911021 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e05b9-6642-4954-8ded-06f028db4521 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:40.911445 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e05b9-6642-4954-8ded-06f028db4521 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:40.913215 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 200/403] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:40.918198 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e05b9-6642-4954-8ded-06f028db4521 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:40.978721 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:40.983027 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465bc04-2553-492b-a2e6-fcb48995339d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:41.017241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d0603-a5a0-424a-b930-e7ee1ca960cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:41.018144 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d0603-a5a0-424a-b930-e7ee1ca960cc None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:41.018426 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d0603-a5a0-424a-b930-e7ee1ca960cc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:41.018846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d0603-a5a0-424a-b930-e7ee1ca960cc None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206/groups/358ad776e6bd4b4aa89eedce06cf830a/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:41.020850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d0603-a5a0-424a-b930-e7ee1ca960cc None admin] RBAC: Authorizing `identity:create_grant(project_id=54b0a661962441ba8877bf383738e206, group_id=358ad776e6bd4b4aa89eedce06cf830a, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:41.022403 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d0603-a5a0-424a-b930-e7ee1ca960cc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:41.027628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e05b9-6642-4954-8ded-06f028db4521 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:41.038684 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 204/404] 10.222.0.48 () {58 vars in 1442 bytes} [Mon Jul 25 12:01:40 2022] PUT /identity/v3/projects/54b0a661962441ba8877bf383738e206/groups/358ad776e6bd4b4aa89eedce06cf830a/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:01:41.040511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e57bd1-70bf-4b39-9184-819577d92463 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:41.041097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e57bd1-70bf-4b39-9184-819577d92463 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:41.041923 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e57bd1-70bf-4b39-9184-819577d92463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:41.058093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:41.069098 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-49e57bd1-70bf-4b39-9184-819577d92463 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:41.071054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-49e57bd1-70bf-4b39-9184-819577d92463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:41.088726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea1fcd-e538-4dd9-933f-db4709667add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:41.089555 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea1fcd-e538-4dd9-933f-db4709667add None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:41.089838 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea1fcd-e538-4dd9-933f-db4709667add None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:41.090172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea1fcd-e538-4dd9-933f-db4709667add None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:41.114141 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea1fcd-e538-4dd9-933f-db4709667add None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:41.133221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-8eea1fcd-e538-4dd9-933f-db4709667add None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:01:41.133221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:41.133221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:41.133221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:41.133221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:41.133221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:41.133221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:41.133221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:41.133221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:41.133221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:41.133221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:41.133221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:41.133221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:41.133221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:41.133221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:41.133221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:41.134278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:41.134278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:41.134278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:41.134278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:41.134278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:41.134278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:41.134278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:41.134278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:41.134278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:41.134278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:41.134278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:41.134278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:41.134278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:41.134278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:41.134278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:41.134278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:41.135598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:41.135598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:41.135598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:41.135598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:41.135598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:41.135598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:41.135598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:41.135598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:41.135598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:41.135598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:41.135598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:01:41.135598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:41.140166 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 201/405] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:01:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:41.145201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea1fcd-e538-4dd9-933f-db4709667add None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:41.192114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 205/406] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:41.229702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e57bd1-70bf-4b39-9184-819577d92463 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:41.304219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea1fcd-e538-4dd9-933f-db4709667add None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:41.350318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da9975-a8dd-4115-8cd8-aa9c77f8a2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:41.351008 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da9975-a8dd-4115-8cd8-aa9c77f8a2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:41.351296 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da9975-a8dd-4115-8cd8-aa9c77f8a2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:41.351581 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da9975-a8dd-4115-8cd8-aa9c77f8a2d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:41.352381 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da9975-a8dd-4115-8cd8-aa9c77f8a2d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:41.352701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da9975-a8dd-4115-8cd8-aa9c77f8a2d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:41.353535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:41.356156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da9975-a8dd-4115-8cd8-aa9c77f8a2d0 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:41.374261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e57bd1-70bf-4b39-9184-819577d92463 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:41.374419 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 202/407] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:41.376262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da9975-a8dd-4115-8cd8-aa9c77f8a2d0 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:41.412138 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b174fe7-9c50-4ff4-bbbb-23c8df37abe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:41.413383 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b174fe7-9c50-4ff4-bbbb-23c8df37abe1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:41.413810 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b174fe7-9c50-4ff4-bbbb-23c8df37abe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:41.414253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b174fe7-9c50-4ff4-bbbb-23c8df37abe1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:41.426777 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b174fe7-9c50-4ff4-bbbb-23c8df37abe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:41.436956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6b174fe7-9c50-4ff4-bbbb-23c8df37abe1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:41.436956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:41.436956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:41.436956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:41.436956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:41.436956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:41.436956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:41.436956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:41.436956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:41.436956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:41.436956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:41.436956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:41.436956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:41.436956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:41.436956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:41.436956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:41.437980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:41.437980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:41.437980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:41.437980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:41.437980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:41.437980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:41.437980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:41.437980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:41.437980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:41.437980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:41.437980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:41.437980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:41.437980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:41.437980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:41.437980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:41.437980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:41.438977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:41.438977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:41.438977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:41.438977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:41.438977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:41.438977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:41.438977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:41.438977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:41.438977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:41.438977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:41.438977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:41.438977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:41.441827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 206/408] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:01:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:01:41.449133 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b174fe7-9c50-4ff4-bbbb-23c8df37abe1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:41.478382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:41.579328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b174fe7-9c50-4ff4-bbbb-23c8df37abe1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:41.616658 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dd7e3-7598-4e36-ac70-361d807608eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:41.617337 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dd7e3-7598-4e36-ac70-361d807608eb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:41.617620 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dd7e3-7598-4e36-ac70-361d807608eb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:41.617892 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dd7e3-7598-4e36-ac70-361d807608eb None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:41.618680 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7dd7e3-7598-4e36-ac70-361d807608eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:41.619903 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7dd7e3-7598-4e36-ac70-361d807608eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:41.621464 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7dd7e3-7598-4e36-ac70-361d807608eb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:41.631471 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 207/409] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:01:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:41.637040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dd7e3-7598-4e36-ac70-361d807608eb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:41.638052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da9975-a8dd-4115-8cd8-aa9c77f8a2d0 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:41.651011 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:41.732659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cc628-eb4c-4a7e-8b61-ebe25b8e6068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:41.733695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cc628-eb4c-4a7e-8b61-ebe25b8e6068 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:41.734098 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cc628-eb4c-4a7e-8b61-ebe25b8e6068 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:41.734470 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cc628-eb4c-4a7e-8b61-ebe25b8e6068 None admin] PATH_INFO: `/v3/groups/ae8cab256b624789b0784665e084bf12` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:41.735786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cc628-eb4c-4a7e-8b61-ebe25b8e6068 None admin] RBAC: Authorizing `identity:get_group(group_id=ae8cab256b624789b0784665e084bf12)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:41.737382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cc628-eb4c-4a7e-8b61-ebe25b8e6068 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:41.743377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 203/410] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 12:01:41 2022] GET /identity/v3/groups/ae8cab256b624789b0784665e084bf12 => generated 229 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:41.747023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cc628-eb4c-4a7e-8b61-ebe25b8e6068 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:41.752971 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dd7e3-7598-4e36-ac70-361d807608eb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:41.791412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f44a02-8fc6-4068-9676-0246e4b4f51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:41.793091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f44a02-8fc6-4068-9676-0246e4b4f51c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:41.793526 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f44a02-8fc6-4068-9676-0246e4b4f51c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:41.793951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f44a02-8fc6-4068-9676-0246e4b4f51c None admin] PATH_INFO: `/v3/groups/358ad776e6bd4b4aa89eedce06cf830a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:41.795327 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f44a02-8fc6-4068-9676-0246e4b4f51c None admin] RBAC: Authorizing `identity:get_group(group_id=358ad776e6bd4b4aa89eedce06cf830a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:41.797409 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f44a02-8fc6-4068-9676-0246e4b4f51c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:41.799582 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 208/411] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 12:01:41 2022] GET /identity/v3/groups/358ad776e6bd4b4aa89eedce06cf830a => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:41.805171 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f44a02-8fc6-4068-9676-0246e4b4f51c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:41.893776 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:41.919929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f44a02-8fc6-4068-9676-0246e4b4f51c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:41.959722 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd748d-03f5-4782-a055-7c88f14bb222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:41.960884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd748d-03f5-4782-a055-7c88f14bb222 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:41.961372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd748d-03f5-4782-a055-7c88f14bb222 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:41.961820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd748d-03f5-4782-a055-7c88f14bb222 None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:41.970787 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd748d-03f5-4782-a055-7c88f14bb222 None admin] RBAC: Authorizing `identity:get_project(project_id=54b0a661962441ba8877bf383738e206)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:41.972246 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd748d-03f5-4782-a055-7c88f14bb222 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:41.973933 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 209/412] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:41 2022] GET /identity/v3/projects/54b0a661962441ba8877bf383738e206 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:41.979634 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd748d-03f5-4782-a055-7c88f14bb222 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:42.012367 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cc628-eb4c-4a7e-8b61-ebe25b8e6068 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:42.041987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:42.093682 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da311b7a-a131-4243-b725-65452eaa85f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:42.094954 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da311b7a-a131-4243-b725-65452eaa85f7 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:42.095574 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da311b7a-a131-4243-b725-65452eaa85f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:42.096051 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da311b7a-a131-4243-b725-65452eaa85f7 None admin] PATH_INFO: `/v3/projects/41f6b44ea8df423598fdb5ab7cad5172` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:42.099064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da311b7a-a131-4243-b725-65452eaa85f7 None admin] RBAC: Authorizing `identity:get_project(project_id=41f6b44ea8df423598fdb5ab7cad5172)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:42.102104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da311b7a-a131-4243-b725-65452eaa85f7 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:42.106767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 204/413] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:41 2022] GET /identity/v3/projects/41f6b44ea8df423598fdb5ab7cad5172 => generated 344 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:42.112489 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da311b7a-a131-4243-b725-65452eaa85f7 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:42.131169 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd748d-03f5-4782-a055-7c88f14bb222 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:42.178089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995907d-4828-49c5-848d-d526eda41163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:42.179966 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995907d-4828-49c5-848d-d526eda41163 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:42.180398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995907d-4828-49c5-848d-d526eda41163 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:42.180841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995907d-4828-49c5-848d-d526eda41163 None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206/groups/358ad776e6bd4b4aa89eedce06cf830a/roles/639e5e5307f34a64a854cfb59086518e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:42.183806 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995907d-4828-49c5-848d-d526eda41163 None admin] RBAC: Authorizing `identity:create_grant(project_id=54b0a661962441ba8877bf383738e206, group_id=358ad776e6bd4b4aa89eedce06cf830a, role_id=639e5e5307f34a64a854cfb59086518e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:42.185829 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995907d-4828-49c5-848d-d526eda41163 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:42.204199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 210/414] 10.222.0.48 () {58 vars in 1442 bytes} [Mon Jul 25 12:01:41 2022] PUT /identity/v3/projects/54b0a661962441ba8877bf383738e206/groups/358ad776e6bd4b4aa89eedce06cf830a/roles/639e5e5307f34a64a854cfb59086518e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:01:42.210500 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eda8fe-e0fa-405d-9d95-2e02689a74b6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:42.210500 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eda8fe-e0fa-405d-9d95-2e02689a74b6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:42.210500 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eda8fe-e0fa-405d-9d95-2e02689a74b6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:42.214440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 211/415] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:42.216070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956566e-a782-4b2a-b9c1-c2d6cdacb456 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:42.216363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956566e-a782-4b2a-b9c1-c2d6cdacb456 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:42.216644 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956566e-a782-4b2a-b9c1-c2d6cdacb456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:42.245520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:42.262051 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4956566e-a782-4b2a-b9c1-c2d6cdacb456 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:42.262051 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4956566e-a782-4b2a-b9c1-c2d6cdacb456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:42.279978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da311b7a-a131-4243-b725-65452eaa85f7 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:42.329771 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c4374-a5d5-481f-a06c-e26012c3be69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:42.330812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c4374-a5d5-481f-a06c-e26012c3be69 None admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:42.331166 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c4374-a5d5-481f-a06c-e26012c3be69 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:42.331580 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c4374-a5d5-481f-a06c-e26012c3be69 None admin] PATH_INFO: `/v3/projects/41f6b44ea8df423598fdb5ab7cad5172/groups/ae8cab256b624789b0784665e084bf12/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:42.333944 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c4374-a5d5-481f-a06c-e26012c3be69 None admin] RBAC: Authorizing `identity:create_grant(project_id=41f6b44ea8df423598fdb5ab7cad5172, group_id=ae8cab256b624789b0784665e084bf12, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:42.335425 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c4374-a5d5-481f-a06c-e26012c3be69 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:42.338128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 212/416] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:42.339669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67405e33-8194-42e6-94bc-63f26d8eec0b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:42.340073 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67405e33-8194-42e6-94bc-63f26d8eec0b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:42.340413 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67405e33-8194-42e6-94bc-63f26d8eec0b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:42.347736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 213/417] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:42.354550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf7185-a24a-4b32-808b-12bfbd1dd39c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:42.355159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf7185-a24a-4b32-808b-12bfbd1dd39c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:42.356234 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf7185-a24a-4b32-808b-12bfbd1dd39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:42.357685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 205/418] 10.222.0.48 () {58 vars in 1442 bytes} [Mon Jul 25 12:01:42 2022] PUT /identity/v3/projects/41f6b44ea8df423598fdb5ab7cad5172/groups/ae8cab256b624789b0784665e084bf12/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:01:42.376371 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c4374-a5d5-481f-a06c-e26012c3be69 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:42.385630 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-88cf7185-a24a-4b32-808b-12bfbd1dd39c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:42.386912 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-88cf7185-a24a-4b32-808b-12bfbd1dd39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:42.452520 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:42.517958 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 214/419] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:01:42.546557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c4374-a5d5-481f-a06c-e26012c3be69 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:42.548132 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf7185-a24a-4b32-808b-12bfbd1dd39c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:42.595675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678c930-5845-40ad-be4a-4ba21f3ccd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:42.596489 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678c930-5845-40ad-be4a-4ba21f3ccd32 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:42.596775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678c930-5845-40ad-be4a-4ba21f3ccd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:42.597051 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678c930-5845-40ad-be4a-4ba21f3ccd32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:42.610704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678c930-5845-40ad-be4a-4ba21f3ccd32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:42.620471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-3678c930-5845-40ad-be4a-4ba21f3ccd32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:42.620471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:42.620471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:42.620471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:42.620471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:42.620471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:42.620471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:42.620471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:42.620471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:42.620471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:42.620471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:42.620471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:42.620471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:42.620471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:42.620471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:42.620471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:42.621327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:42.621327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:42.621327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:42.621327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:42.621327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:42.621327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:42.621327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:42.621327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:42.621327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:42.621327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:42.621327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:42.621327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:42.621327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:42.621327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:42.621327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:42.621327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:42.622154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:42.622154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:42.622154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:42.622154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:42.622154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:42.622154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:42.622154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:42.622154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:42.622154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:42.622154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:42.622154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:42.622154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:42.623498 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:42.625944 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 206/420] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:01:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:42.632445 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678c930-5845-40ad-be4a-4ba21f3ccd32 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:42.683625 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf7185-a24a-4b32-808b-12bfbd1dd39c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:42.748232 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678c930-5845-40ad-be4a-4ba21f3ccd32 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:42.750625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:42.764732 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27eca13-e399-44b5-a9fb-410631ff6251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:42.765543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27eca13-e399-44b5-a9fb-410631ff6251 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:42.765823 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27eca13-e399-44b5-a9fb-410631ff6251 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:42.766125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27eca13-e399-44b5-a9fb-410631ff6251 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:42.787998 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27eca13-e399-44b5-a9fb-410631ff6251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:42.799322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c27eca13-e399-44b5-a9fb-410631ff6251 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:42.799322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:42.799322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:42.799322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:42.799322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:42.799322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:42.799322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:42.799322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:42.799322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:42.799322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:42.799322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:42.799322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:42.799322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:42.799322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:42.799322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:42.799322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:42.800280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:42.800280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:42.800280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:42.800280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:42.800280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:42.800280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:42.800280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:42.800280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:42.800280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:42.800280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:42.800280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:42.800280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:42.800280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:42.800280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:42.800280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:42.800280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:42.801519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:42.801519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:42.801519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:42.801519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:42.801519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:42.801519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:42.801519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:42.801519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:42.801519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:42.801519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:42.801519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:42.801519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:42.801519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 215/421] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:01:42.806683 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27eca13-e399-44b5-a9fb-410631ff6251 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:42.821762 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355caf5-5db8-4cf4-8a04-8654b5f86499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:42.822767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355caf5-5db8-4cf4-8a04-8654b5f86499 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:42.823252 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355caf5-5db8-4cf4-8a04-8654b5f86499 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:42.823701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355caf5-5db8-4cf4-8a04-8654b5f86499 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:42.824631 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355caf5-5db8-4cf4-8a04-8654b5f86499 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:42.825118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355caf5-5db8-4cf4-8a04-8654b5f86499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:42.826684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355caf5-5db8-4cf4-8a04-8654b5f86499 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:42.847903 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 207/422] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:01:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:42.856012 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355caf5-5db8-4cf4-8a04-8654b5f86499 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:42.923267 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27eca13-e399-44b5-a9fb-410631ff6251 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:42.959880 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e179f2a-c3b0-4383-84a2-9bcdc81a46ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:42.960594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e179f2a-c3b0-4383-84a2-9bcdc81a46ba None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:42.966017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e179f2a-c3b0-4383-84a2-9bcdc81a46ba None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:42.966017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e179f2a-c3b0-4383-84a2-9bcdc81a46ba None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:42.966017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e179f2a-c3b0-4383-84a2-9bcdc81a46ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:42.966017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e179f2a-c3b0-4383-84a2-9bcdc81a46ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:42.966017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e179f2a-c3b0-4383-84a2-9bcdc81a46ba None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:42.974707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 216/423] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:42.978927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:42.987028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e179f2a-c3b0-4383-84a2-9bcdc81a46ba None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:43.073072 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355caf5-5db8-4cf4-8a04-8654b5f86499 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:43.147382 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e179f2a-c3b0-4383-84a2-9bcdc81a46ba None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:43.149886 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7341a6-456d-43bf-9dcc-0ec96a5f1bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:43.151138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7341a6-456d-43bf-9dcc-0ec96a5f1bfe None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:43.151426 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7341a6-456d-43bf-9dcc-0ec96a5f1bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:43.151713 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7341a6-456d-43bf-9dcc-0ec96a5f1bfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:43.207974 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc780b28-6a61-4fba-8521-f88b4096701b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:43.209758 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc780b28-6a61-4fba-8521-f88b4096701b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:43.211434 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc780b28-6a61-4fba-8521-f88b4096701b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:43.211912 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc780b28-6a61-4fba-8521-f88b4096701b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:43.229200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:43.294783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7341a6-456d-43bf-9dcc-0ec96a5f1bfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:43.297268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7341a6-456d-43bf-9dcc-0ec96a5f1bfe None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:43.320831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:43.344690 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc780b28-6a61-4fba-8521-f88b4096701b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:43.346086 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc780b28-6a61-4fba-8521-f88b4096701b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:43.456701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 208/424] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:43.458362 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b4130-639f-4504-8d8c-7c1294761310 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:43.458650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b4130-639f-4504-8d8c-7c1294761310 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:43.459082 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b4130-639f-4504-8d8c-7c1294761310 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:43.461140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 209/425] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:43.463238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b4130-639f-4504-8d8c-7c1294761310 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:43.500971 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 217/426] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:43.502595 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7974d7c-ca0f-42ec-a5cd-2c152061d9cb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:43.502973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7974d7c-ca0f-42ec-a5cd-2c152061d9cb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:43.503340 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7974d7c-ca0f-42ec-a5cd-2c152061d9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:43.522098 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c7974d7c-ca0f-42ec-a5cd-2c152061d9cb None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:43.523470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c7974d7c-ca0f-42ec-a5cd-2c152061d9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:43.546016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:43.587575 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b4130-639f-4504-8d8c-7c1294761310 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:43.609020 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 218/427] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:43.609951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7974d7c-ca0f-42ec-a5cd-2c152061d9cb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:43.629202 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:43.632870 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63948f85-5312-4fed-bbb9-38df8e3fd2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:43.634427 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63948f85-5312-4fed-bbb9-38df8e3fd2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:43.635102 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63948f85-5312-4fed-bbb9-38df8e3fd2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:43.635572 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63948f85-5312-4fed-bbb9-38df8e3fd2c4 None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:43.638182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63948f85-5312-4fed-bbb9-38df8e3fd2c4 None admin] RBAC: Authorizing `identity:get_project(project_id=ace9baa6f68746d49a7c11b95f550e58)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:43.640379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63948f85-5312-4fed-bbb9-38df8e3fd2c4 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:43.643284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 210/428] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:43 2022] GET /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:43.644397 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63948f85-5312-4fed-bbb9-38df8e3fd2c4 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:43.726341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7974d7c-ca0f-42ec-a5cd-2c152061d9cb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:43.767561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed88bef-efe4-4951-b5f7-458b2b7212bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:43.769406 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed88bef-efe4-4951-b5f7-458b2b7212bb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:43.769908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed88bef-efe4-4951-b5f7-458b2b7212bb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:43.770730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed88bef-efe4-4951-b5f7-458b2b7212bb None admin] PATH_INFO: `/v3/projects/ace9baa6f68746d49a7c11b95f550e58` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:43.772399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed88bef-efe4-4951-b5f7-458b2b7212bb None admin] RBAC: Authorizing `identity:get_project(project_id=ace9baa6f68746d49a7c11b95f550e58)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:43.774739 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed88bef-efe4-4951-b5f7-458b2b7212bb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:43.782792 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 219/429] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:43 2022] GET /identity/v3/projects/ace9baa6f68746d49a7c11b95f550e58 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:43.784292 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed88bef-efe4-4951-b5f7-458b2b7212bb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:43.787885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63948f85-5312-4fed-bbb9-38df8e3fd2c4 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:43.829353 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb522ba-c99c-48ea-be9d-8405760b9789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:43.830176 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb522ba-c99c-48ea-be9d-8405760b9789 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:43.830469 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb522ba-c99c-48ea-be9d-8405760b9789 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:43.830747 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb522ba-c99c-48ea-be9d-8405760b9789 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:43.832927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:43.844694 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb522ba-c99c-48ea-be9d-8405760b9789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:43.852791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-afb522ba-c99c-48ea-be9d-8405760b9789 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:43.852791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:43.852791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:43.852791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:43.852791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:43.852791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:43.852791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:43.852791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:43.852791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:43.852791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:43.852791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:43.852791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:43.852791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:43.852791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:43.852791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:43.852791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:43.854545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:43.854545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:43.854545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:43.854545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:43.854545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:43.854545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:43.854545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:43.854545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:43.854545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:43.854545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:43.854545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:43.854545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:43.854545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:43.854545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:43.854545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:43.854545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:43.855552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:43.855552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:43.855552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:43.855552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:43.855552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:43.855552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:43.855552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:43.855552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:43.855552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:43.855552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:43.855552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:01:43.855552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:43.855552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 211/430] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:43.855552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb522ba-c99c-48ea-be9d-8405760b9789 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:43.914840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:43.936859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed88bef-efe4-4951-b5f7-458b2b7212bb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:43.971214 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb522ba-c99c-48ea-be9d-8405760b9789 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:43.985445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddce4a-0b9c-470f-99c2-55da7c4d1ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:43.987062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddce4a-0b9c-470f-99c2-55da7c4d1ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:43.987797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddce4a-0b9c-470f-99c2-55da7c4d1ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:43.988299 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddce4a-0b9c-470f-99c2-55da7c4d1ad8 None admin] PATH_INFO: `/v3/groups/358ad776e6bd4b4aa89eedce06cf830a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:43.990366 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddce4a-0b9c-470f-99c2-55da7c4d1ad8 None admin] RBAC: Authorizing `identity:get_group(group_id=358ad776e6bd4b4aa89eedce06cf830a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:43.992054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddce4a-0b9c-470f-99c2-55da7c4d1ad8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:43.995171 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 220/431] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 12:01:43 2022] GET /identity/v3/groups/358ad776e6bd4b4aa89eedce06cf830a => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:43.996155 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddce4a-0b9c-470f-99c2-55da7c4d1ad8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:44.014871 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0bed8-9785-4bda-adbe-12ae61e9c8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:44.015744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0bed8-9785-4bda-adbe-12ae61e9c8af None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:44.016062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0bed8-9785-4bda-adbe-12ae61e9c8af None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:44.016763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0bed8-9785-4bda-adbe-12ae61e9c8af None admin] PATH_INFO: `/v3/groups/358ad776e6bd4b4aa89eedce06cf830a` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:44.018289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0bed8-9785-4bda-adbe-12ae61e9c8af None admin] RBAC: Authorizing `identity:get_group(group_id=358ad776e6bd4b4aa89eedce06cf830a)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:44.019963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0bed8-9785-4bda-adbe-12ae61e9c8af None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:44.027380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 212/432] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 12:01:43 2022] GET /identity/v3/groups/358ad776e6bd4b4aa89eedce06cf830a => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:44.027380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0bed8-9785-4bda-adbe-12ae61e9c8af None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:44.105433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:44.119799 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddce4a-0b9c-470f-99c2-55da7c4d1ad8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:44.155005 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0bed8-9785-4bda-adbe-12ae61e9c8af None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:44.158755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6b158-6594-4683-870d-66c43275cb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:44.159722 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6b158-6594-4683-870d-66c43275cb2f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:44.160240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6b158-6594-4683-870d-66c43275cb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:44.160736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6b158-6594-4683-870d-66c43275cb2f None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:44.161750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6b158-6594-4683-870d-66c43275cb2f None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:44.162454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6b158-6594-4683-870d-66c43275cb2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:44.164514 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6b158-6594-4683-870d-66c43275cb2f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:44.175052 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 221/433] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:01:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:44.176120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6b158-6594-4683-870d-66c43275cb2f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:44.196428 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ccf96-5551-4fd4-841a-65d2b7fa92f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:44.197639 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ccf96-5551-4fd4-841a-65d2b7fa92f8 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:44.197934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ccf96-5551-4fd4-841a-65d2b7fa92f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:44.198234 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ccf96-5551-4fd4-841a-65d2b7fa92f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:44.199082 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ccf96-5551-4fd4-841a-65d2b7fa92f8 None admin] RBAC: Adding query filter params (group.id=358ad776e6bd4b4aa89eedce06cf830a, role.id=639e5e5307f34a64a854cfb59086518e, scope.project.id=ace9baa6f68746d49a7c11b95f550e58) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:44.199401 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ccf96-5551-4fd4-841a-65d2b7fa92f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:44.200826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ccf96-5551-4fd4-841a-65d2b7fa92f8 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:44.203739 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:44.214028 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 213/434] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 12:01:44 2022] GET /identity/v3/role_assignments?group.id=358ad776e6bd4b4aa89eedce06cf830a&scope.project.id=ace9baa6f68746d49a7c11b95f550e58&role.id=639e5e5307f34a64a854cfb59086518e => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:44.214028 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ccf96-5551-4fd4-841a-65d2b7fa92f8 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:44.370814 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6b158-6594-4683-870d-66c43275cb2f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:44.411934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f20e3-a9c5-4eda-97c6-c0e5b0cb1b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:44.413148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f20e3-a9c5-4eda-97c6-c0e5b0cb1b49 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:44.413636 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f20e3-a9c5-4eda-97c6-c0e5b0cb1b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:44.414271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f20e3-a9c5-4eda-97c6-c0e5b0cb1b49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:44.415339 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f20e3-a9c5-4eda-97c6-c0e5b0cb1b49 None admin] RBAC: Adding query filter params (group.id=358ad776e6bd4b4aa89eedce06cf830a, role.id=ae11679806844c6f8d55ce5ccb32ee8b, scope.project.id=ace9baa6f68746d49a7c11b95f550e58) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:44.415905 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f20e3-a9c5-4eda-97c6-c0e5b0cb1b49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:44.417870 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f20e3-a9c5-4eda-97c6-c0e5b0cb1b49 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:44.426343 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 222/435] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 12:01:44 2022] GET /identity/v3/role_assignments?group.id=358ad776e6bd4b4aa89eedce06cf830a&scope.project.id=ace9baa6f68746d49a7c11b95f550e58&role.id=ae11679806844c6f8d55ce5ccb32ee8b => generated 611 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:44.432096 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ccf96-5551-4fd4-841a-65d2b7fa92f8 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:44.470655 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:44.485041 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5229a6-3582-4276-a1f3-a4ad55524e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:44.485712 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5229a6-3582-4276-a1f3-a4ad55524e3f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:44.486059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5229a6-3582-4276-a1f3-a4ad55524e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:44.486308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5229a6-3582-4276-a1f3-a4ad55524e3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:44.504652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af333b7-0a00-41cc-88de-3cf47d2bfa00 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:44.504945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af333b7-0a00-41cc-88de-3cf47d2bfa00 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:44.505367 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af333b7-0a00-41cc-88de-3cf47d2bfa00 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:44.507060 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 223/436] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:01:44.523531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523034a-dd42-4b6e-9834-18f89a1fc2c0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:44.523831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523034a-dd42-4b6e-9834-18f89a1fc2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:44.524095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523034a-dd42-4b6e-9834-18f89a1fc2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:44.544478 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4523034a-dd42-4b6e-9834-18f89a1fc2c0 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:44.545714 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4523034a-dd42-4b6e-9834-18f89a1fc2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:44.579263 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5229a6-3582-4276-a1f3-a4ad55524e3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:44.581143 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5229a6-3582-4276-a1f3-a4ad55524e3f None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:44.636178 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 224/437] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:44.659223 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523034a-dd42-4b6e-9834-18f89a1fc2c0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:44.672664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:44.706388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 214/438] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:44.713884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a1fc1-cd29-42cb-86e3-bab7763d49b1 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:44.714268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a1fc1-cd29-42cb-86e3-bab7763d49b1 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:44.714546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a1fc1-cd29-42cb-86e3-bab7763d49b1 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:44.716138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 215/439] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:01:44.716843 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a1fc1-cd29-42cb-86e3-bab7763d49b1 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:44.747723 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:44.785963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523034a-dd42-4b6e-9834-18f89a1fc2c0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:44.827624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08308314-ded5-4a0d-b0eb-5767cbf129f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:44.828768 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08308314-ded5-4a0d-b0eb-5767cbf129f8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:44.829061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08308314-ded5-4a0d-b0eb-5767cbf129f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:44.829615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08308314-ded5-4a0d-b0eb-5767cbf129f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:44.841044 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a1fc1-cd29-42cb-86e3-bab7763d49b1 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:44.842072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08308314-ded5-4a0d-b0eb-5767cbf129f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:44.850513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-08308314-ded5-4a0d-b0eb-5767cbf129f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:44.850513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:44.850513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:44.850513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:44.850513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:44.850513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:44.850513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:44.850513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:44.850513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:44.850513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:44.850513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:44.850513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:44.850513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:44.850513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:44.850513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:44.850513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:44.851562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:44.851562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:44.851562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:44.851562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:44.851562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:44.851562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:44.851562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:44.851562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:44.851562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:44.851562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:44.851562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:44.851562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:44.851562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:44.851562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:44.851562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:44.851562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:44.852435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:44.852435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:44.852435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:44.852435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:44.852435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:44.852435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:44.852435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:44.852435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:44.852435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:44.852435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:44.852435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:44.852435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:44.852435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 225/440] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:01:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:01:44.853841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854669f-8c7f-4ca1-b0c5-bf411189dbd0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:44.854153 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854669f-8c7f-4ca1-b0c5-bf411189dbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:44.854428 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854669f-8c7f-4ca1-b0c5-bf411189dbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:44.875413 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5854669f-8c7f-4ca1-b0c5-bf411189dbd0 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:44.876609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5854669f-8c7f-4ca1-b0c5-bf411189dbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:44.887900 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0894875-55e3-4270-a400-46b57c680698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:44.889129 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0894875-55e3-4270-a400-46b57c680698 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:44.889422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0894875-55e3-4270-a400-46b57c680698 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:44.889690 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0894875-55e3-4270-a400-46b57c680698 None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:44.891241 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0894875-55e3-4270-a400-46b57c680698 None admin] RBAC: Authorizing `identity:get_project(project_id=54b0a661962441ba8877bf383738e206)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:44.892682 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0894875-55e3-4270-a400-46b57c680698 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:44.894725 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 216/441] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:44 2022] GET /identity/v3/projects/54b0a661962441ba8877bf383738e206 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:44.895590 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0894875-55e3-4270-a400-46b57c680698 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:44.954646 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:44.961290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 226/442] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:44.962181 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854669f-8c7f-4ca1-b0c5-bf411189dbd0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:45.016759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:45.024526 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0894875-55e3-4270-a400-46b57c680698 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:45.064425 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d0530-8741-4d30-970f-5ec35171c9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:45.065092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d0530-8741-4d30-970f-5ec35171c9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:45.065375 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d0530-8741-4d30-970f-5ec35171c9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:45.065651 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d0530-8741-4d30-970f-5ec35171c9f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:45.066439 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d0530-8741-4d30-970f-5ec35171c9f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:45.066750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d0530-8741-4d30-970f-5ec35171c9f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:45.068118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d0530-8741-4d30-970f-5ec35171c9f1 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:45.076136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 217/443] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:01:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:45.077004 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854669f-8c7f-4ca1-b0c5-bf411189dbd0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:45.077109 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d0530-8741-4d30-970f-5ec35171c9f1 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:45.112320 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d9f43-8a7d-4183-a8a7-bc3675d3390c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:45.113265 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d9f43-8a7d-4183-a8a7-bc3675d3390c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:45.113551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d9f43-8a7d-4183-a8a7-bc3675d3390c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:45.113823 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d9f43-8a7d-4183-a8a7-bc3675d3390c None admin] PATH_INFO: `/v3/groups/358ad776e6bd4b4aa89eedce06cf830a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:45.115022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d9f43-8a7d-4183-a8a7-bc3675d3390c None admin] RBAC: Authorizing `identity:get_group(group_id=358ad776e6bd4b4aa89eedce06cf830a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:45.116456 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d9f43-8a7d-4183-a8a7-bc3675d3390c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:45.118088 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 227/444] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 12:01:44 2022] GET /identity/v3/groups/358ad776e6bd4b4aa89eedce06cf830a => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:45.118839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d9f43-8a7d-4183-a8a7-bc3675d3390c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:45.176718 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d0530-8741-4d30-970f-5ec35171c9f1 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:45.183463 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:45.209125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76810b1-5785-4094-b242-922156ef604f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:45.209905 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76810b1-5785-4094-b242-922156ef604f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:45.210229 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76810b1-5785-4094-b242-922156ef604f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:45.210504 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76810b1-5785-4094-b242-922156ef604f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:45.216128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d9f43-8a7d-4183-a8a7-bc3675d3390c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:45.220927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76810b1-5785-4094-b242-922156ef604f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:45.229070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-e76810b1-5785-4094-b242-922156ef604f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:01:45.229070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:45.229070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:45.229070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:45.229070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:45.229070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:45.229070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:45.229070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:45.229070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:45.229070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:45.229070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:45.229070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:45.229070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:45.229070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:45.229070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:45.229070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:45.229963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:45.229963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:45.229963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:45.229963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:45.229963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:45.229963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:45.229963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:45.229963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:45.229963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:45.229963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:45.229963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:45.229963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:45.229963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:45.229963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:45.229963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:45.229963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:45.230835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:45.230835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:45.230835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:45.230835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:45.230835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:45.230835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:45.230835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:45.230835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:45.230835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:45.230835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:45.230835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:01:45.230835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:45.230835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 218/445] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:01:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:45.231484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76810b1-5785-4094-b242-922156ef604f None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:45.248553 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:45.252633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92948288-def8-4594-9ed2-e003f7427f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:45.253295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92948288-def8-4594-9ed2-e003f7427f70 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:45.253572 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92948288-def8-4594-9ed2-e003f7427f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:45.253842 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92948288-def8-4594-9ed2-e003f7427f70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:45.319462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92948288-def8-4594-9ed2-e003f7427f70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:45.321071 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92948288-def8-4594-9ed2-e003f7427f70 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:45.330763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76810b1-5785-4094-b242-922156ef604f None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:45.363598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0fb7a-1bbf-4cf8-bb83-b7b5827d83e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:45.364236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0fb7a-1bbf-4cf8-bb83-b7b5827d83e7 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:45.364520 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0fb7a-1bbf-4cf8-bb83-b7b5827d83e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:45.364798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0fb7a-1bbf-4cf8-bb83-b7b5827d83e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:45.365628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0fb7a-1bbf-4cf8-bb83-b7b5827d83e7 None admin] RBAC: Adding query filter params (group.id=358ad776e6bd4b4aa89eedce06cf830a, role.id=ae11679806844c6f8d55ce5ccb32ee8b, scope.project.id=54b0a661962441ba8877bf383738e206) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:45.365941 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0fb7a-1bbf-4cf8-bb83-b7b5827d83e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:45.367374 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0fb7a-1bbf-4cf8-bb83-b7b5827d83e7 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:45.373258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 219/446] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 12:01:45 2022] GET /identity/v3/role_assignments?group.id=358ad776e6bd4b4aa89eedce06cf830a&scope.project.id=54b0a661962441ba8877bf383738e206&role.id=ae11679806844c6f8d55ce5ccb32ee8b => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:45.374185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0fb7a-1bbf-4cf8-bb83-b7b5827d83e7 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:45.386805 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:45.430195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 228/447] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:45.431487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92948288-def8-4594-9ed2-e003f7427f70 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:45.473052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:45.496114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0fb7a-1bbf-4cf8-bb83-b7b5827d83e7 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:45.536912 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23acd4-a05c-41dd-9a4d-cf0abab00bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:45.536912 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23acd4-a05c-41dd-9a4d-cf0abab00bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:45.537227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23acd4-a05c-41dd-9a4d-cf0abab00bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:45.537377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23acd4-a05c-41dd-9a4d-cf0abab00bd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:45.538617 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23acd4-a05c-41dd-9a4d-cf0abab00bd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:45.538617 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23acd4-a05c-41dd-9a4d-cf0abab00bd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:45.539823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23acd4-a05c-41dd-9a4d-cf0abab00bd2 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:45.549649 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 220/448] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:45.552455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92948288-def8-4594-9ed2-e003f7427f70 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:45.555710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23acd4-a05c-41dd-9a4d-cf0abab00bd2 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:45.588967 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716f2b6-16d1-4b18-8f7e-bfe4fd562da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:45.589828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716f2b6-16d1-4b18-8f7e-bfe4fd562da4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:45.590143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716f2b6-16d1-4b18-8f7e-bfe4fd562da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:45.590415 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716f2b6-16d1-4b18-8f7e-bfe4fd562da4 None admin] PATH_INFO: `/v3/projects/54b0a661962441ba8877bf383738e206` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:45.591697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716f2b6-16d1-4b18-8f7e-bfe4fd562da4 None admin] RBAC: Authorizing `identity:get_project(project_id=54b0a661962441ba8877bf383738e206)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:45.593153 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716f2b6-16d1-4b18-8f7e-bfe4fd562da4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:45.595102 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 229/449] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:45 2022] GET /identity/v3/projects/54b0a661962441ba8877bf383738e206 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:45.602323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716f2b6-16d1-4b18-8f7e-bfe4fd562da4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:45.640354 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:45.680270 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23acd4-a05c-41dd-9a4d-cf0abab00bd2 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:45.719724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716f2b6-16d1-4b18-8f7e-bfe4fd562da4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:45.723335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567656b-6bc5-47a3-a724-29a59dc1251c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:45.724198 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567656b-6bc5-47a3-a724-29a59dc1251c None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:45.724688 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567656b-6bc5-47a3-a724-29a59dc1251c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:45.725152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567656b-6bc5-47a3-a724-29a59dc1251c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:45.739962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:45.757254 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8a6d2-8168-4a74-9d87-890107b15cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:45.758149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a6d2-8168-4a74-9d87-890107b15cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:45.758430 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a6d2-8168-4a74-9d87-890107b15cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:45.758700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a6d2-8168-4a74-9d87-890107b15cd1 None admin] PATH_INFO: `/v3/groups/358ad776e6bd4b4aa89eedce06cf830a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:45.760434 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8a6d2-8168-4a74-9d87-890107b15cd1 None admin] RBAC: Authorizing `identity:get_group(group_id=358ad776e6bd4b4aa89eedce06cf830a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:45.761874 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8a6d2-8168-4a74-9d87-890107b15cd1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:45.763523 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 230/450] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 12:01:45 2022] GET /identity/v3/groups/358ad776e6bd4b4aa89eedce06cf830a => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:45.769158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8a6d2-8168-4a74-9d87-890107b15cd1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:45.800053 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567656b-6bc5-47a3-a724-29a59dc1251c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:45.801484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567656b-6bc5-47a3-a724-29a59dc1251c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:45.866398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8a6d2-8168-4a74-9d87-890107b15cd1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:45.868639 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:45.901018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6531cba-57d5-4849-8074-6a98f229af02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:45.901665 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6531cba-57d5-4849-8074-6a98f229af02 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:45.901947 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6531cba-57d5-4849-8074-6a98f229af02 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:45.902252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6531cba-57d5-4849-8074-6a98f229af02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:45.903081 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6531cba-57d5-4849-8074-6a98f229af02 None admin] RBAC: Adding query filter params (group.id=358ad776e6bd4b4aa89eedce06cf830a, role.id=639e5e5307f34a64a854cfb59086518e, scope.project.id=54b0a661962441ba8877bf383738e206) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:45.903391 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6531cba-57d5-4849-8074-6a98f229af02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:45.904061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 221/451] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:45.909276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6531cba-57d5-4849-8074-6a98f229af02 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:45.909698 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567656b-6bc5-47a3-a724-29a59dc1251c None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:45.910858 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 231/452] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 12:01:45 2022] GET /identity/v3/role_assignments?group.id=358ad776e6bd4b4aa89eedce06cf830a&scope.project.id=54b0a661962441ba8877bf383738e206&role.id=639e5e5307f34a64a854cfb59086518e => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:45.955867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:46.016460 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567656b-6bc5-47a3-a724-29a59dc1251c None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:46.051639 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da5bca-e563-46fc-bbd5-0ef3342013b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:46.052503 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da5bca-e563-46fc-bbd5-0ef3342013b9 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:46.052790 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da5bca-e563-46fc-bbd5-0ef3342013b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:46.053068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da5bca-e563-46fc-bbd5-0ef3342013b9 None admin] PATH_INFO: `/v3/projects/41f6b44ea8df423598fdb5ab7cad5172` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:46.054302 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da5bca-e563-46fc-bbd5-0ef3342013b9 None admin] RBAC: Authorizing `identity:get_project(project_id=41f6b44ea8df423598fdb5ab7cad5172)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:46.055738 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da5bca-e563-46fc-bbd5-0ef3342013b9 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:46.057992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 222/453] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:01:45 2022] GET /identity/v3/projects/41f6b44ea8df423598fdb5ab7cad5172 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:46.063641 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6531cba-57d5-4849-8074-6a98f229af02 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:46.168007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6531cba-57d5-4849-8074-6a98f229af02 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:46.202440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbce7b1-803b-4dbe-bae6-997477e8007f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:46.203291 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbce7b1-803b-4dbe-bae6-997477e8007f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:46.203566 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbce7b1-803b-4dbe-bae6-997477e8007f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:46.203833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbce7b1-803b-4dbe-bae6-997477e8007f None admin] PATH_INFO: `/v3/groups/ae8cab256b624789b0784665e084bf12` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:46.204997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbce7b1-803b-4dbe-bae6-997477e8007f None admin] RBAC: Authorizing `identity:get_group(group_id=ae8cab256b624789b0784665e084bf12)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:46.206466 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbce7b1-803b-4dbe-bae6-997477e8007f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:46.208061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 232/454] 10.222.0.48 () {56 vars in 1180 bytes} [Mon Jul 25 12:01:46 2022] GET /identity/v3/groups/ae8cab256b624789b0784665e084bf12 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:46.214075 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da5bca-e563-46fc-bbd5-0ef3342013b9 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:46.313826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da5bca-e563-46fc-bbd5-0ef3342013b9 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:46.323944 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:46.346098 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d609c7c-7c83-4529-9fec-58b7a32e155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:46.346736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d609c7c-7c83-4529-9fec-58b7a32e155b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:46.347015 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d609c7c-7c83-4529-9fec-58b7a32e155b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:46.347284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d609c7c-7c83-4529-9fec-58b7a32e155b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:46.348104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d609c7c-7c83-4529-9fec-58b7a32e155b None admin] RBAC: Adding query filter params (group.id=ae8cab256b624789b0784665e084bf12, role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.project.id=41f6b44ea8df423598fdb5ab7cad5172) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:46.348410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d609c7c-7c83-4529-9fec-58b7a32e155b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:46.349810 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d609c7c-7c83-4529-9fec-58b7a32e155b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:46.355919 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 223/455] 10.222.0.48 () {56 vars in 1376 bytes} [Mon Jul 25 12:01:46 2022] GET /identity/v3/role_assignments?group.id=ae8cab256b624789b0784665e084bf12&scope.project.id=41f6b44ea8df423598fdb5ab7cad5172&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:48.645329 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b56a4f-65cf-44cf-85c9-4da2e91a816b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:48.646355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b56a4f-65cf-44cf-85c9-4da2e91a816b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:48.646837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b56a4f-65cf-44cf-85c9-4da2e91a816b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:48.648643 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 233/456] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:48.654179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063898e-eb3a-4704-9533-563c1edfb375 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:48.654971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063898e-eb3a-4704-9533-563c1edfb375 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:48.655537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063898e-eb3a-4704-9533-563c1edfb375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:48.679037 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-9063898e-eb3a-4704-9533-563c1edfb375 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:48.680231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-9063898e-eb3a-4704-9533-563c1edfb375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:48.760917 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 224/457] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:01:48.797543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b56a4f-65cf-44cf-85c9-4da2e91a816b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:48.849756 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:48.935694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b56a4f-65cf-44cf-85c9-4da2e91a816b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:48.979427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30f7e8-8892-4cc6-8517-d636696f9e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:48.980227 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30f7e8-8892-4cc6-8517-d636696f9e84 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:48.980510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30f7e8-8892-4cc6-8517-d636696f9e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:48.980787 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30f7e8-8892-4cc6-8517-d636696f9e84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:48.996592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30f7e8-8892-4cc6-8517-d636696f9e84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:48.998087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30f7e8-8892-4cc6-8517-d636696f9e84 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:49.020013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2e30f7e8-8892-4cc6-8517-d636696f9e84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:49.020013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:49.020013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:49.020013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:49.020013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:49.020013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:49.020013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:49.020013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:49.020013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:49.020013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:49.020013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:49.020013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:49.020013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:01:49.020013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:01:49.020013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:01:49.020873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:01:49.020873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:49.020873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:49.020873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:49.020873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:49.020873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:49.020873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:49.020873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:49.020873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:49.020873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:49.020873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:49.020873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:49.020873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:49.020873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:49.020873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:49.020873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:49.020873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:49.021689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:01:49.021689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:01:49.021689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:49.021689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:49.021689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 234/458] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:49.031109 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063898e-eb3a-4704-9533-563c1edfb375 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:49.194594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43d71c-38af-4fc0-a60a-afd4de3b6fa2 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:49.194805 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063898e-eb3a-4704-9533-563c1edfb375 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:49.194903 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43d71c-38af-4fc0-a60a-afd4de3b6fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:49.195170 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43d71c-38af-4fc0-a60a-afd4de3b6fa2 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:49.196544 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 235/459] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:49.198315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:49.202248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e008c-6fcf-4900-802b-663147162e00 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:49.202536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e008c-6fcf-4900-802b-663147162e00 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:49.202813 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e008c-6fcf-4900-802b-663147162e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:49.236243 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-584e008c-6fcf-4900-802b-663147162e00 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:49.237427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-584e008c-6fcf-4900-802b-663147162e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:49.256508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6931ec4-1a92-418c-80c7-e440703d6527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:49.257168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6931ec4-1a92-418c-80c7-e440703d6527 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:49.257448 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6931ec4-1a92-418c-80c7-e440703d6527 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:49.257717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6931ec4-1a92-418c-80c7-e440703d6527 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:49.258473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6931ec4-1a92-418c-80c7-e440703d6527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:49.258772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6931ec4-1a92-418c-80c7-e440703d6527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:49.260178 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6931ec4-1a92-418c-80c7-e440703d6527 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:49.272462 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 225/460] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:49.277963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6931ec4-1a92-418c-80c7-e440703d6527 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:49.356681 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 236/461] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:49.367129 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaee53a-9687-4413-83dc-1cb02cd2cdf9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:49.367672 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaee53a-9687-4413-83dc-1cb02cd2cdf9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:49.368151 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaee53a-9687-4413-83dc-1cb02cd2cdf9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:49.370468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 237/462] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:49 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:49.377038 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83317121-ac49-4ded-b3ec-dbb2ff1e50d8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:49.377544 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83317121-ac49-4ded-b3ec-dbb2ff1e50d8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:49.377990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83317121-ac49-4ded-b3ec-dbb2ff1e50d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:49.405173 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-83317121-ac49-4ded-b3ec-dbb2ff1e50d8 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:49.406736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-83317121-ac49-4ded-b3ec-dbb2ff1e50d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:49.410591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6931ec4-1a92-418c-80c7-e440703d6527 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:49.421744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:49.452188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e900a0-942a-42bf-bf5a-99636d5669f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:49.452865 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e900a0-942a-42bf-bf5a-99636d5669f1 None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:49.453143 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e900a0-942a-42bf-bf5a-99636d5669f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:49.453416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e900a0-942a-42bf-bf5a-99636d5669f1 None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:49.454166 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e900a0-942a-42bf-bf5a-99636d5669f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:49.455593 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e900a0-942a-42bf-bf5a-99636d5669f1 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:49.490239 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 226/463] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 12:01:49 2022] POST /identity/v3/users => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:01:49.490239 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e900a0-942a-42bf-bf5a-99636d5669f1 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:49.516397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 238/464] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:01:49.536624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:49.581383 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83317121-ac49-4ded-b3ec-dbb2ff1e50d8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:49.701493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e900a0-942a-42bf-bf5a-99636d5669f1 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:49.755800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33858f83-bc13-43d9-bfe3-00c2dcabeb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:49.756603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33858f83-bc13-43d9-bfe3-00c2dcabeb4f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:49.756891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33858f83-bc13-43d9-bfe3-00c2dcabeb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:49.757169 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33858f83-bc13-43d9-bfe3-00c2dcabeb4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:49.770154 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83317121-ac49-4ded-b3ec-dbb2ff1e50d8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:49.773153 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33858f83-bc13-43d9-bfe3-00c2dcabeb4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:49.774769 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33858f83-bc13-43d9-bfe3-00c2dcabeb4f None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:49.793909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-33858f83-bc13-43d9-bfe3-00c2dcabeb4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:49.793909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:49.793909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:49.793909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:49.793909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:49.793909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:49.793909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:49.793909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:49.793909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:49.793909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:49.793909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:49.793909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:49.793909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:01:49.793909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:01:49.793909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:01:49.794804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:01:49.794804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:49.794804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:49.794804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:49.794804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:49.794804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:49.794804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:49.794804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:49.794804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:49.794804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:49.794804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:49.794804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:49.794804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:49.794804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:49.794804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:49.794804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:49.794804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:49.795615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:01:49.795615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:01:49.795615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:49.795615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:49.795615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 227/465] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:49.796764 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930776d-23ae-4259-ab2d-a82cb9e1f7b7 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:49.797057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930776d-23ae-4259-ab2d-a82cb9e1f7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:49.797335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930776d-23ae-4259-ab2d-a82cb9e1f7b7 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:49.802083 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 228/466] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:49.803331 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930776d-23ae-4259-ab2d-a82cb9e1f7b7 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:49.820009 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6d06a-078a-42c3-8210-e07c222bbb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:49.820816 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6d06a-078a-42c3-8210-e07c222bbb24 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:49.821100 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6d06a-078a-42c3-8210-e07c222bbb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:49.821379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6d06a-078a-42c3-8210-e07c222bbb24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:49.833752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6d06a-078a-42c3-8210-e07c222bbb24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:49.835291 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6d06a-078a-42c3-8210-e07c222bbb24 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:49.846128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:49.858964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b4a6d06a-078a-42c3-8210-e07c222bbb24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:49.858964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:49.858964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:49.858964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:49.858964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:49.858964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:49.858964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:49.858964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:49.858964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:49.858964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:49.858964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:49.858964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:49.858964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:01:49.858964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:01:49.858964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:01:49.859827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:01:49.859827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:49.859827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:49.859827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:49.859827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:49.859827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:49.859827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:49.859827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:49.859827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:49.859827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:49.859827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:49.859827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:49.859827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:49.859827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:49.859827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:49.859827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:49.859827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:49.860651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:01:49.860651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:01:49.860651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:49.860651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:49.863397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 239/467] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:01:49.864427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88881c48-5af4-4ad4-8254-fea085ab11b6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:49.864707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88881c48-5af4-4ad4-8254-fea085ab11b6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:49.864974 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88881c48-5af4-4ad4-8254-fea085ab11b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:49.883099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:49.884341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-88881c48-5af4-4ad4-8254-fea085ab11b6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:49.885627 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-88881c48-5af4-4ad4-8254-fea085ab11b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:49.918851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930776d-23ae-4259-ab2d-a82cb9e1f7b7 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:49.956504 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac1de7-3f68-4db9-ae06-a3a673cd0d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:49.957173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac1de7-3f68-4db9-ae06-a3a673cd0d1a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:49.966060 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac1de7-3f68-4db9-ae06-a3a673cd0d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:49.966232 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 240/468] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:49.966318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac1de7-3f68-4db9-ae06-a3a673cd0d1a None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:49.966318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac1de7-3f68-4db9-ae06-a3a673cd0d1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:49.966318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac1de7-3f68-4db9-ae06-a3a673cd0d1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:49.966525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bb9e6-367e-4942-b1f0-56856b7b5445 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:49.966525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bb9e6-367e-4942-b1f0-56856b7b5445 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:49.966525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bb9e6-367e-4942-b1f0-56856b7b5445 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:49.966686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac1de7-3f68-4db9-ae06-a3a673cd0d1a None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:49.966757 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 241/469] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:49.966757 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bb9e6-367e-4942-b1f0-56856b7b5445 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:49.981419 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 229/470] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:49.981419 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a41be-6656-48c1-b1e2-c9ecc925d381 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:49.981419 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a41be-6656-48c1-b1e2-c9ecc925d381 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:49.981419 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a41be-6656-48c1-b1e2-c9ecc925d381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:49.998959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-d01a41be-6656-48c1-b1e2-c9ecc925d381 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:50.000166 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d01a41be-6656-48c1-b1e2-c9ecc925d381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:50.070789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 230/471] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:50.071532 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a41be-6656-48c1-b1e2-c9ecc925d381 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:50.083882 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bb9e6-367e-4942-b1f0-56856b7b5445 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:50.114207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:50.126028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da15a2-d7ea-44ec-be25-a6972a671516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:50.126028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da15a2-d7ea-44ec-be25-a6972a671516 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:50.126028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da15a2-d7ea-44ec-be25-a6972a671516 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:50.126028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da15a2-d7ea-44ec-be25-a6972a671516 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:50.126433 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da15a2-d7ea-44ec-be25-a6972a671516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:50.126433 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da15a2-d7ea-44ec-be25-a6972a671516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:50.127762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da15a2-d7ea-44ec-be25-a6972a671516 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:50.150829 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 242/472] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:50.150829 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da15a2-d7ea-44ec-be25-a6972a671516 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:50.154527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:50.198459 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a41be-6656-48c1-b1e2-c9ecc925d381 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:50.237736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210061d-5976-40a1-9708-5a8dd62f2d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:50.238442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210061d-5976-40a1-9708-5a8dd62f2d42 None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:50.238742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210061d-5976-40a1-9708-5a8dd62f2d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:50.239002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210061d-5976-40a1-9708-5a8dd62f2d42 None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:50.239711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210061d-5976-40a1-9708-5a8dd62f2d42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:50.241143 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210061d-5976-40a1-9708-5a8dd62f2d42 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:50.257182 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da15a2-d7ea-44ec-be25-a6972a671516 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:50.274038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 231/473] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 12:01:50 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:01:50.274038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210061d-5976-40a1-9708-5a8dd62f2d42 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:50.304702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf058d2-f2c4-496c-aaea-72aff78b1b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:50.305577 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf058d2-f2c4-496c-aaea-72aff78b1b4e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:50.305861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf058d2-f2c4-496c-aaea-72aff78b1b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:50.306177 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf058d2-f2c4-496c-aaea-72aff78b1b4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:50.321960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf058d2-f2c4-496c-aaea-72aff78b1b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:50.323798 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf058d2-f2c4-496c-aaea-72aff78b1b4e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:50.349435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fdf058d2-f2c4-496c-aaea-72aff78b1b4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:50.349435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:50.349435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:50.349435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:50.349435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:50.349435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:50.349435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:50.349435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:50.349435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:50.349435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:50.349435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:50.349435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:50.349435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:01:50.349435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:01:50.349435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:01:50.350513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:01:50.350513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:50.350513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:50.350513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:50.350513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:50.350513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:50.350513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:50.350513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:50.350513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:50.350513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:50.350513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:50.350513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:50.350513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:50.350513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:50.350513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:50.350513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:50.350513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:50.351334 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:01:50.351334 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:01:50.351334 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:50.351334 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:50.352114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 243/474] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:50.352260 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf058d2-f2c4-496c-aaea-72aff78b1b4e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:50.414390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:50.415143 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210061d-5976-40a1-9708-5a8dd62f2d42 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:50.444456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:50.479702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc4ffa-1bb8-4f6a-8fe7-e87f5442d57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:50.480102 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc4ffa-1bb8-4f6a-8fe7-e87f5442d57e None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:50.480385 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc4ffa-1bb8-4f6a-8fe7-e87f5442d57e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:50.480661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc4ffa-1bb8-4f6a-8fe7-e87f5442d57e None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:50.482063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc4ffa-1bb8-4f6a-8fe7-e87f5442d57e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:50.483079 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc4ffa-1bb8-4f6a-8fe7-e87f5442d57e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:50.489444 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf058d2-f2c4-496c-aaea-72aff78b1b4e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:50.497722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.sql.core [None req-b4dc4ffa-1bb8-4f6a-8fe7-e87f5442d57e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 12:01:50.497722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 12:01:50.497722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [parameters: {'id': '84cab6fd1a0e4c68bcaf060f45b51499', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 12:01:50.497722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80317) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 12:01:50.517955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-b4dc4ffa-1bb8-4f6a-8fe7-e87f5442d57e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 12:01:50.517955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:50.517955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 12:01:50.517955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 12:01:50.517955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 12:01:50.517955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 12:01:50.517955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 12:01:50.517955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 12:01:50.517955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 12:01:50.517955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application conn.query(q) Jul 25 12:01:50.517955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 12:01:50.517955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 12:01:50.517955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 12:01:50.517955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application result.read() Jul 25 12:01:50.517955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 12:01:50.518985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 12:01:50.518985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 12:01:50.518985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 12:01:50.518985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 12:01:50.518985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 12:01:50.518985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 12:01:50.518985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 12:01:50.518985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 12:01:50.518985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:50.518985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 12:01:50.518985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:50.518985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:50.518985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 12:01:50.518985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 12:01:50.518985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 25 12:01:50.518985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return ref.to_dict() Jul 25 12:01:50.518985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 12:01:50.518985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application next(self.gen) Jul 25 12:01:50.519932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 12:01:50.519932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application yield resource Jul 25 12:01:50.519932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 12:01:50.519932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application next(self.gen) Jul 25 12:01:50.519932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 12:01:50.519932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 12:01:50.519932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:01:50.519932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 12:01:50.519932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:01:50.519932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise self.value Jul 25 12:01:50.519932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 12:01:50.519932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 12:01:50.519932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 12:01:50.519932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application session.commit() Jul 25 12:01:50.519932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 12:01:50.519932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 12:01:50.519932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 12:01:50.520909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 12:01:50.520909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 12:01:50.520909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self.session.flush() Jul 25 12:01:50.520909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 12:01:50.520909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 12:01:50.520909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 12:01:50.520909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 12:01:50.520909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 12:01:50.520909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application compat.raise_( Jul 25 12:01:50.520909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 12:01:50.520909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception Jul 25 12:01:50.520909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 12:01:50.520909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 12:01:50.520909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 12:01:50.520909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 12:01:50.520909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 12:01:50.520909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 12:01:50.521949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 12:01:50.521949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 12:01:50.521949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 12:01:50.521949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 12:01:50.521949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 12:01:50.521949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 12:01:50.521949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 12:01:50.521949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 12:01:50.521949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 12:01:50.521949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 12:01:50.521949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 12:01:50.521949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 12:01:50.521949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 12:01:50.521949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 12:01:50.521949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 12:01:50.521949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception Jul 25 12:01:50.522846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 12:01:50.522846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 12:01:50.522846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 12:01:50.522846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 12:01:50.522846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 12:01:50.522846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 12:01:50.522846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 12:01:50.522846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application conn.query(q) Jul 25 12:01:50.522846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 12:01:50.522846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 12:01:50.522846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 12:01:50.522846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application result.read() Jul 25 12:01:50.522846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 12:01:50.522846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 12:01:50.522846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 12:01:50.522846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 12:01:50.523779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 12:01:50.523779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 12:01:50.523779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 12:01:50.523779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 12:01:50.523779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 12:01:50.523779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 12:01:50.523779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [parameters: {'id': '84cab6fd1a0e4c68bcaf060f45b51499', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 12:01:50.523779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 12:01:50.523779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:50.523779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:01:50.523779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:50.523779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:50.523779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:50.523779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:50.523779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:50.523779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:50.524717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:50.524717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:50.524717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:50.524717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:50.524717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:50.524717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:50.524717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 25 12:01:50.524717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 25 12:01:50.524717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:50.524717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:50.524717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 25 12:01:50.524717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 25 12:01:50.524717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 12:01:50.524717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 12:01:50.524717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 12:01:50.524717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:50.526312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 232/475] 10.222.0.48 () {60 vars in 1131 bytes} [Mon Jul 25 12:01:50 2022] POST /identity/v3/roles => generated 144 bytes in 255 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:50.526312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc4ffa-1bb8-4f6a-8fe7-e87f5442d57e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:50.540039 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b700a-d843-4110-83f5-b2df939b91c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:50.541124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b700a-d843-4110-83f5-b2df939b91c7 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:50.541568 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b700a-d843-4110-83f5-b2df939b91c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:50.542290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b700a-d843-4110-83f5-b2df939b91c7 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:50.543150 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b700a-d843-4110-83f5-b2df939b91c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:50.544777 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b700a-d843-4110-83f5-b2df939b91c7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:50.571065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 244/476] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 12:01:50 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:01:50.572851 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b700a-d843-4110-83f5-b2df939b91c7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:50.670876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc4ffa-1bb8-4f6a-8fe7-e87f5442d57e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:50.745567 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8df01-8c00-4df6-ba09-41841c6b0842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:50.746273 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8df01-8c00-4df6-ba09-41841c6b0842 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:50.746620 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8df01-8c00-4df6-ba09-41841c6b0842 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:50.746903 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8df01-8c00-4df6-ba09-41841c6b0842 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:50.747650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8df01-8c00-4df6-ba09-41841c6b0842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:50.747958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8df01-8c00-4df6-ba09-41841c6b0842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:50.749343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8df01-8c00-4df6-ba09-41841c6b0842 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:50.763678 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:50.765323 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 233/477] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:50.768047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b700a-d843-4110-83f5-b2df939b91c7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:50.771115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8df01-8c00-4df6-ba09-41841c6b0842 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:50.823544 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:50.824300 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc3d3c-8bf8-4ee3-aa88-555ef8dab51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:50.825453 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc3d3c-8bf8-4ee3-aa88-555ef8dab51b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:50.825782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc3d3c-8bf8-4ee3-aa88-555ef8dab51b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:50.826092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc3d3c-8bf8-4ee3-aa88-555ef8dab51b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:50.842261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc3d3c-8bf8-4ee3-aa88-555ef8dab51b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:50.854395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-65fc3d3c-8bf8-4ee3-aa88-555ef8dab51b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:50.854395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:50.854395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:50.854395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:50.854395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:50.854395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:50.854395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:50.854395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:50.854395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:50.854395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:50.854395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:50.854395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:50.854395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:50.854395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:50.854395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:50.854395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:50.855468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:50.855468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:50.855468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:50.855468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:50.855468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:50.855468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:50.855468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:50.855468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:50.855468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:50.855468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:50.855468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:50.855468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:50.855468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:50.855468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:50.855468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:50.855468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:50.856450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:50.856450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:50.856450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:50.856450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:50.856450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:50.856450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:50.856450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:50.856450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:50.856450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:50.856450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:50.856450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:01:50.856450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:50.856450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 245/478] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:01:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:50.863045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc3d3c-8bf8-4ee3-aa88-555ef8dab51b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:50.901594 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8df01-8c00-4df6-ba09-41841c6b0842 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:50.948819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a557d-affb-4269-a0f9-bc59b42804e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:50.949500 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a557d-affb-4269-a0f9-bc59b42804e2 None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:50.949785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a557d-affb-4269-a0f9-bc59b42804e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:50.950087 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a557d-affb-4269-a0f9-bc59b42804e2 None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:50.950816 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a557d-affb-4269-a0f9-bc59b42804e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:50.952311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a557d-affb-4269-a0f9-bc59b42804e2 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:50.986444 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc3d3c-8bf8-4ee3-aa88-555ef8dab51b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:50.986864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 234/479] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 12:01:50 2022] POST /identity/v3/users => generated 249 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:01:51.031207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57c4a0-38b0-4187-a7c3-f2c27020f945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:51.031972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57c4a0-38b0-4187-a7c3-f2c27020f945 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:51.032257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57c4a0-38b0-4187-a7c3-f2c27020f945 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:51.032581 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57c4a0-38b0-4187-a7c3-f2c27020f945 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:51.033409 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57c4a0-38b0-4187-a7c3-f2c27020f945 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:51.033723 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57c4a0-38b0-4187-a7c3-f2c27020f945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:51.035285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57c4a0-38b0-4187-a7c3-f2c27020f945 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:51.048294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 246/480] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:01:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:51.877323 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ed8e4-140b-4437-81ca-410d3454f802 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:51.877839 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ed8e4-140b-4437-81ca-410d3454f802 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:51.877839 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ed8e4-140b-4437-81ca-410d3454f802 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:51.879743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 235/481] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:51.884623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371c8e8-0a79-4022-a6d4-edf3756fadaa None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:51.885416 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371c8e8-0a79-4022-a6d4-edf3756fadaa None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:51.885886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371c8e8-0a79-4022-a6d4-edf3756fadaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:51.910996 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a371c8e8-0a79-4022-a6d4-edf3756fadaa None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:51.912181 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a371c8e8-0a79-4022-a6d4-edf3756fadaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:51.930876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:52.000645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 247/482] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:52.033772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ed8e4-140b-4437-81ca-410d3454f802 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:52.170446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:52.179946 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ed8e4-140b-4437-81ca-410d3454f802 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:52.216862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea5428-0a22-4632-8e66-441615beb8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:52.217671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea5428-0a22-4632-8e66-441615beb8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:52.217957 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea5428-0a22-4632-8e66-441615beb8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:52.218266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea5428-0a22-4632-8e66-441615beb8b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:52.232783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea5428-0a22-4632-8e66-441615beb8b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:52.240820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-73ea5428-0a22-4632-8e66-441615beb8b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:01:52.240820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:52.240820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:52.240820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:52.240820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:52.240820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:52.240820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:52.240820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:52.240820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:52.240820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:52.240820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:52.240820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:52.240820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:52.240820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:52.240820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:52.240820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:52.241701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:52.241701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:52.241701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:52.241701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:52.241701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:52.241701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:52.241701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:52.241701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:52.241701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:52.241701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:52.241701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:52.241701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:52.241701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:52.241701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:52.241701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:52.241701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:52.242496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:52.242496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:52.242496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:52.242496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:52.242496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:52.242496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:52.242496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:52.242496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:52.242496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:52.242496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:52.242496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:01:52.242496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:52.242496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 236/483] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:01:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:52.247773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371c8e8-0a79-4022-a6d4-edf3756fadaa None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:52.410247 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371c8e8-0a79-4022-a6d4-edf3756fadaa None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:52.454875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82ce90-e83a-458d-92e6-d252b6ca16c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:52.455477 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82ce90-e83a-458d-92e6-d252b6ca16c2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:52.455760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82ce90-e83a-458d-92e6-d252b6ca16c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:52.456030 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82ce90-e83a-458d-92e6-d252b6ca16c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:52.456775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82ce90-e83a-458d-92e6-d252b6ca16c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:52.457079 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82ce90-e83a-458d-92e6-d252b6ca16c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:52.458478 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82ce90-e83a-458d-92e6-d252b6ca16c2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:52.469971 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 248/484] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:01:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:52.475137 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea5428-0a22-4632-8e66-441615beb8b2 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:52.617703 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea5428-0a22-4632-8e66-441615beb8b2 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:52.662596 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65306536-efe3-40c6-a85a-9ebec9ae9ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:52.663725 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65306536-efe3-40c6-a85a-9ebec9ae9ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:52.664197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65306536-efe3-40c6-a85a-9ebec9ae9ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:52.664653 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65306536-efe3-40c6-a85a-9ebec9ae9ad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:52.680951 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65306536-efe3-40c6-a85a-9ebec9ae9ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:52.682738 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65306536-efe3-40c6-a85a-9ebec9ae9ad3 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:52.702814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-65306536-efe3-40c6-a85a-9ebec9ae9ad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:52.702814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:52.702814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:52.702814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:52.702814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:52.702814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:52.702814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:52.702814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:52.702814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:52.702814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:52.702814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:52.702814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:52.702814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:01:52.702814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:01:52.702814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:01:52.703700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:01:52.703700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:52.703700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:52.703700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:52.703700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:52.703700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:52.703700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:52.703700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:52.703700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:52.703700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:52.703700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:52.703700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:52.703700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:52.703700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:52.703700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:52.703700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:52.703700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:52.704551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:01:52.704551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:01:52.704551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:52.704551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:52.706357 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 237/485] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:52.712412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82ce90-e83a-458d-92e6-d252b6ca16c2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:52.715082 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa652e4f-a732-4d57-8a48-e5e9972214f3 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:52.715527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa652e4f-a732-4d57-8a48-e5e9972214f3 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:52.716007 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa652e4f-a732-4d57-8a48-e5e9972214f3 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:52.717600 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 238/486] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:01:52.727611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5374f5-78b4-4b9c-936c-42077409ad96 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:52.728131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5374f5-78b4-4b9c-936c-42077409ad96 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:52.728768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5374f5-78b4-4b9c-936c-42077409ad96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:52.735058 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:52.757333 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-9a5374f5-78b4-4b9c-936c-42077409ad96 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:52.758846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-9a5374f5-78b4-4b9c-936c-42077409ad96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:52.767012 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:52.832780 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82ce90-e83a-458d-92e6-d252b6ca16c2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:52.871303 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cce39-e8d7-4433-ae9c-5a08e25887fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:52.872456 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cce39-e8d7-4433-ae9c-5a08e25887fa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:52.873075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cce39-e8d7-4433-ae9c-5a08e25887fa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:52.873450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cce39-e8d7-4433-ae9c-5a08e25887fa None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:52.874304 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cce39-e8d7-4433-ae9c-5a08e25887fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:52.874678 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cce39-e8d7-4433-ae9c-5a08e25887fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:52.876115 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cce39-e8d7-4433-ae9c-5a08e25887fa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:52.889829 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 249/487] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:52.895212 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cce39-e8d7-4433-ae9c-5a08e25887fa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:52.912328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 239/488] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:52.935594 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5374f5-78b4-4b9c-936c-42077409ad96 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:53.035747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:53.095098 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cce39-e8d7-4433-ae9c-5a08e25887fa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:53.109683 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5374f5-78b4-4b9c-936c-42077409ad96 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:53.167714 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214aed4-ac81-4c5e-ab4b-7e2b5096531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:53.169330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214aed4-ac81-4c5e-ab4b-7e2b5096531b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:53.170194 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214aed4-ac81-4c5e-ab4b-7e2b5096531b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:53.171520 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919013b-1475-48dd-8d78-55bcc99f9171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:53.172042 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214aed4-ac81-4c5e-ab4b-7e2b5096531b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:53.173593 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919013b-1475-48dd-8d78-55bcc99f9171 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:53.174269 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919013b-1475-48dd-8d78-55bcc99f9171 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:53.175897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919013b-1475-48dd-8d78-55bcc99f9171 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:53.187219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214aed4-ac81-4c5e-ab4b-7e2b5096531b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:53.189282 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214aed4-ac81-4c5e-ab4b-7e2b5096531b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:53.192976 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:53.199407 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919013b-1475-48dd-8d78-55bcc99f9171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:53.216785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-8919013b-1475-48dd-8d78-55bcc99f9171 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:01:53.216785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:53.216785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:53.216785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:53.216785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:53.216785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:53.216785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:53.216785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:53.216785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:53.216785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:53.216785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:53.216785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:53.216785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:53.216785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:53.216785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:53.216785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:53.217675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:53.217675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:53.217675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:53.217675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:53.217675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:53.217675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:53.217675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:53.217675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:53.217675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:53.217675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:53.217675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:53.217675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:53.217675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:53.217675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:53.217675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:53.217675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:53.218484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:53.218484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:53.218484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:53.218484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:53.218484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:53.218484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:53.218484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:53.218484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:53.218484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:53.218484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:53.218484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:01:53.218484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:53.225559 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 240/489] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:01:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:01:53.226677 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919013b-1475-48dd-8d78-55bcc99f9171 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:53.227886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f214aed4-ac81-4c5e-ab4b-7e2b5096531b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:01:53.227886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:53.227886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:53.227886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:53.227886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:53.227886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:53.227886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:53.227886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:53.227886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:53.227886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:53.227886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:53.227886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:53.227886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:01:53.227886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:01:53.227886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:01:53.227886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:01:53.229369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:53.229369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:53.229369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:01:53.229369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:01:53.229369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:01:53.229369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:01:53.229369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:53.229369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:53.229369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:53.229369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:53.229369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:53.229369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:53.229369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:53.229369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:53.229369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:53.229369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:53.229369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:53.229369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:53.230271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:53.230271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:53.230271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:01:53.230271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:01:53.230271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:01:53.230271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:01:53.230271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:01:53.230271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:01:53.230271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:01:53.230271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:53.235914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 250/490] 10.222.0.48 () {56 vars in 1093 bytes} [Mon Jul 25 12:01:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:53.242841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214aed4-ac81-4c5e-ab4b-7e2b5096531b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:53.365713 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214aed4-ac81-4c5e-ab4b-7e2b5096531b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:53.366215 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919013b-1475-48dd-8d78-55bcc99f9171 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:53.395686 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:53.401501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d55c24-cc7d-4256-b56f-a76b439cc998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:53.402417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d55c24-cc7d-4256-b56f-a76b439cc998 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:53.402861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d55c24-cc7d-4256-b56f-a76b439cc998 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:53.403374 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d55c24-cc7d-4256-b56f-a76b439cc998 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:53.404240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d55c24-cc7d-4256-b56f-a76b439cc998 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:53.404746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d55c24-cc7d-4256-b56f-a76b439cc998 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:53.405832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4a858-8cb2-4e5e-ae53-043f85f0f9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:53.406346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d55c24-cc7d-4256-b56f-a76b439cc998 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:53.406533 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4a858-8cb2-4e5e-ae53-043f85f0f9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:53.406819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4a858-8cb2-4e5e-ae53-043f85f0f9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:53.407096 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4a858-8cb2-4e5e-ae53-043f85f0f9f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:53.407849 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4a858-8cb2-4e5e-ae53-043f85f0f9f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:53.408154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4a858-8cb2-4e5e-ae53-043f85f0f9f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:53.409619 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4a858-8cb2-4e5e-ae53-043f85f0f9f3 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:53.419474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 241/491] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:01:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:53.420925 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6cc3d-bd42-41cc-9878-d3392a04249d None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:53.421215 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6cc3d-bd42-41cc-9878-d3392a04249d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:53.421498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6cc3d-bd42-41cc-9878-d3392a04249d None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:53.426946 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 242/492] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:53.427782 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6cc3d-bd42-41cc-9878-d3392a04249d None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:53.451286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 251/493] 10.222.0.48 () {56 vars in 1133 bytes} [Mon Jul 25 12:01:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:53.452586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065c8d2-d4aa-4d19-aa4a-b787adad8d42 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:53.452875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065c8d2-d4aa-4d19-aa4a-b787adad8d42 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:53.453153 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065c8d2-d4aa-4d19-aa4a-b787adad8d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:53.483884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4065c8d2-d4aa-4d19-aa4a-b787adad8d42 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:53.485487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4065c8d2-d4aa-4d19-aa4a-b787adad8d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:53.501010 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:53.544714 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6cc3d-bd42-41cc-9878-d3392a04249d None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:53.562427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 252/494] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:53.562427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065c8d2-d4aa-4d19-aa4a-b787adad8d42 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:53.588695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a2c85-e687-4e2d-b115-1a3586bcbff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:53.589505 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a2c85-e687-4e2d-b115-1a3586bcbff1 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:53.589929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a2c85-e687-4e2d-b115-1a3586bcbff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:53.590238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a2c85-e687-4e2d-b115-1a3586bcbff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:53.602262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a2c85-e687-4e2d-b115-1a3586bcbff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:53.604036 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a2c85-e687-4e2d-b115-1a3586bcbff1 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:53.623659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-8b7a2c85-e687-4e2d-b115-1a3586bcbff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:53.623659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:53.623659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:53.623659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:53.623659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:53.623659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:53.623659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:53.623659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:53.623659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:53.623659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:53.623659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:53.623659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:53.623659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:01:53.623659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:01:53.623659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:01:53.624486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:01:53.624486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:53.624486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:53.624486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:53.624486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:53.624486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:53.624486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:53.624486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:53.624486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:53.624486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:53.624486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:53.624486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:53.624486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:53.624486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:53.624486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:53.624486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:53.624486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:53.625300 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:01:53.625300 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:01:53.625300 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:53.625300 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:53.625300 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 243/495] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:53.626238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc6fe0-294b-4cd4-bcb9-2a25ecb83c55 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:53.626338 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc6fe0-294b-4cd4-bcb9-2a25ecb83c55 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:53.626586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc6fe0-294b-4cd4-bcb9-2a25ecb83c55 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:53.628026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 244/496] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:53.628542 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc6fe0-294b-4cd4-bcb9-2a25ecb83c55 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:53.682602 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065c8d2-d4aa-4d19-aa4a-b787adad8d42 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:53.705408 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:53.721486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0085e-beff-499d-9ec2-3d4608cedd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:53.722178 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0085e-beff-499d-9ec2-3d4608cedd0c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:53.722462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0085e-beff-499d-9ec2-3d4608cedd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:53.722741 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0085e-beff-499d-9ec2-3d4608cedd0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:53.731125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc6fe0-294b-4cd4-bcb9-2a25ecb83c55 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:53.749863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:53.771295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa2459-dc8d-4683-a69c-f8e09ad8f0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:53.772088 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa2459-dc8d-4683-a69c-f8e09ad8f0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:53.772372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa2459-dc8d-4683-a69c-f8e09ad8f0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:53.772654 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa2459-dc8d-4683-a69c-f8e09ad8f0d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:53.783316 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa2459-dc8d-4683-a69c-f8e09ad8f0d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:53.789375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0085e-beff-499d-9ec2-3d4608cedd0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:53.790916 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0085e-beff-499d-9ec2-3d4608cedd0c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:53.791136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-c9fa2459-dc8d-4683-a69c-f8e09ad8f0d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:01:53.791136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:53.791136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:53.791136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:53.791136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:53.791136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:53.791136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:53.791136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:53.791136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:53.791136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:53.791136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:53.791136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:53.791136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:53.791136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:53.791136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:53.791136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:53.792242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:53.792242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:53.792242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:53.792242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:53.792242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:53.792242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:53.792242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:53.792242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:53.792242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:53.792242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:53.792242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:53.792242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:53.792242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:53.792242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:53.792242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:53.792242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:53.793106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:53.793106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:53.793106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:53.793106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:53.793106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:53.793106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:53.793106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:53.793106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:53.793106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:53.793106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:53.793106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:01:53.793106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:53.793106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 245/497] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:01:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:53.793770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa2459-dc8d-4683-a69c-f8e09ad8f0d5 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:53.893903 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa2459-dc8d-4683-a69c-f8e09ad8f0d5 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:53.894237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 253/498] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:53.895683 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93202691-86f4-466e-9349-c5958c4252ce None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:53.896098 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93202691-86f4-466e-9349-c5958c4252ce None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:53.896374 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93202691-86f4-466e-9349-c5958c4252ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:53.913873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-93202691-86f4-466e-9349-c5958c4252ce None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:53.915113 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-93202691-86f4-466e-9349-c5958c4252ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:53.927479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10667ccd-7072-4c8e-994d-94805420e5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:53.928139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10667ccd-7072-4c8e-994d-94805420e5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:53.928421 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10667ccd-7072-4c8e-994d-94805420e5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:53.928700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10667ccd-7072-4c8e-994d-94805420e5a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:53.928981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:53.929727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10667ccd-7072-4c8e-994d-94805420e5a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:53.929727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10667ccd-7072-4c8e-994d-94805420e5a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:53.931420 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10667ccd-7072-4c8e-994d-94805420e5a8 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:53.943631 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 246/499] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:53.944862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7182e-049a-4429-8027-8be8ae6842e3 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:53.945204 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7182e-049a-4429-8027-8be8ae6842e3 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:53.945489 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7182e-049a-4429-8027-8be8ae6842e3 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:53.946820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 247/500] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:53.948118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7182e-049a-4429-8027-8be8ae6842e3 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:53.984254 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 254/501] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:53.994765 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93202691-86f4-466e-9349-c5958c4252ce None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:53.999011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:54.067829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7182e-049a-4429-8027-8be8ae6842e3 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:54.083521 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93202691-86f4-466e-9349-c5958c4252ce None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:54.101609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514cd66-6831-4173-8547-b4a2373c6f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:54.102301 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514cd66-6831-4173-8547-b4a2373c6f6f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:54.102587 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514cd66-6831-4173-8547-b4a2373c6f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:54.102859 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514cd66-6831-4173-8547-b4a2373c6f6f None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:54.103596 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514cd66-6831-4173-8547-b4a2373c6f6f None admin] RBAC: Adding query filter params (name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:54.103894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514cd66-6831-4173-8547-b4a2373c6f6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:54.105240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514cd66-6831-4173-8547-b4a2373c6f6f None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:54.112892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 248/502] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:01:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:54.113664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514cd66-6831-4173-8547-b4a2373c6f6f None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:54.116237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc421216-1e00-4e85-a66a-af24808123f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:54.117076 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc421216-1e00-4e85-a66a-af24808123f8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:54.117446 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc421216-1e00-4e85-a66a-af24808123f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:54.117722 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc421216-1e00-4e85-a66a-af24808123f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:54.128208 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc421216-1e00-4e85-a66a-af24808123f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:54.129648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc421216-1e00-4e85-a66a-af24808123f8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:54.147671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-bc421216-1e00-4e85-a66a-af24808123f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:54.147671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:54.147671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:54.147671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:54.147671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:54.147671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:54.147671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:54.147671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:54.147671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:54.147671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:54.147671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:54.147671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:54.147671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:01:54.147671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:01:54.147671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:01:54.148501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:01:54.148501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:54.148501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:54.148501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:54.148501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:54.148501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:54.148501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:54.148501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:54.148501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:54.148501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:54.148501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:54.148501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:54.148501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:54.148501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:54.148501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:54.148501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:54.148501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:54.149309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:01:54.149309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:01:54.149309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:54.149309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:54.149309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 255/503] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:54.150109 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4543b-e393-41f9-a8d3-a2414bc60302 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:54.150402 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4543b-e393-41f9-a8d3-a2414bc60302 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:54.150676 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4543b-e393-41f9-a8d3-a2414bc60302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:54.157397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:54.169731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c6d4543b-e393-41f9-a8d3-a2414bc60302 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:54.170988 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c6d4543b-e393-41f9-a8d3-a2414bc60302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:54.211749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:54.218531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514cd66-6831-4173-8547-b4a2373c6f6f None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:54.236253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 256/504] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:54.236910 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4543b-e393-41f9-a8d3-a2414bc60302 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:54.261048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ff47b-5771-4839-a63e-1ad54c32149c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:54.261837 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ff47b-5771-4839-a63e-1ad54c32149c None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:54.262152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ff47b-5771-4839-a63e-1ad54c32149c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:54.262426 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ff47b-5771-4839-a63e-1ad54c32149c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:54.269903 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ff47b-5771-4839-a63e-1ad54c32149c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:54.271376 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ff47b-5771-4839-a63e-1ad54c32149c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:54.287101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-507ff47b-5771-4839-a63e-1ad54c32149c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 12:01:54.287101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:54.287101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:54.287101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:54.287101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:54.287101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:54.287101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:54.287101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:54.287101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:54.287101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:54.287101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:54.287101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:54.287101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:01:54.287101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:01:54.287101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:01:54.287101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:01:54.288034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:54.288034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:54.288034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:01:54.288034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:01:54.288034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:01:54.288034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:01:54.288034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:54.288034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:54.288034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:54.288034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:54.288034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:54.288034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:54.288034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:54.288034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:54.288034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:54.288034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:54.288034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:54.288034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:54.288897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:54.288897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:54.288897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:01:54.288897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:01:54.288897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:01:54.288897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:01:54.288897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:01:54.288897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:01:54.288897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 12:01:54.288897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:54.288897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 249/505] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:54.289445 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ff47b-5771-4839-a63e-1ad54c32149c None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:54.334346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4543b-e393-41f9-a8d3-a2414bc60302 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:54.362810 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:54.367986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15111761-0e5d-4fb0-bc5f-a8c3b40d24eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:54.368803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15111761-0e5d-4fb0-bc5f-a8c3b40d24eb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:54.369086 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15111761-0e5d-4fb0-bc5f-a8c3b40d24eb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:54.369364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15111761-0e5d-4fb0-bc5f-a8c3b40d24eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:54.379148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15111761-0e5d-4fb0-bc5f-a8c3b40d24eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:54.380680 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15111761-0e5d-4fb0-bc5f-a8c3b40d24eb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:54.390168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ff47b-5771-4839-a63e-1ad54c32149c None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:54.398484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-15111761-0e5d-4fb0-bc5f-a8c3b40d24eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:54.398484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:54.398484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:54.398484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:54.398484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:54.398484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:54.398484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:54.398484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:54.398484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:54.398484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:54.398484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:54.398484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:54.398484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:01:54.398484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:01:54.398484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:01:54.399256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:01:54.399256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:54.399256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:54.399256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:54.399256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:54.399256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:54.399256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:54.399256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:54.399256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:54.399256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:54.399256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:54.399256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:54.399256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:54.399256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:54.399256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:54.399256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:54.399256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:54.400054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:01:54.400054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:01:54.400054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:54.400054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:54.400054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 257/506] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:54.400970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15111761-0e5d-4fb0-bc5f-a8c3b40d24eb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:54.428714 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cd44e-00fc-4556-a1a5-d4b3cd841b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:54.429495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cd44e-00fc-4556-a1a5-d4b3cd841b3f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:54.429778 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cd44e-00fc-4556-a1a5-d4b3cd841b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:54.430102 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cd44e-00fc-4556-a1a5-d4b3cd841b3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:54.440471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cd44e-00fc-4556-a1a5-d4b3cd841b3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:54.441948 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cd44e-00fc-4556-a1a5-d4b3cd841b3f None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:54.459446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-b17cd44e-00fc-4556-a1a5-d4b3cd841b3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:54.459446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:54.459446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:54.459446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:54.459446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:54.459446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:54.459446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:54.459446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:54.459446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:54.459446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:54.459446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:54.459446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:54.459446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:01:54.459446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:01:54.459446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:01:54.460294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:01:54.460294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:54.460294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:54.460294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:54.460294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:54.460294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:54.460294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:54.460294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:54.460294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:54.460294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:54.460294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:54.460294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:54.460294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:54.460294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:54.460294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:54.460294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:54.460294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:54.461380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:01:54.461380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:01:54.461380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:54.461380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:54.461380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 250/507] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:54.461380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cd44e-00fc-4556-a1a5-d4b3cd841b3f None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:54.474406 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:54.500481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15111761-0e5d-4fb0-bc5f-a8c3b40d24eb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:54.534432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25db641-aacd-40ff-afdc-172974f8f4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:54.535092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25db641-aacd-40ff-afdc-172974f8f4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:54.535373 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25db641-aacd-40ff-afdc-172974f8f4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:54.535644 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25db641-aacd-40ff-afdc-172974f8f4d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:54.536369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25db641-aacd-40ff-afdc-172974f8f4d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:54.536672 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25db641-aacd-40ff-afdc-172974f8f4d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:54.538064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25db641-aacd-40ff-afdc-172974f8f4d4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:54.549526 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 258/508] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:54.550335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25db641-aacd-40ff-afdc-172974f8f4d4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:54.561691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cd44e-00fc-4556-a1a5-d4b3cd841b3f None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:54.595567 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:54.595721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215714d-f838-4a2b-b291-535d07933d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:54.596446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215714d-f838-4a2b-b291-535d07933d23 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:54.596730 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215714d-f838-4a2b-b291-535d07933d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:54.597004 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215714d-f838-4a2b-b291-535d07933d23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:54.607227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215714d-f838-4a2b-b291-535d07933d23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:54.614893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-3215714d-f838-4a2b-b291-535d07933d23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:01:54.614893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:54.614893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:54.614893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:54.614893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:54.614893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:54.614893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:54.614893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:54.614893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:54.614893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:54.614893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:54.614893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:54.614893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:54.614893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:54.614893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:54.614893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:54.615927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:54.615927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:54.615927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:54.615927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:54.615927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:54.615927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:54.615927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:54.615927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:54.615927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:54.615927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:54.615927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:54.615927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:54.615927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:54.615927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:54.615927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:54.615927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:54.616761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:54.616761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:54.616761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:54.616761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:54.616761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:54.616761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:54.616761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:54.616761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:54.616761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:54.616761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:54.616761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:01:54.616761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:54.616761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 251/509] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:01:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:54.617381 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215714d-f838-4a2b-b291-535d07933d23 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:54.651931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25db641-aacd-40ff-afdc-172974f8f4d4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:54.682838 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:54.684685 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb03a86-9758-4877-b481-b50eaf871564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:54.685393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb03a86-9758-4877-b481-b50eaf871564 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:54.685673 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb03a86-9758-4877-b481-b50eaf871564 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:54.685948 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb03a86-9758-4877-b481-b50eaf871564 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:54.686814 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb03a86-9758-4877-b481-b50eaf871564 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:54.687122 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb03a86-9758-4877-b481-b50eaf871564 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:54.688559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb03a86-9758-4877-b481-b50eaf871564 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:54.705174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 259/510] 10.222.0.48 () {56 vars in 1137 bytes} [Mon Jul 25 12:01:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:54.705970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb03a86-9758-4877-b481-b50eaf871564 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:54.722452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215714d-f838-4a2b-b291-535d07933d23 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:54.755932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b78903-192c-4afe-b4d0-c0423bf104b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:54.756594 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b78903-192c-4afe-b4d0-c0423bf104b5 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:54.756873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b78903-192c-4afe-b4d0-c0423bf104b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:54.757147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b78903-192c-4afe-b4d0-c0423bf104b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:54.757860 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b78903-192c-4afe-b4d0-c0423bf104b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:54.758193 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b78903-192c-4afe-b4d0-c0423bf104b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:54.759545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b78903-192c-4afe-b4d0-c0423bf104b5 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:54.771570 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 252/511] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:54.772342 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b78903-192c-4afe-b4d0-c0423bf104b5 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:54.807104 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb03a86-9758-4877-b481-b50eaf871564 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:54.808731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:54.843521 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5264d7c-ff9a-4268-9d0a-27abfabbe37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:54.844173 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5264d7c-ff9a-4268-9d0a-27abfabbe37a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:54.844451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5264d7c-ff9a-4268-9d0a-27abfabbe37a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:54.844723 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5264d7c-ff9a-4268-9d0a-27abfabbe37a None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:54.845441 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5264d7c-ff9a-4268-9d0a-27abfabbe37a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:54.845740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5264d7c-ff9a-4268-9d0a-27abfabbe37a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:54.847145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5264d7c-ff9a-4268-9d0a-27abfabbe37a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:54.858630 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 260/512] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:54.859403 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5264d7c-ff9a-4268-9d0a-27abfabbe37a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:54.869869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b78903-192c-4afe-b4d0-c0423bf104b5 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:54.895750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:54.905259 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e11d9b-044b-4ec0-a378-d6ca4121ad55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:54.905984 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e11d9b-044b-4ec0-a378-d6ca4121ad55 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:54.906278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e11d9b-044b-4ec0-a378-d6ca4121ad55 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:54.906556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e11d9b-044b-4ec0-a378-d6ca4121ad55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:54.913021 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e11d9b-044b-4ec0-a378-d6ca4121ad55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:54.914496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e11d9b-044b-4ec0-a378-d6ca4121ad55 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:54.928883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-17e11d9b-044b-4ec0-a378-d6ca4121ad55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:01:54.928883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:54.928883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:54.928883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:54.928883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:54.928883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:54.928883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:54.928883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:54.928883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:54.928883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:54.928883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:54.928883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:54.928883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:01:54.928883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:01:54.928883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:01:54.930131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:01:54.930131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:54.930131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:54.930131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:54.930131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:54.930131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:54.930131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:54.930131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:54.930131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:54.930131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:54.930131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:54.930131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:54.930131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:54.930131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:54.930131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:54.930131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:54.930131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:54.930975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:01:54.930975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:01:54.930975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:01:54.930975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:01:54.930975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:01:54.930975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:01:54.930975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:01:54.930975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:54.930975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 253/513] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:01:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:54.930975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e11d9b-044b-4ec0-a378-d6ca4121ad55 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:54.959736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5264d7c-ff9a-4268-9d0a-27abfabbe37a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:54.992403 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ed271-e091-498c-af93-855c684a2f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:54.993063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ed271-e091-498c-af93-855c684a2f49 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:54.993346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ed271-e091-498c-af93-855c684a2f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:54.993619 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ed271-e091-498c-af93-855c684a2f49 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:54.995570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ed271-e091-498c-af93-855c684a2f49 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:54.995570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ed271-e091-498c-af93-855c684a2f49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:54.996567 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ed271-e091-498c-af93-855c684a2f49 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:55.008878 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 261/514] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:01:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:55.008878 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ed271-e091-498c-af93-855c684a2f49 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:55.032013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:55.034933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e11d9b-044b-4ec0-a378-d6ca4121ad55 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:55.068286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0e3cf-355e-4f15-96a9-71ce6a1e0398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:55.068928 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0e3cf-355e-4f15-96a9-71ce6a1e0398 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:55.069213 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0e3cf-355e-4f15-96a9-71ce6a1e0398 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:55.069490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0e3cf-355e-4f15-96a9-71ce6a1e0398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:55.103340 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ed271-e091-498c-af93-855c684a2f49 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:55.124114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:55.136828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0e3cf-355e-4f15-96a9-71ce6a1e0398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:55.137127 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabe44e-9a0e-4b08-9039-93c7a9bd8546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:55.137791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabe44e-9a0e-4b08-9039-93c7a9bd8546 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:55.138113 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabe44e-9a0e-4b08-9039-93c7a9bd8546 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:55.138306 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0e3cf-355e-4f15-96a9-71ce6a1e0398 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:55.138411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabe44e-9a0e-4b08-9039-93c7a9bd8546 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:55.139072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabe44e-9a0e-4b08-9039-93c7a9bd8546 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:55.140494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabe44e-9a0e-4b08-9039-93c7a9bd8546 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:55.166564 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 262/515] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 12:01:55 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:01:55.166564 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabe44e-9a0e-4b08-9039-93c7a9bd8546 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:55.261113 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 254/516] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:55.261113 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0e3cf-355e-4f15-96a9-71ce6a1e0398 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:55.275228 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:55.299670 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabe44e-9a0e-4b08-9039-93c7a9bd8546 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:55.337805 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017f482-91d6-4a4f-997d-c279ac74104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:55.338882 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017f482-91d6-4a4f-997d-c279ac74104e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:55.339332 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017f482-91d6-4a4f-997d-c279ac74104e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:55.339744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017f482-91d6-4a4f-997d-c279ac74104e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:55.351039 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017f482-91d6-4a4f-997d-c279ac74104e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:55.352699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017f482-91d6-4a4f-997d-c279ac74104e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:55.359528 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:55.370219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5017f482-91d6-4a4f-997d-c279ac74104e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 12:01:55.370219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:55.370219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:55.370219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:55.370219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:55.370219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:55.370219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:55.370219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:55.370219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:55.370219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:55.370219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:55.370219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:55.370219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:01:55.370219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:01:55.370219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:01:55.370219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:01:55.371276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:55.371276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:55.371276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:01:55.371276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:01:55.371276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:01:55.371276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:01:55.371276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:55.371276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:55.371276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:55.371276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:55.371276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:55.371276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:55.371276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:55.371276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:55.371276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:55.371276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:55.371276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:55.371276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:55.372349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:55.372349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:55.372349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:01:55.372349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:01:55.372349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:01:55.372349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:01:55.372349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:01:55.372349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:01:55.372349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 12:01:55.372349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:55.374071 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 263/517] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:01:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:55.375043 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017f482-91d6-4a4f-997d-c279ac74104e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:55.375151 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0e3cf-355e-4f15-96a9-71ce6a1e0398 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:55.410457 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4aa0f-6f1b-4c57-be44-98cdc2afe602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:55.411124 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4aa0f-6f1b-4c57-be44-98cdc2afe602 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:55.411449 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4aa0f-6f1b-4c57-be44-98cdc2afe602 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:55.411676 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4aa0f-6f1b-4c57-be44-98cdc2afe602 None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:55.412683 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4aa0f-6f1b-4c57-be44-98cdc2afe602 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:55.412809 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4aa0f-6f1b-4c57-be44-98cdc2afe602 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:55.414195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4aa0f-6f1b-4c57-be44-98cdc2afe602 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:55.434402 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 255/518] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:01:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:55.435183 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4aa0f-6f1b-4c57-be44-98cdc2afe602 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:55.497767 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017f482-91d6-4a4f-997d-c279ac74104e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:55.533090 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65129948-bf19-4ddc-b37f-064a53e7fd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:55.533886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65129948-bf19-4ddc-b37f-064a53e7fd0a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:55.534198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65129948-bf19-4ddc-b37f-064a53e7fd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:55.534582 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65129948-bf19-4ddc-b37f-064a53e7fd0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:55.537305 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4aa0f-6f1b-4c57-be44-98cdc2afe602 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:55.544535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:55.547599 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65129948-bf19-4ddc-b37f-064a53e7fd0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:55.549075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65129948-bf19-4ddc-b37f-064a53e7fd0a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:55.567899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-65129948-bf19-4ddc-b37f-064a53e7fd0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:55.567899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:55.567899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:55.567899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:55.567899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:55.567899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:55.567899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:55.567899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:55.567899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:55.567899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:55.567899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:55.567899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:55.567899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:01:55.567899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:01:55.567899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:01:55.568913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:01:55.568913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:55.568913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:55.568913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:55.568913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:55.568913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:55.568913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:55.568913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:55.568913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:55.568913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:55.568913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:55.568913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:55.568913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:55.568913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:55.568913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:55.568913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:55.568913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:55.574225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:01:55.574225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:01:55.574225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:55.574225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:55.574225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 264/519] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:55.574225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65129948-bf19-4ddc-b37f-064a53e7fd0a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:55.580978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4d8b3-918c-47a2-ad6f-807c91a194fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:55.581896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4d8b3-918c-47a2-ad6f-807c91a194fa None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:55.582299 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4d8b3-918c-47a2-ad6f-807c91a194fa None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:55.582663 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4d8b3-918c-47a2-ad6f-807c91a194fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:55.593492 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4d8b3-918c-47a2-ad6f-807c91a194fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:55.595056 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4d8b3-918c-47a2-ad6f-807c91a194fa None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:55.604636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:55.614642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-fef4d8b3-918c-47a2-ad6f-807c91a194fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:55.614642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:55.614642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:55.614642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:55.614642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:55.614642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:55.614642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:55.614642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:55.614642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:55.614642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:55.614642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:55.614642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:55.614642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:01:55.614642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:01:55.614642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:01:55.615633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:01:55.615633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:55.615633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:55.615633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:55.615633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:55.615633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:55.615633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:55.615633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:55.615633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:55.615633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:55.615633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:55.615633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:55.615633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:55.615633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:55.615633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:55.615633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:55.615633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:55.616642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:01:55.616642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:01:55.616642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:55.616642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:55.618891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 256/520] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:55.624133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4d8b3-918c-47a2-ad6f-807c91a194fa None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:55.684980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65129948-bf19-4ddc-b37f-064a53e7fd0a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:55.723961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecb5ca-83b2-42cd-beab-708aad05358d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:55.724786 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecb5ca-83b2-42cd-beab-708aad05358d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:55.725369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecb5ca-83b2-42cd-beab-708aad05358d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:55.725480 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecb5ca-83b2-42cd-beab-708aad05358d None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:55.726445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecb5ca-83b2-42cd-beab-708aad05358d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:55.726755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecb5ca-83b2-42cd-beab-708aad05358d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:55.729015 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecb5ca-83b2-42cd-beab-708aad05358d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:55.735045 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4d8b3-918c-47a2-ad6f-807c91a194fa None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:55.751636 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 265/521] 10.222.0.48 () {56 vars in 1137 bytes} [Mon Jul 25 12:01:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:55.751636 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecb5ca-83b2-42cd-beab-708aad05358d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:55.774502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733063a6-6c6a-4063-a2dc-963cc1324f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:55.775160 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733063a6-6c6a-4063-a2dc-963cc1324f5a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:55.775960 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733063a6-6c6a-4063-a2dc-963cc1324f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:55.776235 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733063a6-6c6a-4063-a2dc-963cc1324f5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:55.777073 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733063a6-6c6a-4063-a2dc-963cc1324f5a None admin] RBAC: Adding query filter params (role.id=0f49ec405a3c42a99beaaa0c79e67c5e, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=6d9db26891a04b0bb7e655c21feeffdd) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:55.777383 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733063a6-6c6a-4063-a2dc-963cc1324f5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:55.778853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733063a6-6c6a-4063-a2dc-963cc1324f5a None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:55.794036 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 257/522] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:55 2022] GET /identity/v3/role_assignments?user.id=6d9db26891a04b0bb7e655c21feeffdd&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=0f49ec405a3c42a99beaaa0c79e67c5e => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:55.794036 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733063a6-6c6a-4063-a2dc-963cc1324f5a None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:55.813765 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:55.864566 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:55.874029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecb5ca-83b2-42cd-beab-708aad05358d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:55.915403 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0d60a-d74d-4bf5-b445-8b344ff2e26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:55.917268 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0d60a-d74d-4bf5-b445-8b344ff2e26a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:55.917786 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0d60a-d74d-4bf5-b445-8b344ff2e26a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:55.918306 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0d60a-d74d-4bf5-b445-8b344ff2e26a None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:55.919244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0d60a-d74d-4bf5-b445-8b344ff2e26a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:55.919793 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0d60a-d74d-4bf5-b445-8b344ff2e26a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:55.921427 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733063a6-6c6a-4063-a2dc-963cc1324f5a None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:55.921568 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0d60a-d74d-4bf5-b445-8b344ff2e26a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:55.937051 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 266/523] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:55.938263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0d60a-d74d-4bf5-b445-8b344ff2e26a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:55.968819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56346b-77ee-43b5-ad05-c303673c799e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:55.969517 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56346b-77ee-43b5-ad05-c303673c799e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:55.969802 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56346b-77ee-43b5-ad05-c303673c799e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:55.970101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56346b-77ee-43b5-ad05-c303673c799e None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:55.970836 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56346b-77ee-43b5-ad05-c303673c799e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:55.971145 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56346b-77ee-43b5-ad05-c303673c799e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:55.972627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56346b-77ee-43b5-ad05-c303673c799e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:55.986262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 258/524] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:55.987103 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56346b-77ee-43b5-ad05-c303673c799e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:56.049164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0d60a-d74d-4bf5-b445-8b344ff2e26a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:56.060824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:56.085222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7bdb2-5069-473f-a8d6-88254b93a092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:56.086032 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7bdb2-5069-473f-a8d6-88254b93a092 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:56.086420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7bdb2-5069-473f-a8d6-88254b93a092 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:56.086793 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7bdb2-5069-473f-a8d6-88254b93a092 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:56.122671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56346b-77ee-43b5-ad05-c303673c799e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:56.146937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:56.160684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b11430-c1a6-4345-973d-6ef4776b34d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:56.161731 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b11430-c1a6-4345-973d-6ef4776b34d7 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:56.162089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b11430-c1a6-4345-973d-6ef4776b34d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:56.162463 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b11430-c1a6-4345-973d-6ef4776b34d7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:56.171304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b11430-c1a6-4345-973d-6ef4776b34d7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:56.172890 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b11430-c1a6-4345-973d-6ef4776b34d7 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:56.180075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7bdb2-5069-473f-a8d6-88254b93a092 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:56.182320 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7bdb2-5069-473f-a8d6-88254b93a092 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:56.188026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-b7b11430-c1a6-4345-973d-6ef4776b34d7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 12:01:56.188026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:56.188026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:56.188026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:56.188026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:56.188026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:56.188026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:56.188026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:56.188026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:56.188026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:56.188026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:56.188026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:56.188026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:01:56.188026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:01:56.188026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:01:56.188026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:01:56.189081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:56.189081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:56.189081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:01:56.189081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:01:56.189081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:01:56.189081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:01:56.189081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:56.189081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:56.189081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:56.189081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:56.189081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:56.189081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:56.189081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:56.189081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:56.189081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:56.189081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:56.189081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:56.189081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:56.190199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:56.190199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:56.190199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:01:56.190199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:01:56.190199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:01:56.190199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:01:56.190199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:01:56.190199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:01:56.190199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 12:01:56.190199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:56.191800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 259/525] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:01:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:56.192662 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b11430-c1a6-4345-973d-6ef4776b34d7 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:56.302772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 267/526] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:56.303979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7bdb2-5069-473f-a8d6-88254b93a092 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:56.311103 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b11430-c1a6-4345-973d-6ef4776b34d7 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:56.319295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:56.360173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb9ad7-b472-45a2-9767-d745c1201721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:56.361210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb9ad7-b472-45a2-9767-d745c1201721 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:56.361498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb9ad7-b472-45a2-9767-d745c1201721 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:56.361772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb9ad7-b472-45a2-9767-d745c1201721 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:56.371436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb9ad7-b472-45a2-9767-d745c1201721 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:56.373519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb9ad7-b472-45a2-9767-d745c1201721 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:56.392282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-aaeb9ad7-b472-45a2-9767-d745c1201721 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:01:56.392282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:56.392282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:56.392282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:56.392282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:56.392282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:56.392282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:56.392282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:56.392282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:56.392282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:56.392282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:56.392282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:56.392282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:01:56.392282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:01:56.392282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:01:56.393304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:01:56.393304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:56.393304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:56.393304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:56.393304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:56.393304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:56.393304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:56.393304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:56.393304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:56.393304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:56.393304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:56.393304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:56.393304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:56.393304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:56.393304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:56.393304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:56.393304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:56.394353 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:01:56.394353 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:01:56.394353 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:01:56.394353 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:01:56.394353 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:01:56.394353 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:01:56.394353 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:01:56.394353 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:56.404075 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 260/527] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:01:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:56.404075 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb9ad7-b472-45a2-9767-d745c1201721 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:56.435484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7bdb2-5069-473f-a8d6-88254b93a092 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:56.452300 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:56.486156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64255143-6b7d-4c1a-a32c-4f21c3ba0705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:56.486950 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64255143-6b7d-4c1a-a32c-4f21c3ba0705 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:56.487352 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64255143-6b7d-4c1a-a32c-4f21c3ba0705 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:56.487723 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64255143-6b7d-4c1a-a32c-4f21c3ba0705 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:56.489023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64255143-6b7d-4c1a-a32c-4f21c3ba0705 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:56.489023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64255143-6b7d-4c1a-a32c-4f21c3ba0705 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:56.490588 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64255143-6b7d-4c1a-a32c-4f21c3ba0705 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:56.509202 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 268/528] 10.222.0.48 () {56 vars in 1139 bytes} [Mon Jul 25 12:01:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:56.510746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64255143-6b7d-4c1a-a32c-4f21c3ba0705 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:56.528224 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb9ad7-b472-45a2-9767-d745c1201721 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:56.576652 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f430fb4-db05-4597-8a9f-17ef4607a2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:56.577682 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f430fb4-db05-4597-8a9f-17ef4607a2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:56.578133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f430fb4-db05-4597-8a9f-17ef4607a2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:56.578552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f430fb4-db05-4597-8a9f-17ef4607a2f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:56.581042 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:56.593875 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f430fb4-db05-4597-8a9f-17ef4607a2f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:56.596239 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f430fb4-db05-4597-8a9f-17ef4607a2f9 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:56.620688 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64255143-6b7d-4c1a-a32c-4f21c3ba0705 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:56.621561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-4f430fb4-db05-4597-8a9f-17ef4607a2f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:56.621561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:56.621561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:56.621561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:56.621561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:56.621561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:56.621561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:56.621561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:56.621561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:56.621561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:56.621561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:56.621561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:56.621561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:01:56.621561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:01:56.621561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:01:56.622571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:01:56.622571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:56.622571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:56.622571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:56.622571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:56.622571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:56.622571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:56.622571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:56.622571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:56.622571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:56.622571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:56.622571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:56.622571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:56.622571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:56.622571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:56.622571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:56.622571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:56.623518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:01:56.623518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:01:56.623518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:56.623518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:56.626465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 261/529] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:56.627442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f430fb4-db05-4597-8a9f-17ef4607a2f9 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:56.658988 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8110f-a497-4479-a8ab-c5df6e5c8966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:56.659814 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8110f-a497-4479-a8ab-c5df6e5c8966 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:56.660201 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8110f-a497-4479-a8ab-c5df6e5c8966 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:56.660598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8110f-a497-4479-a8ab-c5df6e5c8966 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:56.661496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8110f-a497-4479-a8ab-c5df6e5c8966 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:56.661936 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8110f-a497-4479-a8ab-c5df6e5c8966 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:56.663465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8110f-a497-4479-a8ab-c5df6e5c8966 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:56.682626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 269/530] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:01:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:56.687718 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8110f-a497-4479-a8ab-c5df6e5c8966 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:56.768672 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:56.777656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f430fb4-db05-4597-8a9f-17ef4607a2f9 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:56.798483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8110f-a497-4479-a8ab-c5df6e5c8966 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:56.823218 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cd614-5f97-4620-acb7-347f3511cc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:56.824676 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cd614-5f97-4620-acb7-347f3511cc9b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:56.825106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cd614-5f97-4620-acb7-347f3511cc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:56.825681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cd614-5f97-4620-acb7-347f3511cc9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:56.828620 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:56.838386 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60526064-9103-4d9a-8fcb-c1bf7129d639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:56.839226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60526064-9103-4d9a-8fcb-c1bf7129d639 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:56.839615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60526064-9103-4d9a-8fcb-c1bf7129d639 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:56.840016 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60526064-9103-4d9a-8fcb-c1bf7129d639 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:56.841010 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60526064-9103-4d9a-8fcb-c1bf7129d639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:56.841251 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60526064-9103-4d9a-8fcb-c1bf7129d639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:56.842815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60526064-9103-4d9a-8fcb-c1bf7129d639 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:56.855572 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 270/531] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:56.856591 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60526064-9103-4d9a-8fcb-c1bf7129d639 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:56.908524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587cd614-5f97-4620-acb7-347f3511cc9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:56.910334 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587cd614-5f97-4620-acb7-347f3511cc9b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:56.966957 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60526064-9103-4d9a-8fcb-c1bf7129d639 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:57.003483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd23b6-c459-49d5-b108-42d2b50510df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:57.004139 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd23b6-c459-49d5-b108-42d2b50510df None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:57.004420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd23b6-c459-49d5-b108-42d2b50510df None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:57.004690 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd23b6-c459-49d5-b108-42d2b50510df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:57.005645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd23b6-c459-49d5-b108-42d2b50510df None admin] RBAC: Adding query filter params (role.id=0f49ec405a3c42a99beaaa0c79e67c5e, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=cd52ff8138094d64bce9de60c819ab4a) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:57.006330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd23b6-c459-49d5-b108-42d2b50510df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:57.007520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd23b6-c459-49d5-b108-42d2b50510df None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:57.022290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 271/532] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:56 2022] GET /identity/v3/role_assignments?user.id=cd52ff8138094d64bce9de60c819ab4a&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=0f49ec405a3c42a99beaaa0c79e67c5e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:57.022290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd23b6-c459-49d5-b108-42d2b50510df None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:57.029342 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:57.039174 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 262/533] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:57.045317 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cd614-5f97-4620-acb7-347f3511cc9b None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:57.074783 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:57.126381 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd23b6-c459-49d5-b108-42d2b50510df None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:57.162250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbe0b1-9d98-4d0c-9814-e490f738186f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:57.163021 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbe0b1-9d98-4d0c-9814-e490f738186f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:57.163544 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbe0b1-9d98-4d0c-9814-e490f738186f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:57.163890 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbe0b1-9d98-4d0c-9814-e490f738186f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:57.172827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbe0b1-9d98-4d0c-9814-e490f738186f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:57.174480 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbe0b1-9d98-4d0c-9814-e490f738186f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:57.193679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-80cbe0b1-9d98-4d0c-9814-e490f738186f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:01:57.193679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:57.193679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:57.193679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:57.193679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:57.193679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:57.193679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:57.193679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:57.193679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:57.193679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:57.193679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:57.193679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:57.193679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:01:57.193679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:01:57.193679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:01:57.194624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:01:57.194624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:57.194624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:57.194624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:57.194624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:57.194624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:57.194624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:57.194624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:57.194624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:57.194624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:57.194624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:57.194624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:57.194624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:57.194624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:57.194624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:57.194624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:57.194624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:57.195417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:01:57.195417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:01:57.195417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:01:57.195417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:01:57.195417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:01:57.195417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:01:57.195417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:01:57.195417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:57.195417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 272/534] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:01:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:57.203741 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbe0b1-9d98-4d0c-9814-e490f738186f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:57.254694 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cd614-5f97-4620-acb7-347f3511cc9b None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:57.294336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63229616-b291-45dc-a0dd-fe22cb169f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:57.295164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63229616-b291-45dc-a0dd-fe22cb169f80 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:57.295453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63229616-b291-45dc-a0dd-fe22cb169f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:57.295727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63229616-b291-45dc-a0dd-fe22cb169f80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:57.307427 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63229616-b291-45dc-a0dd-fe22cb169f80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:57.308966 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63229616-b291-45dc-a0dd-fe22cb169f80 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:57.328704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-63229616-b291-45dc-a0dd-fe22cb169f80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:57.328704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:57.328704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:57.328704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:57.328704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:57.328704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:57.328704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:57.328704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:57.328704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:57.328704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:57.328704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:57.328704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:57.328704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:01:57.328704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:01:57.328704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:01:57.329577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:01:57.329577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:57.329577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:57.329577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:57.329577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:57.329577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:57.329577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:57.329577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:57.329577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:57.329577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:57.329577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:57.329577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:57.329577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:57.329577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:57.329577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:57.329577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:57.329577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:57.330426 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:01:57.330426 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:01:57.330426 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:57.330426 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:57.330636 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbe0b1-9d98-4d0c-9814-e490f738186f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:57.334569 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 263/535] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:01:57.335937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db82f1-7539-43a8-ba76-a44c728bf8fe None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:57.336233 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db82f1-7539-43a8-ba76-a44c728bf8fe None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:57.336508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db82f1-7539-43a8-ba76-a44c728bf8fe None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:57.338273 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 264/536] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:57.338979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db82f1-7539-43a8-ba76-a44c728bf8fe None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:57.344058 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:57.367267 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5931d6-fa7c-41b0-818f-8c0b8214744b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:57.367930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5931d6-fa7c-41b0-818f-8c0b8214744b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:57.368212 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5931d6-fa7c-41b0-818f-8c0b8214744b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:57.368853 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5931d6-fa7c-41b0-818f-8c0b8214744b None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:57.369982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5931d6-fa7c-41b0-818f-8c0b8214744b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:57.370319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5931d6-fa7c-41b0-818f-8c0b8214744b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:57.371758 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5931d6-fa7c-41b0-818f-8c0b8214744b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:57.389687 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 273/537] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:01:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:57.391261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55ac3a-68c3-4776-adce-66dfd950c0c6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:57.391548 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55ac3a-68c3-4776-adce-66dfd950c0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:57.391821 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55ac3a-68c3-4776-adce-66dfd950c0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:57.401334 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:57.412499 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8f55ac3a-68c3-4776-adce-66dfd950c0c6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:57.413768 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8f55ac3a-68c3-4776-adce-66dfd950c0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:57.457096 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db82f1-7539-43a8-ba76-a44c728bf8fe None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:57.498026 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 274/538] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:57.498026 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55ac3a-68c3-4776-adce-66dfd950c0c6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:57.504014 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2fc46-84ea-4b90-b358-e2813017ca64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:57.504909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2fc46-84ea-4b90-b358-e2813017ca64 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:57.505638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2fc46-84ea-4b90-b358-e2813017ca64 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:57.506289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2fc46-84ea-4b90-b358-e2813017ca64 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:57.507821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2fc46-84ea-4b90-b358-e2813017ca64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:57.508508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2fc46-84ea-4b90-b358-e2813017ca64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:57.510774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2fc46-84ea-4b90-b358-e2813017ca64 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:57.534170 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 265/539] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:57.539715 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2fc46-84ea-4b90-b358-e2813017ca64 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:57.615508 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55ac3a-68c3-4776-adce-66dfd950c0c6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:57.617747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:57.659315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32673152-5aef-41e3-a070-00d8ba153c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:57.660099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32673152-5aef-41e3-a070-00d8ba153c5b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:57.660736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32673152-5aef-41e3-a070-00d8ba153c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:57.661081 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32673152-5aef-41e3-a070-00d8ba153c5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:57.662223 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32673152-5aef-41e3-a070-00d8ba153c5b None admin] RBAC: Adding query filter params (role.id=0f49ec405a3c42a99beaaa0c79e67c5e, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=f014af35de5c47ab86ec02ebed360678) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:57.662607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32673152-5aef-41e3-a070-00d8ba153c5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:57.664414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32673152-5aef-41e3-a070-00d8ba153c5b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:57.672448 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 275/540] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:57 2022] GET /identity/v3/role_assignments?user.id=f014af35de5c47ab86ec02ebed360678&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=0f49ec405a3c42a99beaaa0c79e67c5e => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:57.673613 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32673152-5aef-41e3-a070-00d8ba153c5b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:57.689524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2fc46-84ea-4b90-b358-e2813017ca64 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:57.712334 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:57.802789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2a9d0-a770-4c44-ae05-2d7342da6348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:57.803627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2a9d0-a770-4c44-ae05-2d7342da6348 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:57.803911 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2a9d0-a770-4c44-ae05-2d7342da6348 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:57.804189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2a9d0-a770-4c44-ae05-2d7342da6348 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:57.804760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32673152-5aef-41e3-a070-00d8ba153c5b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:57.815997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2a9d0-a770-4c44-ae05-2d7342da6348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:57.824062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-9ec2a9d0-a770-4c44-ae05-2d7342da6348 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:01:57.824062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:57.824062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:57.824062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:57.824062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:57.824062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:57.824062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:57.824062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:57.824062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:57.824062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:57.824062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:57.824062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:57.824062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:57.824062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:57.824062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:57.824062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:57.824967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:57.824967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:57.824967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:57.824967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:57.824967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:57.824967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:57.824967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:57.824967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:57.824967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:57.824967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:57.824967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:57.824967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:57.824967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:57.824967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:57.824967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:57.824967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:57.826192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:57.826192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:57.826192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:57.826192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:57.826192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:57.826192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:57.826192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:57.826192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:57.826192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:57.826192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:57.826192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:01:57.826192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:57.826192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 266/541] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:01:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:01:57.835044 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2a9d0-a770-4c44-ae05-2d7342da6348 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:57.846832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d2d2a-1572-4abf-8de9-e2bf36a1abb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:57.847977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d2d2a-1572-4abf-8de9-e2bf36a1abb0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:57.848478 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d2d2a-1572-4abf-8de9-e2bf36a1abb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:57.848945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d2d2a-1572-4abf-8de9-e2bf36a1abb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:57.857461 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d2d2a-1572-4abf-8de9-e2bf36a1abb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:57.859292 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d2d2a-1572-4abf-8de9-e2bf36a1abb0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:57.875137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-245d2d2a-1572-4abf-8de9-e2bf36a1abb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:01:57.875137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:57.875137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:57.875137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:57.875137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:57.875137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:57.875137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:57.875137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:57.875137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:57.875137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:57.875137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:57.875137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:57.875137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:01:57.875137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:01:57.875137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:01:57.875973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:01:57.875973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:57.875973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:57.875973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:57.875973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:57.875973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:57.875973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:57.875973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:57.875973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:57.875973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:57.875973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:57.875973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:57.875973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:57.875973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:57.875973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:57.875973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:57.875973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:57.876773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:01:57.876773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:01:57.876773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:01:57.876773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:01:57.876773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:01:57.876773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:01:57.876773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:01:57.876773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:57.879371 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 276/542] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:01:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:57.885557 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d2d2a-1572-4abf-8de9-e2bf36a1abb0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:57.915843 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:57.988264 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2a9d0-a770-4c44-ae05-2d7342da6348 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:58.012881 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d2d2a-1572-4abf-8de9-e2bf36a1abb0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:58.025969 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5fee4-82a3-4edd-8778-0afdbfa53274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:58.027047 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5fee4-82a3-4edd-8778-0afdbfa53274 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:58.027362 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5fee4-82a3-4edd-8778-0afdbfa53274 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:58.027641 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5fee4-82a3-4edd-8778-0afdbfa53274 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:58.028851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5fee4-82a3-4edd-8778-0afdbfa53274 None admin] RBAC: Adding query filter params (name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:58.029274 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5fee4-82a3-4edd-8778-0afdbfa53274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:58.030838 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5fee4-82a3-4edd-8778-0afdbfa53274 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:58.042238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 267/543] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:01:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:58.044144 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93b60c-f3b0-4390-943a-f5511d15007a None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:58.044564 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93b60c-f3b0-4390-943a-f5511d15007a None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:58.044962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93b60c-f3b0-4390-943a-f5511d15007a None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:58.046494 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 268/544] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:58.047182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93b60c-f3b0-4390-943a-f5511d15007a None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:58.060222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd5961-48ae-4049-9f70-e47056482033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:58.061373 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd5961-48ae-4049-9f70-e47056482033 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:58.061657 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd5961-48ae-4049-9f70-e47056482033 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:58.061934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd5961-48ae-4049-9f70-e47056482033 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:58.063670 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd5961-48ae-4049-9f70-e47056482033 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:58.063992 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd5961-48ae-4049-9f70-e47056482033 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:58.065719 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd5961-48ae-4049-9f70-e47056482033 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:58.082714 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 277/545] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:01:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:58.083998 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff44f4-1c11-4c0b-8fe4-5f16f93b6d83 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:58.084288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff44f4-1c11-4c0b-8fe4-5f16f93b6d83 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:58.084561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff44f4-1c11-4c0b-8fe4-5f16f93b6d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:58.089316 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:58.111228 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fcff44f4-1c11-4c0b-8fe4-5f16f93b6d83 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:58.113667 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fcff44f4-1c11-4c0b-8fe4-5f16f93b6d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:58.186718 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93b60c-f3b0-4390-943a-f5511d15007a None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:58.210286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 278/546] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:58.211179 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff44f4-1c11-4c0b-8fe4-5f16f93b6d83 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:58.232479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f759d-ee47-4cd0-9b16-8403348e9321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:58.233988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f759d-ee47-4cd0-9b16-8403348e9321 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:58.234775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f759d-ee47-4cd0-9b16-8403348e9321 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:58.235253 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f759d-ee47-4cd0-9b16-8403348e9321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:58.244633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:58.248689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f759d-ee47-4cd0-9b16-8403348e9321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:58.250852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f759d-ee47-4cd0-9b16-8403348e9321 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:58.272062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-af1f759d-ee47-4cd0-9b16-8403348e9321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:58.272062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:58.272062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:58.272062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:58.272062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:58.272062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:58.272062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:58.272062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:58.272062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:58.272062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:58.272062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:58.272062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:58.272062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:01:58.272062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:01:58.272062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:01:58.272947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:01:58.272947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:58.272947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:58.272947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:58.272947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:58.272947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:58.272947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:58.272947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:58.272947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:58.272947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:58.272947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:58.272947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:58.272947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:58.272947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:58.272947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:58.272947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:58.272947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:58.273752 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:01:58.273752 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:01:58.273752 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:58.273752 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:58.273752 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 269/547] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:58.279343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f759d-ee47-4cd0-9b16-8403348e9321 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:58.353505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff44f4-1c11-4c0b-8fe4-5f16f93b6d83 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:58.372063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:58.391276 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f759d-ee47-4cd0-9b16-8403348e9321 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:58.403951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb33564-aab2-4a60-aa78-a18846beace6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:58.404910 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb33564-aab2-4a60-aa78-a18846beace6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:58.405546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb33564-aab2-4a60-aa78-a18846beace6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:58.406384 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb33564-aab2-4a60-aa78-a18846beace6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:58.407713 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb33564-aab2-4a60-aa78-a18846beace6 None admin] RBAC: Adding query filter params (role.id=0f49ec405a3c42a99beaaa0c79e67c5e, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=fbc9fad7089b4c95ac92e846d46cb5a3) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:58.408259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb33564-aab2-4a60-aa78-a18846beace6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:58.410344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb33564-aab2-4a60-aa78-a18846beace6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:58.418849 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 279/548] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:01:58 2022] GET /identity/v3/role_assignments?user.id=fbc9fad7089b4c95ac92e846d46cb5a3&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=0f49ec405a3c42a99beaaa0c79e67c5e => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:58.420169 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb33564-aab2-4a60-aa78-a18846beace6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:58.426842 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6a39e-9fb0-4a15-8729-1f8ff013117f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:58.427739 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6a39e-9fb0-4a15-8729-1f8ff013117f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:58.428030 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6a39e-9fb0-4a15-8729-1f8ff013117f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:58.428310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6a39e-9fb0-4a15-8729-1f8ff013117f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:58.444725 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6a39e-9fb0-4a15-8729-1f8ff013117f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:01:58.453289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-22f6a39e-9fb0-4a15-8729-1f8ff013117f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:01:58.453289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:58.453289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:58.453289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:58.453289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:58.453289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:58.453289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:58.453289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:58.453289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:58.453289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:58.453289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:58.453289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:58.453289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:01:58.453289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:01:58.453289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:01:58.453289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:01:58.454219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:01:58.454219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:01:58.454219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:01:58.454219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:01:58.454219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:58.454219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:58.454219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:58.454219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:58.454219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:58.454219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:58.454219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:58.454219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:58.454219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:58.454219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:58.454219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:58.454219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:58.455537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:58.455537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:58.455537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:58.455537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:58.455537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:01:58.455537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:01:58.455537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:01:58.455537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:01:58.455537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:01:58.455537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:01:58.455537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:01:58.455537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:58.455537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 270/549] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:01:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:58.464247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6a39e-9fb0-4a15-8729-1f8ff013117f None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:58.530234 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:58.553526 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb33564-aab2-4a60-aa78-a18846beace6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:58.593851 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876097b-e643-4df8-8272-ecb796fcb07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:58.594800 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876097b-e643-4df8-8272-ecb796fcb07d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:58.595230 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876097b-e643-4df8-8272-ecb796fcb07d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:58.596041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876097b-e643-4df8-8272-ecb796fcb07d None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:58.597078 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876097b-e643-4df8-8272-ecb796fcb07d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:58.597654 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876097b-e643-4df8-8272-ecb796fcb07d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:58.599384 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876097b-e643-4df8-8272-ecb796fcb07d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:58.614306 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 280/550] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:58.621363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876097b-e643-4df8-8272-ecb796fcb07d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:58.696505 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6a39e-9fb0-4a15-8729-1f8ff013117f None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:58.731854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876097b-e643-4df8-8272-ecb796fcb07d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:58.769496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464b93f-8781-41dc-aba8-95a7cbd755af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:58.770791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464b93f-8781-41dc-aba8-95a7cbd755af None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:58.771378 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464b93f-8781-41dc-aba8-95a7cbd755af None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:58.771860 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464b93f-8781-41dc-aba8-95a7cbd755af None admin] PATH_INFO: `/v3/users/swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:58.778770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0060c-808c-4b1f-9352-31f5725a5041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:58.779475 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0060c-808c-4b1f-9352-31f5725a5041 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:58.779775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0060c-808c-4b1f-9352-31f5725a5041 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:58.780015 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0060c-808c-4b1f-9352-31f5725a5041 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:58.780780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0060c-808c-4b1f-9352-31f5725a5041 None admin] RBAC: Adding query filter params (name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:58.781075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464b93f-8781-41dc-aba8-95a7cbd755af None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:58.781179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0060c-808c-4b1f-9352-31f5725a5041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:58.782480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0060c-808c-4b1f-9352-31f5725a5041 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:58.783127 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464b93f-8781-41dc-aba8-95a7cbd755af None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:58.785927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:58.799828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c464b93f-8781-41dc-aba8-95a7cbd755af None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:01:58.799828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:58.799828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:58.799828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:58.799828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:58.799828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:58.799828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:58.799828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:58.799828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:58.799828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:58.799828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:58.799828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:58.799828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:01:58.799828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:01:58.799828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:01:58.799828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:01:58.800859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:58.800859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:58.800859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:01:58.800859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:01:58.800859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:01:58.800859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:01:58.800859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:58.800859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:58.800859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:58.800859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:58.800859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:58.800859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:58.800859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:58.800859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:58.800859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:58.800859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:58.800859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:58.800859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:58.801831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:58.801831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:58.801831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:01:58.801831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:01:58.801831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:01:58.801831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:01:58.801831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:01:58.801831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:01:58.801831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:01:58.801831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:01:58.804947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 271/551] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:01:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:58.805948 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 281/552] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:01:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:01:58.811209 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0060c-808c-4b1f-9352-31f5725a5041 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:58.814976 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464b93f-8781-41dc-aba8-95a7cbd755af None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:58.818334 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:58.987750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0060c-808c-4b1f-9352-31f5725a5041 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:58.999322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464b93f-8781-41dc-aba8-95a7cbd755af None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:59.058902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323169f-91ad-4ff8-9388-a4b199033950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:59.060184 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323169f-91ad-4ff8-9388-a4b199033950 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:59.061143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323169f-91ad-4ff8-9388-a4b199033950 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:59.061925 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebded5a-ea78-46d4-979d-b1029822d77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:59.063292 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebded5a-ea78-46d4-979d-b1029822d77e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:59.063752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323169f-91ad-4ff8-9388-a4b199033950 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:59.064779 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323169f-91ad-4ff8-9388-a4b199033950 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:59.065237 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebded5a-ea78-46d4-979d-b1029822d77e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:59.065685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebded5a-ea78-46d4-979d-b1029822d77e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:59.066742 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323169f-91ad-4ff8-9388-a4b199033950 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:59.068364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323169f-91ad-4ff8-9388-a4b199033950 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:59.087479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebded5a-ea78-46d4-979d-b1029822d77e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:59.093905 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebded5a-ea78-46d4-979d-b1029822d77e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:59.101574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 282/553] 10.222.0.48 () {56 vars in 1135 bytes} [Mon Jul 25 12:01:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:59.109081 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323169f-91ad-4ff8-9388-a4b199033950 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:59.118156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-9ebded5a-ea78-46d4-979d-b1029822d77e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:59.118156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:59.118156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:59.118156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:59.118156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:59.118156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:59.118156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:59.118156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:59.118156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:59.118156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:59.118156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:59.118156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:59.118156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:01:59.118156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:01:59.118156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:01:59.118997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:01:59.118997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:59.118997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:59.118997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:59.118997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:59.118997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:59.118997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:59.118997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:59.118997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:59.118997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:59.118997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:59.118997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:59.118997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:59.118997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:59.118997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:59.118997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:59.118997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:59.120628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:01:59.120628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:01:59.120628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:59.120628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:59.122821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 272/554] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:59.128265 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebded5a-ea78-46d4-979d-b1029822d77e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:59.231153 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:59.248646 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:59.282391 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebded5a-ea78-46d4-979d-b1029822d77e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:59.329994 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323169f-91ad-4ff8-9388-a4b199033950 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:59.369592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056b1e2-8300-4ced-a9d6-350342b0cd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:59.370324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056b1e2-8300-4ced-a9d6-350342b0cd30 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:59.370609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056b1e2-8300-4ced-a9d6-350342b0cd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:59.370932 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056b1e2-8300-4ced-a9d6-350342b0cd30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:59.389268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b98135-c6e9-4d9f-86d2-61672a315864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:59.390241 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b98135-c6e9-4d9f-86d2-61672a315864 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:59.390523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b98135-c6e9-4d9f-86d2-61672a315864 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:59.390795 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b98135-c6e9-4d9f-86d2-61672a315864 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:59.392134 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b98135-c6e9-4d9f-86d2-61672a315864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:59.392451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b98135-c6e9-4d9f-86d2-61672a315864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:59.393819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b98135-c6e9-4d9f-86d2-61672a315864 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:59.414156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 273/555] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:01:59.415520 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e0cdf-5089-4ac3-8288-51aaea866009 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:59.415813 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e0cdf-5089-4ac3-8288-51aaea866009 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:59.416719 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e0cdf-5089-4ac3-8288-51aaea866009 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:59.418548 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 274/556] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:59.419301 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e0cdf-5089-4ac3-8288-51aaea866009 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:59.455372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056b1e2-8300-4ced-a9d6-350342b0cd30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:59.457233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056b1e2-8300-4ced-a9d6-350342b0cd30 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:59.522434 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:59.527622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e0cdf-5089-4ac3-8288-51aaea866009 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:59.558491 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:59.563659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1f664-8d64-4113-90fe-3c86bfb31d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:59.564516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1f664-8d64-4113-90fe-3c86bfb31d2b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:59.565066 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1f664-8d64-4113-90fe-3c86bfb31d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:59.565385 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1f664-8d64-4113-90fe-3c86bfb31d2b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:59.569844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 283/557] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:01:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:01:59.571427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e5667-7df0-4ab9-a10d-8960824c6145 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:59.571859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e5667-7df0-4ab9-a10d-8960824c6145 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:59.572800 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e5667-7df0-4ab9-a10d-8960824c6145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:59.574138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1f664-8d64-4113-90fe-3c86bfb31d2b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:59.575682 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1f664-8d64-4113-90fe-3c86bfb31d2b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:59.591886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e09e5667-7df0-4ab9-a10d-8960824c6145 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:01:59.592538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-11a1f664-8d64-4113-90fe-3c86bfb31d2b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:01:59.592538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:59.592538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:59.592538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:59.592538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:59.592538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:59.592538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:59.592538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:59.592538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:59.592538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:59.592538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:59.592538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:59.592538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:01:59.592538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:01:59.592538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:01:59.592538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:01:59.593940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:59.593940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:59.593940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:01:59.593940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:01:59.593940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:01:59.593940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:01:59.593940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:59.593940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:59.593940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:59.593940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:59.593940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:59.593940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:59.593940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:59.593940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:59.593940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:59.593940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:59.593940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:59.593940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:59.594868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:59.594868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:59.594868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:01:59.594868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:01:59.594868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:01:59.594868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:01:59.594868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:01:59.594868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:01:59.594868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:01:59.594868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:59.596613 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e09e5667-7df0-4ab9-a10d-8960824c6145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:01:59.598308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 275/558] 10.222.0.48 () {56 vars in 1093 bytes} [Mon Jul 25 12:01:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:59.599343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1f664-8d64-4113-90fe-3c86bfb31d2b None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:59.666796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 284/559] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:01:59.668160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e5667-7df0-4ab9-a10d-8960824c6145 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:59.727207 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1f664-8d64-4113-90fe-3c86bfb31d2b None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:59.775172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27f84b-b11b-477c-a15f-4dd22ebcd6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:59.776835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27f84b-b11b-477c-a15f-4dd22ebcd6bc None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:59.777122 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27f84b-b11b-477c-a15f-4dd22ebcd6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:59.777400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27f84b-b11b-477c-a15f-4dd22ebcd6bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:59.779717 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:59.800275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27f84b-b11b-477c-a15f-4dd22ebcd6bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:59.801820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e5667-7df0-4ab9-a10d-8960824c6145 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:59.801970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27f84b-b11b-477c-a15f-4dd22ebcd6bc None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:59.823576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-6a27f84b-b11b-477c-a15f-4dd22ebcd6bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:59.823576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:01:59.823576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:01:59.823576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:01:59.823576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:01:59.823576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:01:59.823576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:01:59.823576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:01:59.823576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:01:59.823576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:01:59.823576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:01:59.823576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:01:59.823576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:01:59.823576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:01:59.823576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:01:59.824736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:01:59.824736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:01:59.824736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:01:59.824736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:01:59.824736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:01:59.824736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:01:59.824736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:01:59.824736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:01:59.824736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:01:59.824736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:01:59.824736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:01:59.824736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:01:59.824736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:01:59.824736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:01:59.824736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:01:59.824736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:01:59.824736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:01:59.825797 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:01:59.825797 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:01:59.825797 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:01:59.825797 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:01:59.829472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 276/560] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:01:59.830332 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27f84b-b11b-477c-a15f-4dd22ebcd6bc None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:59.854956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad5bc3-af51-4d39-a518-b93a8d55b334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:59.855625 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad5bc3-af51-4d39-a518-b93a8d55b334 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:59.855907 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad5bc3-af51-4d39-a518-b93a8d55b334 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:59.856180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad5bc3-af51-4d39-a518-b93a8d55b334 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:59.857163 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad5bc3-af51-4d39-a518-b93a8d55b334 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:01:59.857623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad5bc3-af51-4d39-a518-b93a8d55b334 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:01:59.859014 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad5bc3-af51-4d39-a518-b93a8d55b334 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:01:59.860416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:01:59.878902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 285/561] 10.222.0.48 () {56 vars in 1133 bytes} [Mon Jul 25 12:01:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:01:59.880326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddec74-dabf-4e2c-8498-1ea374adbcd1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:59.880680 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddec74-dabf-4e2c-8498-1ea374adbcd1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:59.881021 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddec74-dabf-4e2c-8498-1ea374adbcd1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:59.882484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 286/562] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:01:59.886774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddec74-dabf-4e2c-8498-1ea374adbcd1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:01:59.946147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27f84b-b11b-477c-a15f-4dd22ebcd6bc None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:59.987048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108a7c2-98c2-4252-9e89-b7d287335bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:01:59.987908 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108a7c2-98c2-4252-9e89-b7d287335bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:01:59.988118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108a7c2-98c2-4252-9e89-b7d287335bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:01:59.988386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108a7c2-98c2-4252-9e89-b7d287335bd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:01:59.992557 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddec74-dabf-4e2c-8498-1ea374adbcd1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:01:59.999430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108a7c2-98c2-4252-9e89-b7d287335bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:00.007328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-0108a7c2-98c2-4252-9e89-b7d287335bd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:00.007328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:00.007328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:00.007328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:00.007328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:00.007328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:00.007328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:00.007328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:00.007328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:00.007328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:00.007328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:00.007328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:00.007328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:00.007328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:00.007328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:00.007328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:00.008315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:00.008315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:00.008315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:00.008315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:00.008315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:00.008315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:00.008315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:00.008315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:00.008315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:00.008315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:00.008315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:00.008315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:00.008315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:00.008315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:00.008315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:00.008315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:00.009164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:00.009164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:00.009164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:00.009164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:00.009164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:00.009164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:00.009164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:00.009164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:00.009164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:00.009164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:00.009164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:00.009164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:00.009164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 277/563] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:01:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:00.011477 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108a7c2-98c2-4252-9e89-b7d287335bd6 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:00.034188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ca813-d008-4986-8e48-30da971d4b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:00.034885 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ca813-d008-4986-8e48-30da971d4b93 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:00.035170 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ca813-d008-4986-8e48-30da971d4b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:00.035442 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ca813-d008-4986-8e48-30da971d4b93 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:00.036162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ca813-d008-4986-8e48-30da971d4b93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:00.036465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ca813-d008-4986-8e48-30da971d4b93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:00.037834 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ca813-d008-4986-8e48-30da971d4b93 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:00.054886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 287/564] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:00.054886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4981-53a0-49ed-aa37-1205258058d6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:00.054886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4981-53a0-49ed-aa37-1205258058d6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:00.054886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4981-53a0-49ed-aa37-1205258058d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:00.068949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:00.074985 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-98ea4981-53a0-49ed-aa37-1205258058d6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:00.076158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-98ea4981-53a0-49ed-aa37-1205258058d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:00.110251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:00.128533 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108a7c2-98c2-4252-9e89-b7d287335bd6 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:00.152020 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 288/565] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:02:00.152946 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea4981-53a0-49ed-aa37-1205258058d6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:00.170666 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c37b02-19e5-4638-b434-1dec7da2733e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:00.172051 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c37b02-19e5-4638-b434-1dec7da2733e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:00.172546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c37b02-19e5-4638-b434-1dec7da2733e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:00.173521 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c37b02-19e5-4638-b434-1dec7da2733e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:00.187198 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c37b02-19e5-4638-b434-1dec7da2733e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:00.188634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c37b02-19e5-4638-b434-1dec7da2733e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:00.207991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-b4c37b02-19e5-4638-b434-1dec7da2733e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:00.207991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:00.207991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:00.207991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:00.207991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:00.207991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:00.207991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:00.207991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:00.207991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:00.207991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:00.207991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:00.207991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:00.207991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:00.207991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:00.207991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:00.208891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:00.208891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:00.208891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:00.208891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:00.208891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:00.208891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:00.208891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:00.208891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:00.208891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:00.208891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:00.208891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:00.208891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:00.208891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:00.208891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:00.208891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:00.208891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:00.208891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:00.209736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:00.209736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:00.209736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:00.209736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:00.209736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 278/566] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:00.210598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c37b02-19e5-4638-b434-1dec7da2733e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:00.264097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea4981-53a0-49ed-aa37-1205258058d6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:00.297725 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5bc5a-796b-4cb9-80ae-e304aa397913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:00.298347 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5bc5a-796b-4cb9-80ae-e304aa397913 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:00.298632 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5bc5a-796b-4cb9-80ae-e304aa397913 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:00.298902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5bc5a-796b-4cb9-80ae-e304aa397913 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:00.299649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5bc5a-796b-4cb9-80ae-e304aa397913 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:00.299958 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5bc5a-796b-4cb9-80ae-e304aa397913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:00.301324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5bc5a-796b-4cb9-80ae-e304aa397913 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:00.303509 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:00.310595 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 289/567] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:02:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:00.311468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5bc5a-796b-4cb9-80ae-e304aa397913 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:00.325703 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c37b02-19e5-4638-b434-1dec7da2733e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:00.361894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749f091-3bcd-455a-97a2-d757abfb9546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:00.363037 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749f091-3bcd-455a-97a2-d757abfb9546 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:00.363490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749f091-3bcd-455a-97a2-d757abfb9546 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:00.363933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749f091-3bcd-455a-97a2-d757abfb9546 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:00.371765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749f091-3bcd-455a-97a2-d757abfb9546 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:00.373651 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749f091-3bcd-455a-97a2-d757abfb9546 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:00.376444 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:00.390767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-5749f091-3bcd-455a-97a2-d757abfb9546 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:00.390767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:00.390767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:00.390767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:00.390767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:00.390767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:00.390767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:00.390767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:00.390767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:00.390767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:00.390767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:00.390767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:00.390767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:00.390767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:00.390767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:00.391880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:00.391880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:00.391880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:00.391880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:00.391880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:00.391880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:00.391880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:00.391880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:00.391880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:00.391880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:00.391880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:00.391880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:00.391880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:00.391880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:00.391880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:00.391880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:00.391880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:00.392749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:00.392749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:00.392749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:00.392749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:00.392749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:00.392749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:00.392749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:00.392749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:00.392749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 279/568] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:00.392749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749f091-3bcd-455a-97a2-d757abfb9546 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:00.418146 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5bc5a-796b-4cb9-80ae-e304aa397913 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:00.457534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e12c4-2376-471b-97a4-d5320642aea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:00.458410 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e12c4-2376-471b-97a4-d5320642aea7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:00.458655 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e12c4-2376-471b-97a4-d5320642aea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:00.458924 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e12c4-2376-471b-97a4-d5320642aea7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:00.474761 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e12c4-2376-471b-97a4-d5320642aea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:00.483007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d75e12c4-2376-471b-97a4-d5320642aea7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:00.483007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:00.483007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:00.483007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:00.483007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:00.483007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:00.483007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:00.483007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:00.483007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:00.483007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:00.483007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:00.483007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:00.483007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:00.483007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:00.483007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:00.483007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:00.483884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:00.483884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:00.483884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:00.483884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:00.483884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:00.483884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:00.483884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:00.483884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:00.483884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:00.483884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:00.483884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:00.483884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:00.483884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:00.483884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:00.483884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:00.483884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:00.484697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:00.484697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:00.484697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:00.484697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:00.484697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:00.484697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:00.484697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:00.484697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:00.484697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:00.484697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:00.484697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:00.484697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:00.484697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 290/569] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:02:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:00.485368 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e12c4-2376-471b-97a4-d5320642aea7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:00.508325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749f091-3bcd-455a-97a2-d757abfb9546 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:00.542711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3635289-f791-443a-8372-3c4c071cf194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:00.543374 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3635289-f791-443a-8372-3c4c071cf194 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:00.543657 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3635289-f791-443a-8372-3c4c071cf194 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:00.543938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3635289-f791-443a-8372-3c4c071cf194 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:00.544664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3635289-f791-443a-8372-3c4c071cf194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:00.544973 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3635289-f791-443a-8372-3c4c071cf194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:00.546355 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3635289-f791-443a-8372-3c4c071cf194 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:00.546600 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:00.563009 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 280/570] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:00.563009 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3635289-f791-443a-8372-3c4c071cf194 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:00.599918 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e12c4-2376-471b-97a4-d5320642aea7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:00.620739 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:00.634889 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e92291-5f4b-437c-bf56-a1543865231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:00.635694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e92291-5f4b-437c-bf56-a1543865231a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:00.635977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e92291-5f4b-437c-bf56-a1543865231a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:00.636249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e92291-5f4b-437c-bf56-a1543865231a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:00.647640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e92291-5f4b-437c-bf56-a1543865231a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:00.649079 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e92291-5f4b-437c-bf56-a1543865231a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:00.660821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3635289-f791-443a-8372-3c4c071cf194 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:00.666573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-37e92291-5f4b-437c-bf56-a1543865231a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:00.666573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:00.666573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:00.666573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:00.666573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:00.666573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:00.666573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:00.666573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:00.666573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:00.666573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:00.666573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:00.666573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:00.666573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:00.666573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:00.666573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:00.667909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:00.667909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:00.667909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:00.667909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:00.667909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:00.667909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:00.667909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:00.667909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:00.667909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:00.667909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:00.667909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:00.667909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:00.667909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:00.667909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:00.667909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:00.667909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:00.667909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:00.668801 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:00.668801 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:00.668801 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:00.668801 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:00.668801 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 291/571] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:00.668801 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e92291-5f4b-437c-bf56-a1543865231a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:00.696402 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cfc49-cbe7-41c7-a6eb-4ea03cc2cee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:00.697071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cfc49-cbe7-41c7-a6eb-4ea03cc2cee3 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:00.697358 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cfc49-cbe7-41c7-a6eb-4ea03cc2cee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:00.697638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cfc49-cbe7-41c7-a6eb-4ea03cc2cee3 None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:00.698464 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cfc49-cbe7-41c7-a6eb-4ea03cc2cee3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:00.698783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cfc49-cbe7-41c7-a6eb-4ea03cc2cee3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:00.700188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cfc49-cbe7-41c7-a6eb-4ea03cc2cee3 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:00.712070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 281/572] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:00.713344 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cfc49-cbe7-41c7-a6eb-4ea03cc2cee3 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:00.769142 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e92291-5f4b-437c-bf56-a1543865231a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:00.779390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:00.804763 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8170cda-c00d-4b10-adb7-9432e0bd9dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:00.805436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8170cda-c00d-4b10-adb7-9432e0bd9dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:00.805718 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8170cda-c00d-4b10-adb7-9432e0bd9dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:00.805992 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8170cda-c00d-4b10-adb7-9432e0bd9dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:00.806763 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8170cda-c00d-4b10-adb7-9432e0bd9dc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:00.807069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8170cda-c00d-4b10-adb7-9432e0bd9dc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:00.808439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8170cda-c00d-4b10-adb7-9432e0bd9dc9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:00.811440 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cfc49-cbe7-41c7-a6eb-4ea03cc2cee3 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:00.816208 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 292/573] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:02:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:00.817349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb8df2-c1ac-4a06-bd2c-dbcd4d54527a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:00.817634 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb8df2-c1ac-4a06-bd2c-dbcd4d54527a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:00.817910 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb8df2-c1ac-4a06-bd2c-dbcd4d54527a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:00.819164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 293/574] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:00.819847 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb8df2-c1ac-4a06-bd2c-dbcd4d54527a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:00.834213 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:00.848804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e18eaa-fa00-4037-8802-63a53a754a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:00.849596 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e18eaa-fa00-4037-8802-63a53a754a37 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:00.849880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e18eaa-fa00-4037-8802-63a53a754a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:00.850190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e18eaa-fa00-4037-8802-63a53a754a37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:00.857348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e18eaa-fa00-4037-8802-63a53a754a37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:00.858803 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e18eaa-fa00-4037-8802-63a53a754a37 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:00.872429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-40e18eaa-fa00-4037-8802-63a53a754a37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:00.872429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:00.872429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:00.872429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:00.872429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:00.872429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:00.872429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:00.872429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:00.872429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:00.872429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:00.872429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:00.872429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:00.872429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:00.872429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:00.872429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:00.873452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:00.873452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:00.873452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:00.873452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:00.873452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:00.873452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:00.873452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:00.873452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:00.873452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:00.873452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:00.873452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:00.873452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:00.873452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:00.873452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:00.873452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:00.873452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:00.873452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:00.874433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:00.874433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:00.874433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:00.874433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:00.874433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:00.874433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:00.874433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:00.874433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:00.874433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 282/575] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:00.874433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e18eaa-fa00-4037-8802-63a53a754a37 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:00.924455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb8df2-c1ac-4a06-bd2c-dbcd4d54527a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:00.957081 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b5288-1ad1-405f-b83a-a54f9890ad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:00.957732 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b5288-1ad1-405f-b83a-a54f9890ad06 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:00.958039 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b5288-1ad1-405f-b83a-a54f9890ad06 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:00.958314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b5288-1ad1-405f-b83a-a54f9890ad06 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:00.959028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b5288-1ad1-405f-b83a-a54f9890ad06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:00.959331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b5288-1ad1-405f-b83a-a54f9890ad06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:00.960730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b5288-1ad1-405f-b83a-a54f9890ad06 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:00.972165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 294/576] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:00.972809 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e18eaa-fa00-4037-8802-63a53a754a37 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:00.972916 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b5288-1ad1-405f-b83a-a54f9890ad06 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:01.003342 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:01.007808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb08ce9-ecaa-42d8-a7ef-599343cf3505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:01.008466 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb08ce9-ecaa-42d8-a7ef-599343cf3505 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:01.008749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb08ce9-ecaa-42d8-a7ef-599343cf3505 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:01.009028 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb08ce9-ecaa-42d8-a7ef-599343cf3505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:01.009863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb08ce9-ecaa-42d8-a7ef-599343cf3505 None admin] RBAC: Adding query filter params (role.id=0f49ec405a3c42a99beaaa0c79e67c5e, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=e71de21b4b6d4971953f0c1ca92d9f23) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:01.010210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb08ce9-ecaa-42d8-a7ef-599343cf3505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:01.011637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb08ce9-ecaa-42d8-a7ef-599343cf3505 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:01.017024 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 283/577] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:02:00 2022] GET /identity/v3/role_assignments?user.id=e71de21b4b6d4971953f0c1ca92d9f23&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=0f49ec405a3c42a99beaaa0c79e67c5e => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:01.018280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96edba8-de49-4384-86f2-445289ef03c6 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:01.018574 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96edba8-de49-4384-86f2-445289ef03c6 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:01.018851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96edba8-de49-4384-86f2-445289ef03c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:01.049532 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-d96edba8-de49-4384-86f2-445289ef03c6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:01.050820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d96edba8-de49-4384-86f2-445289ef03c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:01.082251 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b5288-1ad1-405f-b83a-a54f9890ad06 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:01.097182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:01.122473 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab9de5-3227-40dd-9252-c3f97b98f9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:01.123294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab9de5-3227-40dd-9252-c3f97b98f9fa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:01.123576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab9de5-3227-40dd-9252-c3f97b98f9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:01.123846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab9de5-3227-40dd-9252-c3f97b98f9fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:01.134093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 284/578] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:02:01.134093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96edba8-de49-4384-86f2-445289ef03c6 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:01.144185 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab9de5-3227-40dd-9252-c3f97b98f9fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:01.146631 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab9de5-3227-40dd-9252-c3f97b98f9fa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:01.170420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2aab9de5-3227-40dd-9252-c3f97b98f9fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:01.170420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:01.170420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:01.170420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:01.170420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:01.170420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:01.170420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:01.170420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:01.170420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:01.170420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:01.170420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:01.170420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:01.170420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:01.170420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:01.170420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:01.171969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:01.171969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:01.171969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:01.171969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:01.171969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:01.171969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:01.171969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:01.171969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:01.171969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:01.171969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:01.171969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:01.171969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:01.171969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:01.171969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:01.171969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:01.171969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:01.171969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:01.173034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:01.173034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:01.173034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:01.173034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:01.173034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 295/579] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:01.173034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab9de5-3227-40dd-9252-c3f97b98f9fa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:01.242637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96edba8-de49-4384-86f2-445289ef03c6 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:01.262028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:01.279401 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab9de5-3227-40dd-9252-c3f97b98f9fa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:01.280256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcddfab-cb4b-4008-8e6d-1cee2b480e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:01.281022 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcddfab-cb4b-4008-8e6d-1cee2b480e81 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:01.281397 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcddfab-cb4b-4008-8e6d-1cee2b480e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:01.281795 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcddfab-cb4b-4008-8e6d-1cee2b480e81 None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:01.282713 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcddfab-cb4b-4008-8e6d-1cee2b480e81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:01.283084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcddfab-cb4b-4008-8e6d-1cee2b480e81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:01.284556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcddfab-cb4b-4008-8e6d-1cee2b480e81 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:01.301453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 285/580] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:01.301453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcddfab-cb4b-4008-8e6d-1cee2b480e81 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:01.321455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e8551-51c4-4dda-b745-a01111aaec40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:01.322960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e8551-51c4-4dda-b745-a01111aaec40 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:01.323502 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e8551-51c4-4dda-b745-a01111aaec40 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:01.323728 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e8551-51c4-4dda-b745-a01111aaec40 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:01.332342 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:01.333618 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e8551-51c4-4dda-b745-a01111aaec40 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:01.334872 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e8551-51c4-4dda-b745-a01111aaec40 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:01.350451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4f3e8551-51c4-4dda-b745-a01111aaec40 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 12:02:01.350451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:01.350451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:01.350451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:01.350451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:01.350451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:01.350451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:01.350451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:01.350451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:01.350451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:01.350451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:01.350451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:01.350451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:01.350451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:01.350451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:01.350451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:01.351576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:01.351576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:01.351576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:01.351576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:01.351576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:01.351576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:01.351576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:01.351576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:01.351576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:01.351576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:01.351576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:01.351576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:01.351576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:01.351576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:01.351576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:01.351576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:01.351576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:01.351576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:01.352720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:01.352720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:01.352720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:01.352720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:01.352720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:01.352720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:01.352720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:01.352720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:01.352720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 12:02:01.352720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:01.356391 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 296/581] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:02:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:01.357151 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e8551-51c4-4dda-b745-a01111aaec40 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:01.404997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcddfab-cb4b-4008-8e6d-1cee2b480e81 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:01.443715 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cc2bd-9bbd-4250-88d0-9e20b3442a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:01.445326 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cc2bd-9bbd-4250-88d0-9e20b3442a77 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:01.445793 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cc2bd-9bbd-4250-88d0-9e20b3442a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:01.446499 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cc2bd-9bbd-4250-88d0-9e20b3442a77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:01.460680 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cc2bd-9bbd-4250-88d0-9e20b3442a77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:01.463918 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e8551-51c4-4dda-b745-a01111aaec40 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:01.469432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-8a8cc2bd-9bbd-4250-88d0-9e20b3442a77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:01.469432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:01.469432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:01.469432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:01.469432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:01.469432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:01.469432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:01.469432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:01.469432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:01.469432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:01.469432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:01.469432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:01.469432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:01.469432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:01.469432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:01.469432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:01.470312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:01.470312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:01.470312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:01.470312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:01.470312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:01.470312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:01.470312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:01.470312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:01.470312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:01.470312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:01.470312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:01.470312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:01.470312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:01.470312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:01.470312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:01.470312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:01.471107 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:01.471107 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:01.471107 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:01.471107 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:01.471107 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:01.471107 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:01.471107 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:01.471107 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:01.471107 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:01.471107 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:01.471107 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:01.471107 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:01.471107 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 286/582] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:02:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:01.471107 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cc2bd-9bbd-4250-88d0-9e20b3442a77 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:01.508273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0374e-6427-4c6a-b7e9-fb92c51611ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:01.508976 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0374e-6427-4c6a-b7e9-fb92c51611ef None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:01.509256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0374e-6427-4c6a-b7e9-fb92c51611ef None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:01.509531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0374e-6427-4c6a-b7e9-fb92c51611ef None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:01.510854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0374e-6427-4c6a-b7e9-fb92c51611ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:01.511168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0374e-6427-4c6a-b7e9-fb92c51611ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:01.512562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0374e-6427-4c6a-b7e9-fb92c51611ef None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:01.524776 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 297/583] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:01.530195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0374e-6427-4c6a-b7e9-fb92c51611ef None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:01.533683 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:01.580642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:01.588114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cc2bd-9bbd-4250-88d0-9e20b3442a77 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:01.627236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c216f6c-cbe1-4ba9-89bc-1a4a0f5c6c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:01.628117 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c216f6c-cbe1-4ba9-89bc-1a4a0f5c6c1d None admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:01.628404 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c216f6c-cbe1-4ba9-89bc-1a4a0f5c6c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:01.628682 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c216f6c-cbe1-4ba9-89bc-1a4a0f5c6c1d None admin] PATH_INFO: `/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/6d9db26891a04b0bb7e655c21feeffdd/roles/0f49ec405a3c42a99beaaa0c79e67c5e` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:01.636271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0374e-6427-4c6a-b7e9-fb92c51611ef None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:01.645396 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c216f6c-cbe1-4ba9-89bc-1a4a0f5c6c1d None admin] RBAC: Authorizing `identity:create_grant(project_id=8c80b9db7ace42c0a0cd1f31901599fd, user_id=6d9db26891a04b0bb7e655c21feeffdd, role_id=0f49ec405a3c42a99beaaa0c79e67c5e)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:01.647220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c216f6c-cbe1-4ba9-89bc-1a4a0f5c6c1d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:01.670036 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 287/584] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:02:01 2022] PUT /identity/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/6d9db26891a04b0bb7e655c21feeffdd/roles/0f49ec405a3c42a99beaaa0c79e67c5e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:02:01.670036 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c216f6c-cbe1-4ba9-89bc-1a4a0f5c6c1d None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:01.687350 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1b5aa-a406-43af-a1a5-84b0fa17c720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:01.688354 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1b5aa-a406-43af-a1a5-84b0fa17c720 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:01.688644 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1b5aa-a406-43af-a1a5-84b0fa17c720 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:01.688990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1b5aa-a406-43af-a1a5-84b0fa17c720 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:01.690420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1b5aa-a406-43af-a1a5-84b0fa17c720 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:01.691270 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1b5aa-a406-43af-a1a5-84b0fa17c720 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:01.693198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1b5aa-a406-43af-a1a5-84b0fa17c720 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:01.725186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 298/585] 10.222.0.48 () {56 vars in 1137 bytes} [Mon Jul 25 12:02:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:01.726117 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1b5aa-a406-43af-a1a5-84b0fa17c720 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:01.785497 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c216f6c-cbe1-4ba9-89bc-1a4a0f5c6c1d None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:01.809725 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:01.826751 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4c840-15e9-4bde-9eca-b7056deb7f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:01.827436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4c840-15e9-4bde-9eca-b7056deb7f6d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:01.827722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4c840-15e9-4bde-9eca-b7056deb7f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:01.828000 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4c840-15e9-4bde-9eca-b7056deb7f6d None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:01.828761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4c840-15e9-4bde-9eca-b7056deb7f6d None admin] RBAC: Adding query filter params (name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:01.829068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4c840-15e9-4bde-9eca-b7056deb7f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:01.830511 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4c840-15e9-4bde-9eca-b7056deb7f6d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:01.844452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 288/586] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:02:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:01.845439 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4c840-15e9-4bde-9eca-b7056deb7f6d None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:01.856720 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:01.859602 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1b5aa-a406-43af-a1a5-84b0fa17c720 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:01.909494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe551ea4-481b-4a60-b345-93f47ffcd417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:01.910873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe551ea4-481b-4a60-b345-93f47ffcd417 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:01.911164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe551ea4-481b-4a60-b345-93f47ffcd417 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:01.911445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe551ea4-481b-4a60-b345-93f47ffcd417 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:01.922787 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe551ea4-481b-4a60-b345-93f47ffcd417 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:01.924245 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe551ea4-481b-4a60-b345-93f47ffcd417 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:01.945061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fe551ea4-481b-4a60-b345-93f47ffcd417 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 12:02:01.945061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:01.945061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:01.945061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:01.945061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:01.945061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:01.945061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:01.945061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:01.945061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:01.945061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:01.945061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:01.945061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:01.945061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:01.945061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:01.945061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:01.945061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:01.946414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:01.946414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:01.946414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:01.946414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:01.946414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:01.946414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:01.946414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:01.946414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:01.946414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:01.946414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:01.946414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:01.946414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:01.946414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:01.946414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:01.946414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:01.946414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:01.946414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:01.946414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:01.948510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:01.948510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:01.948510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:01.948510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:01.948510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:01.948510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:01.948510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:01.948510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:01.948510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 12:02:01.948510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:01.950069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 299/587] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:02:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:01.951035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe551ea4-481b-4a60-b345-93f47ffcd417 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:01.968367 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4c840-15e9-4bde-9eca-b7056deb7f6d None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:02.005274 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f42e16-8277-4115-b79b-adb6950c470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:02.006385 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f42e16-8277-4115-b79b-adb6950c470d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:02.006813 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f42e16-8277-4115-b79b-adb6950c470d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:02.007230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f42e16-8277-4115-b79b-adb6950c470d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:02.019385 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f42e16-8277-4115-b79b-adb6950c470d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:02.021070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f42e16-8277-4115-b79b-adb6950c470d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:02.040643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-83f42e16-8277-4115-b79b-adb6950c470d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:02.040643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:02.040643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:02.040643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:02.040643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:02.040643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:02.040643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:02.040643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:02.040643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:02.040643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:02.040643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:02.040643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:02.040643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:02.040643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:02.040643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:02.042496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:02.042496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:02.042496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:02.042496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:02.042496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:02.042496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:02.042496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:02.042496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:02.042496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:02.042496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:02.042496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:02.042496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:02.042496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:02.042496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:02.042496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:02.042496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:02.042496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:02.043363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:02.043363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:02.043363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:02.043363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:02.045155 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 289/588] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:02.046265 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f42e16-8277-4115-b79b-adb6950c470d None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:02.091555 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe551ea4-481b-4a60-b345-93f47ffcd417 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:02.112756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:02.118106 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:02.133254 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86548d8d-4b9f-452b-ae39-a1745c510503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:02.134348 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86548d8d-4b9f-452b-ae39-a1745c510503 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:02.135180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86548d8d-4b9f-452b-ae39-a1745c510503 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:02.135673 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86548d8d-4b9f-452b-ae39-a1745c510503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:02.149710 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86548d8d-4b9f-452b-ae39-a1745c510503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:02.151777 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86548d8d-4b9f-452b-ae39-a1745c510503 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:02.161324 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f42e16-8277-4115-b79b-adb6950c470d None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:02.173040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-86548d8d-4b9f-452b-ae39-a1745c510503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:02.173040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:02.173040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:02.173040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:02.173040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:02.173040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:02.173040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:02.173040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:02.173040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:02.173040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:02.173040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:02.173040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:02.173040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:02.173040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:02.173040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:02.174445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:02.174445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:02.174445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:02.174445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:02.174445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:02.174445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:02.174445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:02.174445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:02.174445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:02.174445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:02.174445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:02.174445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:02.174445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:02.174445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:02.174445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:02.174445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:02.174445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:02.175458 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:02.175458 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:02.175458 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:02.175458 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:02.182373 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 300/589] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:02.183542 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86548d8d-4b9f-452b-ae39-a1745c510503 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:02.202121 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b7187-aa9d-4488-9e8d-2aaa257e2e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:02.202757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b7187-aa9d-4488-9e8d-2aaa257e2e15 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:02.203043 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b7187-aa9d-4488-9e8d-2aaa257e2e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:02.203318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b7187-aa9d-4488-9e8d-2aaa257e2e15 None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:02.204168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b7187-aa9d-4488-9e8d-2aaa257e2e15 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:02.204625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b7187-aa9d-4488-9e8d-2aaa257e2e15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:02.207382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b7187-aa9d-4488-9e8d-2aaa257e2e15 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:02.253275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 290/590] 10.222.0.48 () {56 vars in 1137 bytes} [Mon Jul 25 12:02:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:02.253275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b7187-aa9d-4488-9e8d-2aaa257e2e15 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:02.297913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86548d8d-4b9f-452b-ae39-a1745c510503 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:02.333435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad801493-0f18-4a73-a614-3e1e4dbbc5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:02.334379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad801493-0f18-4a73-a614-3e1e4dbbc5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:02.334916 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad801493-0f18-4a73-a614-3e1e4dbbc5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:02.335342 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad801493-0f18-4a73-a614-3e1e4dbbc5d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:02.336211 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad801493-0f18-4a73-a614-3e1e4dbbc5d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:02.337016 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad801493-0f18-4a73-a614-3e1e4dbbc5d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:02.339215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad801493-0f18-4a73-a614-3e1e4dbbc5d2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:02.352968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 301/591] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:02.354766 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad801493-0f18-4a73-a614-3e1e4dbbc5d2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:02.362249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b7187-aa9d-4488-9e8d-2aaa257e2e15 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:02.381251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:02.398702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:02.402282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaa156-b8b0-4f01-a381-723313043f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:02.403063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaa156-b8b0-4f01-a381-723313043f16 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:02.403480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaa156-b8b0-4f01-a381-723313043f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:02.403850 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaa156-b8b0-4f01-a381-723313043f16 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:02.404710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfaa156-b8b0-4f01-a381-723313043f16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:02.405149 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfaa156-b8b0-4f01-a381-723313043f16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:02.406655 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfaa156-b8b0-4f01-a381-723313043f16 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:02.422303 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 291/592] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:02.423286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaa156-b8b0-4f01-a381-723313043f16 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:02.478327 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad801493-0f18-4a73-a614-3e1e4dbbc5d2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:02.515074 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd00e98-0c7c-4fc4-891f-fd4238948c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:02.515982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd00e98-0c7c-4fc4-891f-fd4238948c0c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:02.516643 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd00e98-0c7c-4fc4-891f-fd4238948c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:02.516757 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd00e98-0c7c-4fc4-891f-fd4238948c0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:02.528125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd00e98-0c7c-4fc4-891f-fd4238948c0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:02.529829 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd00e98-0c7c-4fc4-891f-fd4238948c0c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:02.542629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaa156-b8b0-4f01-a381-723313043f16 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:02.549045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7dd00e98-0c7c-4fc4-891f-fd4238948c0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:02.549045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:02.549045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:02.549045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:02.549045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:02.549045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:02.549045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:02.549045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:02.549045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:02.549045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:02.549045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:02.549045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:02.549045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:02.549045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:02.549045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:02.549940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:02.549940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:02.549940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:02.549940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:02.549940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:02.549940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:02.549940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:02.549940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:02.549940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:02.549940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:02.549940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:02.549940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:02.549940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:02.549940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:02.549940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:02.549940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:02.549940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:02.550841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:02.550841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:02.550841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:02.550841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:02.550841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 302/593] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:02.551149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd00e98-0c7c-4fc4-891f-fd4238948c0c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:02.582914 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad804d0c-aa03-48e9-9222-313978eb15e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:02.584000 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad804d0c-aa03-48e9-9222-313978eb15e5 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:02.584497 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad804d0c-aa03-48e9-9222-313978eb15e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:02.584961 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad804d0c-aa03-48e9-9222-313978eb15e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:02.593209 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad804d0c-aa03-48e9-9222-313978eb15e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:02.594938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad804d0c-aa03-48e9-9222-313978eb15e5 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:02.612076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-ad804d0c-aa03-48e9-9222-313978eb15e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:02.612076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:02.612076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:02.612076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:02.612076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:02.612076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:02.612076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:02.612076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:02.612076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:02.612076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:02.612076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:02.612076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:02.612076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:02.612076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:02.612076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:02.613018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:02.613018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:02.613018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:02.613018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:02.613018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:02.613018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:02.613018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:02.613018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:02.613018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:02.613018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:02.613018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:02.613018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:02.613018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:02.613018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:02.613018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:02.613018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:02.613018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:02.613896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:02.613896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:02.613896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:02.613896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:02.613896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:02.613896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:02.613896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:02.613896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:02.616379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 292/594] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:02.617481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad804d0c-aa03-48e9-9222-313978eb15e5 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:02.642917 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:02.656898 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:02.660891 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd00e98-0c7c-4fc4-891f-fd4238948c0c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:02.698233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a363f53-ab87-4148-b48a-7e8c9eac764e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:02.699277 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a363f53-ab87-4148-b48a-7e8c9eac764e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:02.699744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a363f53-ab87-4148-b48a-7e8c9eac764e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:02.700163 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a363f53-ab87-4148-b48a-7e8c9eac764e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:02.708534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a363f53-ab87-4148-b48a-7e8c9eac764e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:02.710296 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a363f53-ab87-4148-b48a-7e8c9eac764e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:02.726256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4a363f53-ab87-4148-b48a-7e8c9eac764e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 12:02:02.726256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:02.726256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:02.726256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:02.726256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:02.726256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:02.726256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:02.726256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:02.726256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:02.726256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:02.726256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:02.726256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:02.726256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:02.726256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:02.726256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:02.726256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:02.727387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:02.727387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:02.727387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:02.727387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:02.727387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:02.727387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:02.727387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:02.727387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:02.727387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:02.727387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:02.727387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:02.727387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:02.727387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:02.727387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:02.727387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:02.727387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:02.727387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:02.727387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:02.728325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:02.728325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:02.728325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:02.728325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:02.728325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:02.728325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:02.728325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:02.728325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:02.728325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 12:02:02.728325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:02.730405 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 303/595] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:02:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:02.731390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a363f53-ab87-4148-b48a-7e8c9eac764e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:02.732721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad804d0c-aa03-48e9-9222-313978eb15e5 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:02.772771 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fff31-6c38-4cf7-8dea-0da37af01c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:02.773441 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fff31-6c38-4cf7-8dea-0da37af01c1e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:02.773726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fff31-6c38-4cf7-8dea-0da37af01c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:02.774054 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fff31-6c38-4cf7-8dea-0da37af01c1e None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:02.774762 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396fff31-6c38-4cf7-8dea-0da37af01c1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:02.775070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396fff31-6c38-4cf7-8dea-0da37af01c1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:02.777233 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396fff31-6c38-4cf7-8dea-0da37af01c1e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:02.790406 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 293/596] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:02.791285 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fff31-6c38-4cf7-8dea-0da37af01c1e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:02.841307 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a363f53-ab87-4148-b48a-7e8c9eac764e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:02.879524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9600-4515-4066-a0f3-b20edef9cfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:02.880674 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9600-4515-4066-a0f3-b20edef9cfab None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:02.881157 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9600-4515-4066-a0f3-b20edef9cfab None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:02.881649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9600-4515-4066-a0f3-b20edef9cfab None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:02.882765 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb9600-4515-4066-a0f3-b20edef9cfab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:02.883272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb9600-4515-4066-a0f3-b20edef9cfab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:02.885591 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb9600-4515-4066-a0f3-b20edef9cfab None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:02.899574 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:02.901887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 304/597] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:02.903019 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9600-4515-4066-a0f3-b20edef9cfab None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:02.907424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fff31-6c38-4cf7-8dea-0da37af01c1e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:02.912951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:02.946692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e898c-824f-417b-8a42-cea9252fd9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:02.948299 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e898c-824f-417b-8a42-cea9252fd9cf None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:02.948732 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e898c-824f-417b-8a42-cea9252fd9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:02.949154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e898c-824f-417b-8a42-cea9252fd9cf None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:02.950344 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e898c-824f-417b-8a42-cea9252fd9cf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:02.950891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e898c-824f-417b-8a42-cea9252fd9cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:02.952614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e898c-824f-417b-8a42-cea9252fd9cf None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:02.978087 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 294/598] 10.222.0.48 () {56 vars in 1139 bytes} [Mon Jul 25 12:02:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:02.979062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e898c-824f-417b-8a42-cea9252fd9cf None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:03.021746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9600-4515-4066-a0f3-b20edef9cfab None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:03.069259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a689253-1f02-4671-8d44-5975c510f8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:03.070591 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a689253-1f02-4671-8d44-5975c510f8ae None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:03.070877 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a689253-1f02-4671-8d44-5975c510f8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:03.071153 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a689253-1f02-4671-8d44-5975c510f8ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:03.081613 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a689253-1f02-4671-8d44-5975c510f8ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:03.083491 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a689253-1f02-4671-8d44-5975c510f8ae None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:03.095925 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e898c-824f-417b-8a42-cea9252fd9cf None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:03.098726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7a689253-1f02-4671-8d44-5975c510f8ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:03.098726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:03.098726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:03.098726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:03.098726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:03.098726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:03.098726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:03.098726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:03.098726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:03.098726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:03.098726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:03.098726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:03.098726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:03.098726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:03.098726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:03.099592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:03.099592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:03.099592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:03.099592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:03.099592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:03.099592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:03.099592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:03.099592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:03.099592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:03.099592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:03.099592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:03.099592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:03.099592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:03.099592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:03.099592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:03.099592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:03.099592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:03.100436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:03.100436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:03.100436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:03.100436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:03.100436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:03.100436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:03.100436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:03.100436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:03.101455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 305/599] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:03.102539 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a689253-1f02-4671-8d44-5975c510f8ae None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:03.131527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8f75e-d710-4b9f-a860-d399f5697c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:03.132416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8f75e-d710-4b9f-a860-d399f5697c98 None admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:03.132696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8f75e-d710-4b9f-a860-d399f5697c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:03.133115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8f75e-d710-4b9f-a860-d399f5697c98 None admin] PATH_INFO: `/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/cd52ff8138094d64bce9de60c819ab4a/roles/0f49ec405a3c42a99beaaa0c79e67c5e` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:03.150710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8f75e-d710-4b9f-a860-d399f5697c98 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c80b9db7ace42c0a0cd1f31901599fd, user_id=cd52ff8138094d64bce9de60c819ab4a, role_id=0f49ec405a3c42a99beaaa0c79e67c5e)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:03.152128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8f75e-d710-4b9f-a860-d399f5697c98 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:03.169249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 295/600] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:02:02 2022] PUT /identity/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/cd52ff8138094d64bce9de60c819ab4a/roles/0f49ec405a3c42a99beaaa0c79e67c5e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:02:03.169249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a5905-84a1-4d0c-b744-12ba23897484 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:03.169249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a5905-84a1-4d0c-b744-12ba23897484 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:03.169249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a5905-84a1-4d0c-b744-12ba23897484 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:03.169249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 296/601] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:03.169249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a5905-84a1-4d0c-b744-12ba23897484 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:03.179966 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:03.187110 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:03.228082 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a689253-1f02-4671-8d44-5975c510f8ae None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:03.270781 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a407e18-2d0c-4bfa-8d35-3e7ecd8b9ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:03.271747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a407e18-2d0c-4bfa-8d35-3e7ecd8b9ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:03.272578 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a407e18-2d0c-4bfa-8d35-3e7ecd8b9ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:03.272932 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a407e18-2d0c-4bfa-8d35-3e7ecd8b9ef1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:03.289423 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a407e18-2d0c-4bfa-8d35-3e7ecd8b9ef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:03.291167 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a407e18-2d0c-4bfa-8d35-3e7ecd8b9ef1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:03.305004 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a5905-84a1-4d0c-b744-12ba23897484 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:03.312064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9a407e18-2d0c-4bfa-8d35-3e7ecd8b9ef1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:03.312064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:03.312064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:03.312064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:03.312064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:03.312064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:03.312064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:03.312064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:03.312064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:03.312064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:03.312064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:03.312064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:03.312064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:03.312064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:03.312064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:03.312997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:03.312997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:03.312997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:03.312997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:03.312997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:03.312997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:03.312997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:03.312997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:03.312997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:03.312997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:03.312997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:03.312997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:03.312997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:03.312997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:03.312997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:03.312997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:03.312997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:03.313865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:03.313865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:03.313865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:03.313865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:03.313865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 306/602] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:03.315120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b2065-ae8e-4b9f-930a-6728b0dd7aa0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:03.315413 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b2065-ae8e-4b9f-930a-6728b0dd7aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:03.315694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b2065-ae8e-4b9f-930a-6728b0dd7aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:03.337196 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a27b2065-ae8e-4b9f-930a-6728b0dd7aa0 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:03.338659 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a27b2065-ae8e-4b9f-930a-6728b0dd7aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:03.352352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c77e96-9068-40bc-afd7-18d8205bd0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:03.354026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c77e96-9068-40bc-afd7-18d8205bd0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:03.354498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c77e96-9068-40bc-afd7-18d8205bd0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:03.354949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c77e96-9068-40bc-afd7-18d8205bd0c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:03.356085 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c77e96-9068-40bc-afd7-18d8205bd0c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:03.357027 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c77e96-9068-40bc-afd7-18d8205bd0c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:03.358981 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c77e96-9068-40bc-afd7-18d8205bd0c4 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:03.374132 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 297/603] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:03.375259 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c77e96-9068-40bc-afd7-18d8205bd0c4 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:03.419767 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 307/604] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:02:03.420845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b2065-ae8e-4b9f-930a-6728b0dd7aa0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:03.444705 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:03.489694 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c77e96-9068-40bc-afd7-18d8205bd0c4 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:03.491798 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:03.527153 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74061b-76ea-47d2-b573-8cc79038a760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:03.527992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74061b-76ea-47d2-b573-8cc79038a760 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:03.528373 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74061b-76ea-47d2-b573-8cc79038a760 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:03.528749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74061b-76ea-47d2-b573-8cc79038a760 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:03.529749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74061b-76ea-47d2-b573-8cc79038a760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:03.530158 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74061b-76ea-47d2-b573-8cc79038a760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:03.531740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74061b-76ea-47d2-b573-8cc79038a760 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:03.545327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 298/605] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:03.546310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74061b-76ea-47d2-b573-8cc79038a760 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:03.559666 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b2065-ae8e-4b9f-930a-6728b0dd7aa0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:03.602390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df298e6-9910-46e5-8e77-1a81307cb673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:03.603442 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df298e6-9910-46e5-8e77-1a81307cb673 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:03.604344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df298e6-9910-46e5-8e77-1a81307cb673 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:03.604860 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df298e6-9910-46e5-8e77-1a81307cb673 None admin] PATH_INFO: `/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/f014af35de5c47ab86ec02ebed360678/roles/0f49ec405a3c42a99beaaa0c79e67c5e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:03.620853 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df298e6-9910-46e5-8e77-1a81307cb673 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c80b9db7ace42c0a0cd1f31901599fd, user_id=f014af35de5c47ab86ec02ebed360678, role_id=0f49ec405a3c42a99beaaa0c79e67c5e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:03.622528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df298e6-9910-46e5-8e77-1a81307cb673 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:03.639355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 308/606] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:02:03 2022] PUT /identity/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/f014af35de5c47ab86ec02ebed360678/roles/0f49ec405a3c42a99beaaa0c79e67c5e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:02:03.640467 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df298e6-9910-46e5-8e77-1a81307cb673 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:03.715209 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74061b-76ea-47d2-b573-8cc79038a760 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:03.743574 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:03.757854 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b705b7-fb16-412d-ac5e-39dc01ba823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:03.759122 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b705b7-fb16-412d-ac5e-39dc01ba823a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:03.759763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b705b7-fb16-412d-ac5e-39dc01ba823a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:03.760240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b705b7-fb16-412d-ac5e-39dc01ba823a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:03.775313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b705b7-fb16-412d-ac5e-39dc01ba823a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:03.784986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-32b705b7-fb16-412d-ac5e-39dc01ba823a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:03.784986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:03.784986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:03.784986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:03.784986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:03.784986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:03.784986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:03.784986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:03.784986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:03.784986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:03.784986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:03.784986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:03.784986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:03.784986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:03.784986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:03.784986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:03.785978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:03.785978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:03.785978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:03.785978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:03.785978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:03.785978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:03.785978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:03.785978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:03.785978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:03.785978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:03.785978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:03.785978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:03.785978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:03.785978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:03.785978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:03.785978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:03.787128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:03.787128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:03.787128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:03.787128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:03.787128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:03.787128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:03.787128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:03.787128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:03.787128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:03.787128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:03.787128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:03.787128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:03.787128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 299/607] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:02:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:03.788182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1638080-2cf3-4364-9bdf-e1c15d1a70aa None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:03.788182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1638080-2cf3-4364-9bdf-e1c15d1a70aa None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:03.788439 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1638080-2cf3-4364-9bdf-e1c15d1a70aa None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:03.791749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 300/608] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:03.795448 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1638080-2cf3-4364-9bdf-e1c15d1a70aa None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:03.818785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:03.823697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df298e6-9910-46e5-8e77-1a81307cb673 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:03.875772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e82048-81b2-41cc-8748-1f74ef27db64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:03.876579 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e82048-81b2-41cc-8748-1f74ef27db64 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:03.876865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e82048-81b2-41cc-8748-1f74ef27db64 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:03.877139 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e82048-81b2-41cc-8748-1f74ef27db64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:03.885300 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e82048-81b2-41cc-8748-1f74ef27db64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:03.886897 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e82048-81b2-41cc-8748-1f74ef27db64 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:03.901344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f8e82048-81b2-41cc-8748-1f74ef27db64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:03.901344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:03.901344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:03.901344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:03.901344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:03.901344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:03.901344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:03.901344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:03.901344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:03.901344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:03.901344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:03.901344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:03.901344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:03.901344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:03.901344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:03.902272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:03.902272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:03.902272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:03.902272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:03.902272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:03.902272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:03.902272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:03.902272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:03.902272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:03.902272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:03.902272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:03.902272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:03.902272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:03.902272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:03.902272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:03.902272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:03.902272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:03.903195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:03.903195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:03.903195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:03.903195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:03.903195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:03.903195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:03.903195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:03.903195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:03.903195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 309/609] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:03.904231 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd89e9e-edbf-4223-9c87-796948a5002a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:03.904536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd89e9e-edbf-4223-9c87-796948a5002a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:03.904770 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd89e9e-edbf-4223-9c87-796948a5002a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:03.923623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cdd89e9e-edbf-4223-9c87-796948a5002a None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:03.924824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cdd89e9e-edbf-4223-9c87-796948a5002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:03.931180 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1638080-2cf3-4364-9bdf-e1c15d1a70aa None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:03.973637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ae06c-af26-46b4-ae7b-540fba816f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:03.974401 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ae06c-af26-46b4-ae7b-540fba816f5b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:03.974688 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ae06c-af26-46b4-ae7b-540fba816f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:03.974967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ae06c-af26-46b4-ae7b-540fba816f5b None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:03.976267 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ae06c-af26-46b4-ae7b-540fba816f5b None admin] RBAC: Adding query filter params (name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:03.976577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ae06c-af26-46b4-ae7b-540fba816f5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:03.978430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ae06c-af26-46b4-ae7b-540fba816f5b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:03.988739 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 301/610] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:02:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:03.989912 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ae06c-af26-46b4-ae7b-540fba816f5b None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:04.011196 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 310/611] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:02:04.012199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd89e9e-edbf-4223-9c87-796948a5002a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:04.056892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:04.114985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ae06c-af26-46b4-ae7b-540fba816f5b None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:04.118289 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:04.133685 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd89e9e-edbf-4223-9c87-796948a5002a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:04.153151 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1842df-80ea-4a0b-a9a6-b2c78f23eeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:04.153921 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1842df-80ea-4a0b-a9a6-b2c78f23eeb3 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:04.154240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1842df-80ea-4a0b-a9a6-b2c78f23eeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:04.154523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1842df-80ea-4a0b-a9a6-b2c78f23eeb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:04.155345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1842df-80ea-4a0b-a9a6-b2c78f23eeb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:04.155953 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1842df-80ea-4a0b-a9a6-b2c78f23eeb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:04.157333 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1842df-80ea-4a0b-a9a6-b2c78f23eeb3 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:04.174155 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 302/612] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:04.175035 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1842df-80ea-4a0b-a9a6-b2c78f23eeb3 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:04.176874 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0108a0d-f215-4d7f-a916-db9a79c8d828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:04.177676 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0108a0d-f215-4d7f-a916-db9a79c8d828 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:04.178393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0108a0d-f215-4d7f-a916-db9a79c8d828 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:04.178665 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0108a0d-f215-4d7f-a916-db9a79c8d828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:04.193792 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0108a0d-f215-4d7f-a916-db9a79c8d828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:04.196565 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0108a0d-f215-4d7f-a916-db9a79c8d828 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:04.221087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b0108a0d-f215-4d7f-a916-db9a79c8d828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:04.221087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:04.221087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:04.221087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:04.221087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:04.221087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:04.221087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:04.221087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:04.221087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:04.221087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:04.221087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:04.221087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:04.221087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:04.221087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:04.221087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:04.221977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:04.221977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:04.221977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:04.221977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:04.221977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:04.221977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:04.221977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:04.221977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:04.221977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:04.221977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:04.221977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:04.221977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:04.221977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:04.221977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:04.221977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:04.221977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:04.221977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:04.222870 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:04.222870 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:04.222870 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:04.222870 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:04.229638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 311/613] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:04.229638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0108a0d-f215-4d7f-a916-db9a79c8d828 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:04.297155 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1842df-80ea-4a0b-a9a6-b2c78f23eeb3 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:04.305091 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:04.334261 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176f732-1360-4ca8-bcbc-5f7a9677235a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:04.335250 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176f732-1360-4ca8-bcbc-5f7a9677235a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:04.335622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176f732-1360-4ca8-bcbc-5f7a9677235a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:04.335990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176f732-1360-4ca8-bcbc-5f7a9677235a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:04.339254 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0108a0d-f215-4d7f-a916-db9a79c8d828 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:04.347513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176f732-1360-4ca8-bcbc-5f7a9677235a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:04.355721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-6176f732-1360-4ca8-bcbc-5f7a9677235a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:04.355721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:04.355721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:04.355721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:04.355721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:04.355721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:04.355721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:04.355721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:04.355721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:04.355721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:04.355721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:04.355721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:04.355721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:04.355721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:04.355721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:04.355721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:04.356728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:04.356728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:04.356728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:04.356728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:04.356728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:04.356728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:04.356728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:04.356728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:04.356728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:04.356728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:04.356728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:04.356728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:04.356728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:04.356728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:04.356728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:04.356728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:04.357563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:04.357563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:04.357563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:04.357563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:04.357563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:04.357563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:04.357563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:04.357563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:04.357563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:04.357563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:04.357563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:04.357563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:04.361975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 303/614] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:02:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:04.362940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176f732-1360-4ca8-bcbc-5f7a9677235a None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:04.383636 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b077f-dff0-4d01-ba26-1d2c61ce4333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:04.383636 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b077f-dff0-4d01-ba26-1d2c61ce4333 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:04.383636 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b077f-dff0-4d01-ba26-1d2c61ce4333 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:04.383636 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b077f-dff0-4d01-ba26-1d2c61ce4333 None admin] PATH_INFO: `/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/fbc9fad7089b4c95ac92e846d46cb5a3/roles/0f49ec405a3c42a99beaaa0c79e67c5e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:04.402063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:04.407647 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b077f-dff0-4d01-ba26-1d2c61ce4333 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c80b9db7ace42c0a0cd1f31901599fd, user_id=fbc9fad7089b4c95ac92e846d46cb5a3, role_id=0f49ec405a3c42a99beaaa0c79e67c5e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:04.409948 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b077f-dff0-4d01-ba26-1d2c61ce4333 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:04.433617 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 312/615] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:02:04 2022] PUT /identity/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/fbc9fad7089b4c95ac92e846d46cb5a3/roles/0f49ec405a3c42a99beaaa0c79e67c5e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:02:04.433617 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b077f-dff0-4d01-ba26-1d2c61ce4333 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:04.525127 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176f732-1360-4ca8-bcbc-5f7a9677235a None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:04.607967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8bf6e-c351-49ed-be78-92cbf0d8f24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:04.608656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8bf6e-c351-49ed-be78-92cbf0d8f24d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:04.608935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8bf6e-c351-49ed-be78-92cbf0d8f24d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:04.609208 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8bf6e-c351-49ed-be78-92cbf0d8f24d None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:04.609945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8bf6e-c351-49ed-be78-92cbf0d8f24d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:04.611102 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8bf6e-c351-49ed-be78-92cbf0d8f24d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:04.612510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8bf6e-c351-49ed-be78-92cbf0d8f24d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:04.629259 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 304/616] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:04.636208 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8bf6e-c351-49ed-be78-92cbf0d8f24d None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:04.653152 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b077f-dff0-4d01-ba26-1d2c61ce4333 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:04.674108 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:04.692148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810e85d-958f-4c06-b8a8-54896923e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:04.693143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810e85d-958f-4c06-b8a8-54896923e57f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:04.693659 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810e85d-958f-4c06-b8a8-54896923e57f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:04.694159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810e85d-958f-4c06-b8a8-54896923e57f None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:04.695093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810e85d-958f-4c06-b8a8-54896923e57f None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:04.695608 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810e85d-958f-4c06-b8a8-54896923e57f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:04.697162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810e85d-958f-4c06-b8a8-54896923e57f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:04.708353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 313/617] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:02:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:04.715112 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810e85d-958f-4c06-b8a8-54896923e57f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:04.798932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8bf6e-c351-49ed-be78-92cbf0d8f24d None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:04.822200 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:04.867699 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab7ddd-92ad-4db9-8bf5-1886ead51a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:04.868904 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab7ddd-92ad-4db9-8bf5-1886ead51a8c None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:04.870117 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab7ddd-92ad-4db9-8bf5-1886ead51a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:04.870603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab7ddd-92ad-4db9-8bf5-1886ead51a8c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:04.882300 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810e85d-958f-4c06-b8a8-54896923e57f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:04.885941 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab7ddd-92ad-4db9-8bf5-1886ead51a8c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:04.887635 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab7ddd-92ad-4db9-8bf5-1886ead51a8c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:04.919067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-4bab7ddd-92ad-4db9-8bf5-1886ead51a8c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:02:04.919067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:04.919067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:04.919067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:04.919067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:04.919067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:04.919067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:04.919067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:04.919067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:04.919067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:04.919067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:04.919067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:04.919067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:04.919067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:04.919067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:04.919067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:04.920038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:04.920038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:04.920038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:04.920038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:04.920038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:04.920038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:04.920038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:04.920038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:04.920038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:04.920038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:04.920038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:04.920038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:04.920038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:04.920038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:04.920038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:04.920038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:04.920038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:04.920038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:04.920958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:04.920958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:04.920958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:04.920958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:04.920958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:04.920958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:04.920958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:04.920958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:04.920958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:02:04.920958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:04.920958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 305/618] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:02:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:04.927006 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab7ddd-92ad-4db9-8bf5-1886ead51a8c None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:04.930607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d1dde-a6a9-4d0c-b76b-24d0c833b51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:04.931412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d1dde-a6a9-4d0c-b76b-24d0c833b51c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:04.932349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d1dde-a6a9-4d0c-b76b-24d0c833b51c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:04.932626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d1dde-a6a9-4d0c-b76b-24d0c833b51c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:04.954041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d1dde-a6a9-4d0c-b76b-24d0c833b51c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:04.956315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d1dde-a6a9-4d0c-b76b-24d0c833b51c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:04.991640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e03d1dde-a6a9-4d0c-b76b-24d0c833b51c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:04.991640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:04.991640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:04.991640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:04.991640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:04.991640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:04.991640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:04.991640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:04.991640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:04.991640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:04.991640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:04.991640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:04.991640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:04.991640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:04.991640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:04.992543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:04.992543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:04.992543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:04.992543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:04.992543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:04.992543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:04.992543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:04.992543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:04.992543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:04.992543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:04.992543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:04.992543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:04.992543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:04.992543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:04.992543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:04.992543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:04.992543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:04.993530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:04.993530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:04.993530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:04.993530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:04.993530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 314/619] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:04.998844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d1dde-a6a9-4d0c-b76b-24d0c833b51c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:05.061960 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:05.087166 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab7ddd-92ad-4db9-8bf5-1886ead51a8c None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:05.149029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378c8aa-dc31-4d95-8b33-bf47ea594356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:05.149704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378c8aa-dc31-4d95-8b33-bf47ea594356 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:05.149986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378c8aa-dc31-4d95-8b33-bf47ea594356 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:05.150287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378c8aa-dc31-4d95-8b33-bf47ea594356 None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:05.151173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378c8aa-dc31-4d95-8b33-bf47ea594356 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:05.151481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378c8aa-dc31-4d95-8b33-bf47ea594356 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:05.152913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378c8aa-dc31-4d95-8b33-bf47ea594356 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:05.188329 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 306/620] 10.222.0.48 () {56 vars in 1135 bytes} [Mon Jul 25 12:02:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:05.191512 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d1dde-a6a9-4d0c-b76b-24d0c833b51c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:05.193399 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378c8aa-dc31-4d95-8b33-bf47ea594356 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:05.197403 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:05.281389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39642eed-a7ca-4d44-9bdd-1032f69a5c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:05.282105 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39642eed-a7ca-4d44-9bdd-1032f69a5c9b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:05.282393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39642eed-a7ca-4d44-9bdd-1032f69a5c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:05.282672 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39642eed-a7ca-4d44-9bdd-1032f69a5c9b None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:05.283410 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39642eed-a7ca-4d44-9bdd-1032f69a5c9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:05.283720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39642eed-a7ca-4d44-9bdd-1032f69a5c9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:05.285114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39642eed-a7ca-4d44-9bdd-1032f69a5c9b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:05.307509 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 315/621] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:05.315093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39642eed-a7ca-4d44-9bdd-1032f69a5c9b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:05.342041 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378c8aa-dc31-4d95-8b33-bf47ea594356 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:05.400946 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d7254-164c-4616-a0b2-28d663c7b305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:05.401827 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d7254-164c-4616-a0b2-28d663c7b305 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:05.402150 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d7254-164c-4616-a0b2-28d663c7b305 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:05.402431 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d7254-164c-4616-a0b2-28d663c7b305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:05.413719 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d7254-164c-4616-a0b2-28d663c7b305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:05.415326 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d7254-164c-4616-a0b2-28d663c7b305 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:05.419861 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:05.438853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-ca2d7254-164c-4616-a0b2-28d663c7b305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:05.438853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:05.438853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:05.438853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:05.438853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:05.438853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:05.438853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:05.438853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:05.438853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:05.438853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:05.438853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:05.438853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:05.438853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:05.438853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:05.438853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:05.439780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:05.439780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:05.439780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:05.439780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:05.439780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:05.439780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:05.439780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:05.439780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:05.439780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:05.439780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:05.439780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:05.439780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:05.439780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:05.439780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:05.439780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:05.439780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:05.439780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:05.440638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:05.440638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:05.440638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:05.440638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:05.440638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 307/622] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:05.441872 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2ba9b-7552-46e4-951a-18a4c50d4158 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:05.442189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2ba9b-7552-46e4-951a-18a4c50d4158 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:05.442474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2ba9b-7552-46e4-951a-18a4c50d4158 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:05.445292 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39642eed-a7ca-4d44-9bdd-1032f69a5c9b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:05.447946 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 308/623] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:05.448786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2ba9b-7552-46e4-951a-18a4c50d4158 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:05.490665 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05a985-4963-46fa-9486-aad4236c4ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:05.492348 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05a985-4963-46fa-9486-aad4236c4ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:05.492643 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05a985-4963-46fa-9486-aad4236c4ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:05.492924 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05a985-4963-46fa-9486-aad4236c4ed7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:05.502345 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05a985-4963-46fa-9486-aad4236c4ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:05.504074 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05a985-4963-46fa-9486-aad4236c4ed7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:05.526191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5a05a985-4963-46fa-9486-aad4236c4ed7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:02:05.526191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:05.526191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:05.526191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:05.526191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:05.526191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:05.526191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:05.526191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:05.526191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:05.526191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:05.526191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:05.526191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:05.526191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:05.526191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:05.526191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:05.526191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:05.527158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:05.527158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:05.527158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:05.527158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:05.527158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:05.527158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:05.527158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:05.527158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:05.527158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:05.527158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:05.527158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:05.527158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:05.527158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:05.527158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:05.527158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:05.527158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:05.527158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:05.527158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:05.528063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:05.528063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:05.528063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:05.528063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:05.528063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:05.528063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:05.528063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:05.528063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:05.528063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:02:05.528063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:05.532270 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 316/624] 10.222.0.48 () {56 vars in 1093 bytes} [Mon Jul 25 12:02:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:05.534201 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a623b82-7654-4122-8e77-abe559ff7cff None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:05.534496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a623b82-7654-4122-8e77-abe559ff7cff None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:05.534775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a623b82-7654-4122-8e77-abe559ff7cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:05.555468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4a623b82-7654-4122-8e77-abe559ff7cff None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:05.557022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4a623b82-7654-4122-8e77-abe559ff7cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:05.576033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:05.580603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2ba9b-7552-46e4-951a-18a4c50d4158 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:05.628144 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e8197-5680-4ec2-b056-bd6eae970233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:05.628815 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e8197-5680-4ec2-b056-bd6eae970233 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:05.629096 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e8197-5680-4ec2-b056-bd6eae970233 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:05.629369 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e8197-5680-4ec2-b056-bd6eae970233 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:05.630150 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e8197-5680-4ec2-b056-bd6eae970233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:05.630550 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e8197-5680-4ec2-b056-bd6eae970233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:05.630755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 317/625] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:02:05.631813 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a623b82-7654-4122-8e77-abe559ff7cff None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:05.631927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e8197-5680-4ec2-b056-bd6eae970233 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:05.647668 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 309/626] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:05.659009 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e8197-5680-4ec2-b056-bd6eae970233 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:05.717951 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:05.749474 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a623b82-7654-4122-8e77-abe559ff7cff None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:05.765481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e8197-5680-4ec2-b056-bd6eae970233 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:05.788370 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6e1e0-4009-4951-abaa-29158a290a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:05.789416 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6e1e0-4009-4951-abaa-29158a290a78 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:05.789944 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6e1e0-4009-4951-abaa-29158a290a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:05.790383 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6e1e0-4009-4951-abaa-29158a290a78 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:05.791898 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6e1e0-4009-4951-abaa-29158a290a78 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:05.792610 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6e1e0-4009-4951-abaa-29158a290a78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:05.794469 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6e1e0-4009-4951-abaa-29158a290a78 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:05.801653 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23dc7d-2647-4fbc-a13d-f0745734a8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:05.802504 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23dc7d-2647-4fbc-a13d-f0745734a8ab None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:05.802789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23dc7d-2647-4fbc-a13d-f0745734a8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:05.803067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23dc7d-2647-4fbc-a13d-f0745734a8ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:05.811873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23dc7d-2647-4fbc-a13d-f0745734a8ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:05.813411 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23dc7d-2647-4fbc-a13d-f0745734a8ab None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:05.817499 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 318/627] 10.222.0.48 () {56 vars in 1133 bytes} [Mon Jul 25 12:02:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:05.818582 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6e1e0-4009-4951-abaa-29158a290a78 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:05.836190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-bb23dc7d-2647-4fbc-a13d-f0745734a8ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:05.836190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:05.836190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:05.836190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:05.836190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:05.836190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:05.836190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:05.836190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:05.836190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:05.836190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:05.836190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:05.836190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:05.836190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:05.836190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:05.836190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:05.837283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:05.837283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:05.837283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:05.837283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:05.837283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:05.837283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:05.837283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:05.837283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:05.837283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:05.837283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:05.837283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:05.837283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:05.837283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:05.837283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:05.837283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:05.837283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:05.837283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:05.838358 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:05.838358 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:05.838358 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:05.838358 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:05.838358 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:05.838358 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:05.838358 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:05.838358 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:05.839332 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 310/628] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:05.839750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:05.840583 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23dc7d-2647-4fbc-a13d-f0745734a8ab None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:05.948595 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6e1e0-4009-4951-abaa-29158a290a78 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:05.964118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23dc7d-2647-4fbc-a13d-f0745734a8ab None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:05.983476 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:05.986601 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8ccf1-bafd-47b3-bc7a-4fd91797985c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:05.987394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8ccf1-bafd-47b3-bc7a-4fd91797985c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:05.987673 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8ccf1-bafd-47b3-bc7a-4fd91797985c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:05.988178 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8ccf1-bafd-47b3-bc7a-4fd91797985c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:05.998852 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8ccf1-bafd-47b3-bc7a-4fd91797985c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:06.002939 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301d35f-48d7-42cf-8f71-26b802b28091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:06.003674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301d35f-48d7-42cf-8f71-26b802b28091 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:06.004029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301d35f-48d7-42cf-8f71-26b802b28091 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:06.004383 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301d35f-48d7-42cf-8f71-26b802b28091 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:06.006515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ffd8ccf1-bafd-47b3-bc7a-4fd91797985c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:06.006515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:06.006515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:06.006515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:06.006515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:06.006515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:06.006515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:06.006515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:06.006515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:06.006515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:06.006515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:06.006515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:06.006515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:06.006515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:06.006515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:06.006515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:06.007412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:06.007412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:06.007412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:06.007412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:06.007412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:06.007412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:06.007412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:06.007412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:06.007412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:06.007412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:06.007412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:06.007412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:06.007412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:06.007412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:06.007412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:06.007412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:06.008221 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:06.008221 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:06.008221 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:06.008221 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:06.008221 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:06.008221 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:06.008221 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:06.008221 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:06.008221 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:06.008221 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:06.008221 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:06.008221 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:06.008221 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 319/629] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:02:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:06.009459 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8ccf1-bafd-47b3-bc7a-4fd91797985c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:06.082670 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:06.090897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301d35f-48d7-42cf-8f71-26b802b28091 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:06.092284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301d35f-48d7-42cf-8f71-26b802b28091 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:06.115622 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8ccf1-bafd-47b3-bc7a-4fd91797985c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:06.152403 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061415f-aa40-4470-a156-8e43b5a32e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:06.153065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061415f-aa40-4470-a156-8e43b5a32e43 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:06.153375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061415f-aa40-4470-a156-8e43b5a32e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:06.153622 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061415f-aa40-4470-a156-8e43b5a32e43 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:06.154678 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061415f-aa40-4470-a156-8e43b5a32e43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:06.155005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061415f-aa40-4470-a156-8e43b5a32e43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:06.156452 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061415f-aa40-4470-a156-8e43b5a32e43 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:06.169705 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 320/630] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:06.171007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c93d6e-bd89-4e7b-bf46-30d0b2a1ee73 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:06.171297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c93d6e-bd89-4e7b-bf46-30d0b2a1ee73 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:06.171573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c93d6e-bd89-4e7b-bf46-30d0b2a1ee73 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:06.172992 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 321/631] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:06.173484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c93d6e-bd89-4e7b-bf46-30d0b2a1ee73 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:06.210186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 311/632] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:02:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:02:06.211070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301d35f-48d7-42cf-8f71-26b802b28091 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:06.229739 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:06.279018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c93d6e-bd89-4e7b-bf46-30d0b2a1ee73 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:06.310518 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:06.314318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301d35f-48d7-42cf-8f71-26b802b28091 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:06.316858 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199a29a-d3b3-44e0-a730-23c4554d6800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:06.317530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199a29a-d3b3-44e0-a730-23c4554d6800 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:06.317812 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199a29a-d3b3-44e0-a730-23c4554d6800 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:06.318111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199a29a-d3b3-44e0-a730-23c4554d6800 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:06.318856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199a29a-d3b3-44e0-a730-23c4554d6800 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:06.319163 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199a29a-d3b3-44e0-a730-23c4554d6800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:06.320562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199a29a-d3b3-44e0-a730-23c4554d6800 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:06.329403 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 322/633] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:02:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:06.330514 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e526e-8485-4dac-8ce8-a3b63832ce1c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:06.330803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e526e-8485-4dac-8ce8-a3b63832ce1c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:06.331095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e526e-8485-4dac-8ce8-a3b63832ce1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:06.349722 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-536e526e-8485-4dac-8ce8-a3b63832ce1c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:06.350879 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-536e526e-8485-4dac-8ce8-a3b63832ce1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:06.354014 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16a7c6-dc53-4515-bd27-b42f6ec83e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:06.354987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16a7c6-dc53-4515-bd27-b42f6ec83e63 None admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:06.355283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16a7c6-dc53-4515-bd27-b42f6ec83e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:06.355578 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16a7c6-dc53-4515-bd27-b42f6ec83e63 None admin] PATH_INFO: `/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/e71de21b4b6d4971953f0c1ca92d9f23/roles/0f49ec405a3c42a99beaaa0c79e67c5e` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:06.371199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16a7c6-dc53-4515-bd27-b42f6ec83e63 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c80b9db7ace42c0a0cd1f31901599fd, user_id=e71de21b4b6d4971953f0c1ca92d9f23, role_id=0f49ec405a3c42a99beaaa0c79e67c5e)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:06.372628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16a7c6-dc53-4515-bd27-b42f6ec83e63 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:06.385854 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 312/634] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:02:06 2022] PUT /identity/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/e71de21b4b6d4971953f0c1ca92d9f23/roles/0f49ec405a3c42a99beaaa0c79e67c5e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:02:06.392183 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16a7c6-dc53-4515-bd27-b42f6ec83e63 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:06.441651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 323/635] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:02:06.444224 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e526e-8485-4dac-8ce8-a3b63832ce1c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:06.497915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:06.552856 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16a7c6-dc53-4515-bd27-b42f6ec83e63 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:06.582731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e526e-8485-4dac-8ce8-a3b63832ce1c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:06.591215 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58780ec3-f61f-4d9e-83cc-895d8ffd65fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:06.592770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58780ec3-f61f-4d9e-83cc-895d8ffd65fb None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:06.593376 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58780ec3-f61f-4d9e-83cc-895d8ffd65fb None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:06.593796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58780ec3-f61f-4d9e-83cc-895d8ffd65fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:06.607828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58780ec3-f61f-4d9e-83cc-895d8ffd65fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:06.609205 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58780ec3-f61f-4d9e-83cc-895d8ffd65fb None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:06.617375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:06.628416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-58780ec3-f61f-4d9e-83cc-895d8ffd65fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:06.628416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:06.628416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:06.628416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:06.628416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:06.628416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:06.628416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:06.628416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:06.628416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:06.628416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:06.628416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:06.628416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:06.628416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:06.628416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:06.628416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:06.629513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:06.629513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:06.629513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:06.629513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:06.629513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:06.629513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:06.629513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:06.629513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:06.629513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:06.629513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:06.629513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:06.629513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:06.629513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:06.629513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:06.629513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:06.629513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:06.629513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:06.630729 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:06.630729 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:06.630729 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:06.630729 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:06.630729 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 313/636] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:06.635358 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccb21f-0c7c-4155-ac17-a13dc1d0645d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:06.635502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58780ec3-f61f-4d9e-83cc-895d8ffd65fb None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:06.636589 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccb21f-0c7c-4155-ac17-a13dc1d0645d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:06.637024 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccb21f-0c7c-4155-ac17-a13dc1d0645d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:06.637463 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccb21f-0c7c-4155-ac17-a13dc1d0645d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:06.653464 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccb21f-0c7c-4155-ac17-a13dc1d0645d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:06.655668 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccb21f-0c7c-4155-ac17-a13dc1d0645d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:06.680942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-daccb21f-0c7c-4155-ac17-a13dc1d0645d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:06.680942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:06.680942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:06.680942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:06.680942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:06.680942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:06.680942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:06.680942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:06.680942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:06.680942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:06.680942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:06.680942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:06.680942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:06.680942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:06.680942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:06.682645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:06.682645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:06.682645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:06.682645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:06.682645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:06.682645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:06.682645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:06.682645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:06.682645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:06.682645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:06.682645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:06.682645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:06.682645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:06.682645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:06.682645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:06.682645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:06.682645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:06.683730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:06.683730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:06.683730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:06.683730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:06.686372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 324/637] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:06.687365 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccb21f-0c7c-4155-ac17-a13dc1d0645d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:06.757974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58780ec3-f61f-4d9e-83cc-895d8ffd65fb None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:06.778291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:06.797798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5bc37-40ea-4876-b13e-9d587e55ba8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:06.798623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5bc37-40ea-4876-b13e-9d587e55ba8b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:06.798912 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5bc37-40ea-4876-b13e-9d587e55ba8b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:06.799189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5bc37-40ea-4876-b13e-9d587e55ba8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:06.803799 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccb21f-0c7c-4155-ac17-a13dc1d0645d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:06.811905 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5bc37-40ea-4876-b13e-9d587e55ba8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:06.822918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-d0b5bc37-40ea-4876-b13e-9d587e55ba8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:06.822918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:06.822918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:06.822918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:06.822918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:06.822918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:06.822918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:06.822918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:06.822918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:06.822918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:06.822918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:06.822918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:06.822918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:06.822918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:06.822918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:06.822918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:06.824099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:06.824099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:06.824099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:06.824099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:06.824099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:06.824099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:06.824099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:06.824099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:06.824099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:06.824099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:06.824099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:06.824099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:06.824099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:06.824099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:06.824099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:06.824099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:06.825130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:06.825130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:06.825130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:06.825130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:06.825130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:06.825130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:06.825130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:06.825130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:06.825130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:06.825130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:06.825130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:06.825130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:06.825130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 314/638] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:02:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:06.826135 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5bc37-40ea-4876-b13e-9d587e55ba8b None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:06.843110 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0e181-c1e2-46fe-acad-94e0b6271bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:06.844001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0e181-c1e2-46fe-acad-94e0b6271bdb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:06.844443 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0e181-c1e2-46fe-acad-94e0b6271bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:06.844881 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0e181-c1e2-46fe-acad-94e0b6271bdb None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:06.845600 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0e181-c1e2-46fe-acad-94e0b6271bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:06.845913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0e181-c1e2-46fe-acad-94e0b6271bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:06.847301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0e181-c1e2-46fe-acad-94e0b6271bdb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:06.864201 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 325/639] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:06.864201 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252efe9e-ac21-43f9-9a98-38d69ffc5cee None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:06.864201 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252efe9e-ac21-43f9-9a98-38d69ffc5cee None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:06.864201 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252efe9e-ac21-43f9-9a98-38d69ffc5cee None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:06.864201 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 326/640] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:06.864201 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252efe9e-ac21-43f9-9a98-38d69ffc5cee None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:06.902228 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:06.944740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5bc37-40ea-4876-b13e-9d587e55ba8b None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:06.972033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252efe9e-ac21-43f9-9a98-38d69ffc5cee None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:06.979753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa275b7b-0519-4bc0-b9c6-5bcb802a58f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:06.980422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa275b7b-0519-4bc0-b9c6-5bcb802a58f8 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:06.980703 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa275b7b-0519-4bc0-b9c6-5bcb802a58f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:06.980976 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa275b7b-0519-4bc0-b9c6-5bcb802a58f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:06.981695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa275b7b-0519-4bc0-b9c6-5bcb802a58f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:06.982020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa275b7b-0519-4bc0-b9c6-5bcb802a58f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:06.983384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa275b7b-0519-4bc0-b9c6-5bcb802a58f8 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:06.996483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 315/641] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:06.997284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa275b7b-0519-4bc0-b9c6-5bcb802a58f8 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:07.012477 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e9843-401d-4652-9300-e9ea8c027d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:07.013158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e9843-401d-4652-9300-e9ea8c027d7e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:07.013440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e9843-401d-4652-9300-e9ea8c027d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:07.013719 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e9843-401d-4652-9300-e9ea8c027d7e None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:07.014509 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e9843-401d-4652-9300-e9ea8c027d7e None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:07.014815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e9843-401d-4652-9300-e9ea8c027d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:07.016194 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e9843-401d-4652-9300-e9ea8c027d7e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:07.024205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 327/642] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:02:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:07.025450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ba16e-47c9-4894-8a66-4835fb242443 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:07.025748 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ba16e-47c9-4894-8a66-4835fb242443 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:07.026044 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ba16e-47c9-4894-8a66-4835fb242443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:07.044392 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:07.044752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3c6ba16e-47c9-4894-8a66-4835fb242443 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:07.045974 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3c6ba16e-47c9-4894-8a66-4835fb242443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:07.109035 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa275b7b-0519-4bc0-b9c6-5bcb802a58f8 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:07.115962 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 328/643] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:02:07.116748 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ba16e-47c9-4894-8a66-4835fb242443 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:07.153326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:07.155761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a2bbc-4419-4410-976d-a4a676d7b08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:07.157638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a2bbc-4419-4410-976d-a4a676d7b08b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:07.158177 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a2bbc-4419-4410-976d-a4a676d7b08b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:07.158527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a2bbc-4419-4410-976d-a4a676d7b08b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:07.165978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a2bbc-4419-4410-976d-a4a676d7b08b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:07.168408 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a2bbc-4419-4410-976d-a4a676d7b08b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:07.183020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-a06a2bbc-4419-4410-976d-a4a676d7b08b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:07.183020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:07.183020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:07.183020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:07.183020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:07.183020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:07.183020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:07.183020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:07.183020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:07.183020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:07.183020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:07.183020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:07.183020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:07.183020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:07.183020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:07.184094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:07.184094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:07.184094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:07.184094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:07.184094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:07.184094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:07.184094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:07.184094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:07.184094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:07.184094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:07.184094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:07.184094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:07.184094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:07.184094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:07.184094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:07.184094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:07.184094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:07.185089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:07.185089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:07.185089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:07.185089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:07.185089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:07.185089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:07.185089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:07.185089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:07.185089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 316/644] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:07.189484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a2bbc-4419-4410-976d-a4a676d7b08b None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:07.234878 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ba16e-47c9-4894-8a66-4835fb242443 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:07.270279 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac2ec1-d278-47d7-b3ac-c767650739ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:07.271189 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac2ec1-d278-47d7-b3ac-c767650739ec None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:07.271472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac2ec1-d278-47d7-b3ac-c767650739ec None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:07.271749 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac2ec1-d278-47d7-b3ac-c767650739ec None admin] PATH_INFO: `/v3/users/glance` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:07.279047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac2ec1-d278-47d7-b3ac-c767650739ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:07.280720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac2ec1-d278-47d7-b3ac-c767650739ec None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:07.285814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:07.290400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a2bbc-4419-4410-976d-a4a676d7b08b None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:07.296653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a7ac2ec1-d278-47d7-b3ac-c767650739ec None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 12:02:07.296653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:07.296653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:07.296653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:07.296653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:07.296653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:07.296653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:07.296653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:07.296653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:07.296653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:07.296653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:07.296653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:07.296653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:07.296653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:07.296653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:07.296653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:07.297708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:07.297708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:07.297708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:07.297708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:07.297708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:07.297708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:07.297708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:07.297708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:07.297708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:07.297708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:07.297708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:07.297708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:07.297708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:07.297708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:07.297708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:07.297708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:07.297708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:07.297708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:07.298817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:07.298817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:07.298817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:07.298817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:07.298817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:07.298817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:07.298817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:07.298817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:07.298817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 12:02:07.298817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:07.298817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 329/645] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:02:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:07.299402 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac2ec1-d278-47d7-b3ac-c767650739ec None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:07.331917 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d093ced-d55a-4a33-96ed-3fe042463f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:07.332846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d093ced-d55a-4a33-96ed-3fe042463f6a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:07.333200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d093ced-d55a-4a33-96ed-3fe042463f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:07.333559 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d093ced-d55a-4a33-96ed-3fe042463f6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:07.345828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d093ced-d55a-4a33-96ed-3fe042463f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:07.347271 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d093ced-d55a-4a33-96ed-3fe042463f6a None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:07.364929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-4d093ced-d55a-4a33-96ed-3fe042463f6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:07.364929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:07.364929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:07.364929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:07.364929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:07.364929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:07.364929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:07.364929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:07.364929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:07.364929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:07.364929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:07.364929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:07.364929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:07.364929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:07.364929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:07.365796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:07.365796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:07.365796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:07.365796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:07.365796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:07.365796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:07.365796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:07.365796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:07.365796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:07.365796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:07.365796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:07.365796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:07.365796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:07.365796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:07.365796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:07.365796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:07.365796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:07.366727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:07.366727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:07.366727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:07.366727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:07.366727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 317/646] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:07.367019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d093ced-d55a-4a33-96ed-3fe042463f6a None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:07.487115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d093ced-d55a-4a33-96ed-3fe042463f6a None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:07.510715 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:07.533009 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac2ec1-d278-47d7-b3ac-c767650739ec None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:07.534154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba47f41-3d0d-42ab-8f80-2457d6763d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:07.534892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba47f41-3d0d-42ab-8f80-2457d6763d1b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:07.535239 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba47f41-3d0d-42ab-8f80-2457d6763d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:07.535584 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba47f41-3d0d-42ab-8f80-2457d6763d1b None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:07.536454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba47f41-3d0d-42ab-8f80-2457d6763d1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:07.536826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba47f41-3d0d-42ab-8f80-2457d6763d1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:07.538341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba47f41-3d0d-42ab-8f80-2457d6763d1b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:07.552368 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 318/647] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:07.553433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba47f41-3d0d-42ab-8f80-2457d6763d1b None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:07.567773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:07.575968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8c9ce-f970-435f-9f38-dba80e9e8277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:07.576845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8c9ce-f970-435f-9f38-dba80e9e8277 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:07.577197 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8c9ce-f970-435f-9f38-dba80e9e8277 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:07.577545 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8c9ce-f970-435f-9f38-dba80e9e8277 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:07.590349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8c9ce-f970-435f-9f38-dba80e9e8277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:07.598047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7ee8c9ce-f970-435f-9f38-dba80e9e8277 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:07.598047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:07.598047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:07.598047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:07.598047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:07.598047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:07.598047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:07.598047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:07.598047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:07.598047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:07.598047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:07.598047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:07.598047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:07.598047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:07.598047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:07.598047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:07.599240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:07.599240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:07.599240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:07.599240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:07.599240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:07.599240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:07.599240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:07.599240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:07.599240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:07.599240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:07.599240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:07.599240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:07.599240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:07.599240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:07.599240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:07.599240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:07.600298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:07.600298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:07.600298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:07.600298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:07.600298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:07.600298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:07.600298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:07.600298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:07.600298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:07.600298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:07.600298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:07.600298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:07.602346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 330/648] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:02:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:07.603721 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8c9ce-f970-435f-9f38-dba80e9e8277 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:07.663666 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba47f41-3d0d-42ab-8f80-2457d6763d1b None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:07.700997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918e2c3-60b0-497c-8277-d95daa34882d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:07.701935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918e2c3-60b0-497c-8277-d95daa34882d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:07.702254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918e2c3-60b0-497c-8277-d95daa34882d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:07.702533 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918e2c3-60b0-497c-8277-d95daa34882d None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:07.703366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918e2c3-60b0-497c-8277-d95daa34882d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:07.703678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918e2c3-60b0-497c-8277-d95daa34882d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:07.705096 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918e2c3-60b0-497c-8277-d95daa34882d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:07.707491 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8c9ce-f970-435f-9f38-dba80e9e8277 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:07.726686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 319/649] 10.222.0.48 () {56 vars in 1137 bytes} [Mon Jul 25 12:02:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:07.726686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918e2c3-60b0-497c-8277-d95daa34882d None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:07.745740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e536d-657d-43db-845b-814cdfee68ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:07.746439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e536d-657d-43db-845b-814cdfee68ca None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:07.746723 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e536d-657d-43db-845b-814cdfee68ca None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:07.746999 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e536d-657d-43db-845b-814cdfee68ca None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:07.747718 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e536d-657d-43db-845b-814cdfee68ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:07.748023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e536d-657d-43db-845b-814cdfee68ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:07.749400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e536d-657d-43db-845b-814cdfee68ca None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:07.765425 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 331/650] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:07.765425 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e536d-657d-43db-845b-814cdfee68ca None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:07.772598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:07.801041 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:07.840565 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918e2c3-60b0-497c-8277-d95daa34882d None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:07.864216 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e536d-657d-43db-845b-814cdfee68ca None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:07.881709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3d1f7-c76a-4394-b7d1-4efda6e75723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:07.882417 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3d1f7-c76a-4394-b7d1-4efda6e75723 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:07.882701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3d1f7-c76a-4394-b7d1-4efda6e75723 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:07.882979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3d1f7-c76a-4394-b7d1-4efda6e75723 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:07.883820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3d1f7-c76a-4394-b7d1-4efda6e75723 None admin] RBAC: Adding query filter params (role.id=0f49ec405a3c42a99beaaa0c79e67c5e, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=6d9db26891a04b0bb7e655c21feeffdd) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:07.884136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3d1f7-c76a-4394-b7d1-4efda6e75723 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:07.885585 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3d1f7-c76a-4394-b7d1-4efda6e75723 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:07.891929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 320/651] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:02:07 2022] GET /identity/v3/role_assignments?user.id=6d9db26891a04b0bb7e655c21feeffdd&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=0f49ec405a3c42a99beaaa0c79e67c5e => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:07.892639 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3d1f7-c76a-4394-b7d1-4efda6e75723 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:07.914913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e279fdd-3b16-4189-8faa-89fdd2c27c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:07.916000 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e279fdd-3b16-4189-8faa-89fdd2c27c2f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:07.917076 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e279fdd-3b16-4189-8faa-89fdd2c27c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:07.918382 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e279fdd-3b16-4189-8faa-89fdd2c27c2f None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:07.919091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e279fdd-3b16-4189-8faa-89fdd2c27c2f None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:07.919409 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e279fdd-3b16-4189-8faa-89fdd2c27c2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:07.920845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e279fdd-3b16-4189-8faa-89fdd2c27c2f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:07.930844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 332/652] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:02:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:07.932383 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e279fdd-3b16-4189-8faa-89fdd2c27c2f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:08.014934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:08.025921 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3d1f7-c76a-4394-b7d1-4efda6e75723 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:08.050162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e279fdd-3b16-4189-8faa-89fdd2c27c2f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:08.064208 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:08.074334 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319fbe0-690a-4e78-af13-752c91e2657d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:08.075450 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319fbe0-690a-4e78-af13-752c91e2657d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:08.075742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319fbe0-690a-4e78-af13-752c91e2657d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:08.076023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319fbe0-690a-4e78-af13-752c91e2657d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:08.097318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20897306-d51a-4fd1-97a4-f049d52a032e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:08.098309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20897306-d51a-4fd1-97a4-f049d52a032e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:08.098691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20897306-d51a-4fd1-97a4-f049d52a032e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:08.099071 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20897306-d51a-4fd1-97a4-f049d52a032e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:08.109519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20897306-d51a-4fd1-97a4-f049d52a032e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:08.111134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20897306-d51a-4fd1-97a4-f049d52a032e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:08.129462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-20897306-d51a-4fd1-97a4-f049d52a032e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 12:02:08.129462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:08.129462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:08.129462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:08.129462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:08.129462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:08.129462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:08.129462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:08.129462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:08.129462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:08.129462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:08.129462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:08.129462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:08.129462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:08.129462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:08.129462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:08.130559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:08.130559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:08.130559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:08.130559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:08.130559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:08.130559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:08.130559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:08.130559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:08.130559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:08.130559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:08.130559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:08.130559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:08.130559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:08.130559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:08.130559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:08.130559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:08.130559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:08.130559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:08.131524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:08.131524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:08.131524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:08.131524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:08.131524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:08.131524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:08.131524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:08.131524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:08.131524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 12:02:08.131524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:08.131524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 333/653] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:02:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:08.134945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20897306-d51a-4fd1-97a4-f049d52a032e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:08.160979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319fbe0-690a-4e78-af13-752c91e2657d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:08.162570 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319fbe0-690a-4e78-af13-752c91e2657d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:08.277687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 321/654] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:02:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:02:08.282619 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319fbe0-690a-4e78-af13-752c91e2657d None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:08.285095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20897306-d51a-4fd1-97a4-f049d52a032e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:08.317760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:08.323180 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:08.323899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb01f41-d716-44fe-bfd0-f8f5aa81c336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:08.325065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb01f41-d716-44fe-bfd0-f8f5aa81c336 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:08.325511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb01f41-d716-44fe-bfd0-f8f5aa81c336 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:08.326063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb01f41-d716-44fe-bfd0-f8f5aa81c336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:08.341435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb01f41-d716-44fe-bfd0-f8f5aa81c336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:08.343248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb01f41-d716-44fe-bfd0-f8f5aa81c336 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:08.365028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6eb01f41-d716-44fe-bfd0-f8f5aa81c336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:08.365028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:08.365028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:08.365028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:08.365028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:08.365028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:08.365028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:08.365028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:08.365028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:08.365028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:08.365028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:08.365028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:08.365028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:08.365028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:08.365028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:08.365963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:08.365963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:08.365963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:08.365963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:08.365963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:08.365963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:08.365963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:08.365963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:08.365963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:08.365963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:08.365963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:08.365963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:08.365963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:08.365963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:08.365963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:08.365963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:08.365963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:08.366884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:08.366884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:08.366884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:08.366884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:08.366884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 334/655] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:08.367584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb01f41-d716-44fe-bfd0-f8f5aa81c336 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:08.413122 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319fbe0-690a-4e78-af13-752c91e2657d None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:08.456727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbde2f8-2733-47ac-a4c7-b9867c624ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:08.457456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbde2f8-2733-47ac-a4c7-b9867c624ead None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:08.457739 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbde2f8-2733-47ac-a4c7-b9867c624ead None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:08.458031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbde2f8-2733-47ac-a4c7-b9867c624ead None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:08.458916 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbde2f8-2733-47ac-a4c7-b9867c624ead None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:08.459265 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbde2f8-2733-47ac-a4c7-b9867c624ead None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:08.460689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbde2f8-2733-47ac-a4c7-b9867c624ead None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:08.483469 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 322/656] 10.222.0.48 () {56 vars in 1137 bytes} [Mon Jul 25 12:02:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:08.483469 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbde2f8-2733-47ac-a4c7-b9867c624ead None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:08.486362 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb01f41-d716-44fe-bfd0-f8f5aa81c336 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:08.522242 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b4f56-5e17-4a54-a1e8-ee0b0d8dd47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:08.523074 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b4f56-5e17-4a54-a1e8-ee0b0d8dd47f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:08.523358 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b4f56-5e17-4a54-a1e8-ee0b0d8dd47f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:08.523626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b4f56-5e17-4a54-a1e8-ee0b0d8dd47f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:08.534607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b4f56-5e17-4a54-a1e8-ee0b0d8dd47f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:08.535993 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b4f56-5e17-4a54-a1e8-ee0b0d8dd47f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:08.553640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a36b4f56-5e17-4a54-a1e8-ee0b0d8dd47f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:08.553640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:08.553640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:08.553640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:08.553640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:08.553640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:08.553640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:08.553640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:08.553640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:08.553640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:08.553640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:08.553640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:08.553640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:08.553640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:08.553640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:08.554811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:08.554811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:08.554811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:08.554811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:08.554811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:08.554811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:08.554811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:08.554811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:08.554811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:08.554811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:08.554811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:08.554811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:08.554811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:08.554811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:08.554811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:08.554811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:08.554811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:08.555726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:08.555726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:08.555726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:08.555726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:08.555726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 335/657] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:08.556629 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73434139-55b8-4dc3-8ebf-6e8de1a81e78 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:08.556629 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73434139-55b8-4dc3-8ebf-6e8de1a81e78 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:08.557250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73434139-55b8-4dc3-8ebf-6e8de1a81e78 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:08.558593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 336/658] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:08.563057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73434139-55b8-4dc3-8ebf-6e8de1a81e78 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:08.588219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:08.599208 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbde2f8-2733-47ac-a4c7-b9867c624ead None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:08.599709 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:08.636989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf4ec7-1545-4386-84ae-b8c4b7c04c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:08.638041 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf4ec7-1545-4386-84ae-b8c4b7c04c7c None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:08.638041 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf4ec7-1545-4386-84ae-b8c4b7c04c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:08.638213 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf4ec7-1545-4386-84ae-b8c4b7c04c7c None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:08.638942 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf4ec7-1545-4386-84ae-b8c4b7c04c7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:08.639250 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf4ec7-1545-4386-84ae-b8c4b7c04c7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:08.640609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf4ec7-1545-4386-84ae-b8c4b7c04c7c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:08.653027 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 323/659] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:08.654205 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf4ec7-1545-4386-84ae-b8c4b7c04c7c None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:08.679719 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73434139-55b8-4dc3-8ebf-6e8de1a81e78 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:08.719838 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b7070-79cc-4f81-9b8e-d707297e98eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:08.720523 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b7070-79cc-4f81-9b8e-d707297e98eb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:08.720825 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b7070-79cc-4f81-9b8e-d707297e98eb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:08.721219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b7070-79cc-4f81-9b8e-d707297e98eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:08.761230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf4ec7-1545-4386-84ae-b8c4b7c04c7c None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:08.792654 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b7070-79cc-4f81-9b8e-d707297e98eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:08.794023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b7070-79cc-4f81-9b8e-d707297e98eb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:08.797150 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba6b1f-e4b2-4e08-8b8a-e427063f17f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:08.797967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba6b1f-e4b2-4e08-8b8a-e427063f17f5 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:08.798431 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba6b1f-e4b2-4e08-8b8a-e427063f17f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:08.798848 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba6b1f-e4b2-4e08-8b8a-e427063f17f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:08.799724 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba6b1f-e4b2-4e08-8b8a-e427063f17f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:08.800175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba6b1f-e4b2-4e08-8b8a-e427063f17f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:08.801752 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba6b1f-e4b2-4e08-8b8a-e427063f17f5 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:08.815423 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 324/660] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:08.816687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115a77d-0d44-45e1-8951-69db91f41302 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:08.816976 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115a77d-0d44-45e1-8951-69db91f41302 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:08.817250 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115a77d-0d44-45e1-8951-69db91f41302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:08.830833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:08.836315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-0115a77d-0d44-45e1-8951-69db91f41302 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:08.837769 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-0115a77d-0d44-45e1-8951-69db91f41302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:08.840978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:08.900038 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 337/661] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:02:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:02:08.900905 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b7070-79cc-4f81-9b8e-d707297e98eb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:08.920544 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 325/662] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:02:08.921834 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115a77d-0d44-45e1-8951-69db91f41302 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:09.009800 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b7070-79cc-4f81-9b8e-d707297e98eb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:09.035372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115a77d-0d44-45e1-8951-69db91f41302 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:09.044497 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fb992-0ea6-4fad-bd90-f790bbd3d668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:09.045235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fb992-0ea6-4fad-bd90-f790bbd3d668 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:09.045527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fb992-0ea6-4fad-bd90-f790bbd3d668 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:09.045800 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fb992-0ea6-4fad-bd90-f790bbd3d668 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:09.047697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:09.053897 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fb992-0ea6-4fad-bd90-f790bbd3d668 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:09.055717 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fb992-0ea6-4fad-bd90-f790bbd3d668 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:09.069960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-776fb992-0ea6-4fad-bd90-f790bbd3d668 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 12:02:09.069960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:09.069960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:09.069960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:09.069960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:09.069960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:09.069960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:09.069960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:09.069960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:09.069960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:09.069960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:09.069960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:09.069960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:09.069960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:09.069960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:09.069960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:09.071087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:09.071087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:09.071087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:09.071087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:09.071087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:09.071087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:09.071087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:09.071087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:09.071087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:09.071087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:09.071087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:09.071087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:09.071087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:09.071087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:09.071087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:09.071087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:09.071087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:09.071087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:09.072323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:09.072323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:09.072323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:09.072323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:09.072323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:09.072323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:09.072323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:09.072323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:09.072323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 12:02:09.072323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:09.075670 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 338/663] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:02:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:09.076199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60c76c-4e1c-4d91-9ea6-1b6c3a65ed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:09.076461 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fb992-0ea6-4fad-bd90-f790bbd3d668 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:09.077313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60c76c-4e1c-4d91-9ea6-1b6c3a65ed5b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:09.077741 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60c76c-4e1c-4d91-9ea6-1b6c3a65ed5b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:09.078187 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60c76c-4e1c-4d91-9ea6-1b6c3a65ed5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:09.085521 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60c76c-4e1c-4d91-9ea6-1b6c3a65ed5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:09.087001 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60c76c-4e1c-4d91-9ea6-1b6c3a65ed5b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:09.090139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:09.102779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-1d60c76c-4e1c-4d91-9ea6-1b6c3a65ed5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:09.102779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:09.102779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:09.102779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:09.102779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:09.102779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:09.102779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:09.102779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:09.102779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:09.102779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:09.102779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:09.102779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:09.102779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:09.102779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:09.102779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:09.104348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:09.104348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:09.104348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:09.104348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:09.104348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:09.104348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:09.104348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:09.104348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:09.104348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:09.104348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:09.104348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:09.104348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:09.104348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:09.104348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:09.104348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:09.104348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:09.104348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:09.105205 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:09.105205 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:09.105205 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:09.105205 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:09.105205 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:09.105205 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:09.105205 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:09.105205 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:09.105205 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 326/664] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:09.105689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60c76c-4e1c-4d91-9ea6-1b6c3a65ed5b None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:09.191287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fb992-0ea6-4fad-bd90-f790bbd3d668 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:09.215379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60c76c-4e1c-4d91-9ea6-1b6c3a65ed5b None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:09.230482 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db511451-d413-4691-a3e3-bbf99a7cb36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:09.231276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db511451-d413-4691-a3e3-bbf99a7cb36a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:09.231559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db511451-d413-4691-a3e3-bbf99a7cb36a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:09.231833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db511451-d413-4691-a3e3-bbf99a7cb36a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:09.242903 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db511451-d413-4691-a3e3-bbf99a7cb36a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:09.244605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db511451-d413-4691-a3e3-bbf99a7cb36a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:09.250192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281d60e-ac3c-4525-afa2-2fb09f6fd457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:09.251373 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281d60e-ac3c-4525-afa2-2fb09f6fd457 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:09.251656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281d60e-ac3c-4525-afa2-2fb09f6fd457 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:09.251929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281d60e-ac3c-4525-afa2-2fb09f6fd457 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:09.261286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-db511451-d413-4691-a3e3-bbf99a7cb36a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:09.261286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:09.261286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:09.261286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:09.261286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:09.261286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:09.261286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:09.261286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:09.261286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:09.261286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:09.261286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:09.261286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:09.261286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:09.261286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:09.261286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:09.262147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:09.262147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:09.262147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:09.262147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:09.262147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:09.262147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:09.262147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:09.262147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:09.262147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:09.262147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:09.262147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:09.262147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:09.262147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:09.262147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:09.262147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:09.262147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:09.262147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:09.263003 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:09.263003 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:09.263003 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:09.263003 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:09.263003 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 339/665] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:09.263819 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db511451-d413-4691-a3e3-bbf99a7cb36a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:09.268417 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281d60e-ac3c-4525-afa2-2fb09f6fd457 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:09.276734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-f281d60e-ac3c-4525-afa2-2fb09f6fd457 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:09.276734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:09.276734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:09.276734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:09.276734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:09.276734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:09.276734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:09.276734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:09.276734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:09.276734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:09.276734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:09.276734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:09.276734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:09.276734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:09.276734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:09.276734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:09.277623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:09.277623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:09.277623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:09.277623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:09.277623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:09.277623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:09.277623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:09.277623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:09.277623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:09.277623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:09.277623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:09.277623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:09.277623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:09.277623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:09.277623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:09.277623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:09.278909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:09.278909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:09.278909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:09.278909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:09.278909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:09.278909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:09.278909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:09.278909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:09.278909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:09.278909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:09.278909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:09.278909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:09.278909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 327/666] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:02:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:09.278909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281d60e-ac3c-4525-afa2-2fb09f6fd457 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:09.316718 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:09.343282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:09.375837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db511451-d413-4691-a3e3-bbf99a7cb36a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:09.388198 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281d60e-ac3c-4525-afa2-2fb09f6fd457 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:09.413396 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819b133-b321-42fa-9330-c80313ff2149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:09.414076 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819b133-b321-42fa-9330-c80313ff2149 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:09.414358 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819b133-b321-42fa-9330-c80313ff2149 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:09.414626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819b133-b321-42fa-9330-c80313ff2149 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:09.415452 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819b133-b321-42fa-9330-c80313ff2149 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:09.415755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819b133-b321-42fa-9330-c80313ff2149 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:09.417196 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819b133-b321-42fa-9330-c80313ff2149 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:09.423854 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35420d36-bb28-446f-820a-54e3ba872819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:09.424511 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35420d36-bb28-446f-820a-54e3ba872819 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:09.424794 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35420d36-bb28-446f-820a-54e3ba872819 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:09.425069 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35420d36-bb28-446f-820a-54e3ba872819 None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:09.425851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35420d36-bb28-446f-820a-54e3ba872819 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:09.426191 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35420d36-bb28-446f-820a-54e3ba872819 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:09.427596 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35420d36-bb28-446f-820a-54e3ba872819 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:09.439923 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 340/667] 10.222.0.48 () {56 vars in 1139 bytes} [Mon Jul 25 12:02:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:09.439923 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819b133-b321-42fa-9330-c80313ff2149 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:09.444543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 328/668] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:09.445304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35420d36-bb28-446f-820a-54e3ba872819 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:09.547470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819b133-b321-42fa-9330-c80313ff2149 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:09.550640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:09.555482 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35420d36-bb28-446f-820a-54e3ba872819 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:09.577698 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:09.585455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb4e84-1e81-446a-955e-fd2bc52a6f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:09.586150 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb4e84-1e81-446a-955e-fd2bc52a6f80 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:09.586433 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb4e84-1e81-446a-955e-fd2bc52a6f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:09.586708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb4e84-1e81-446a-955e-fd2bc52a6f80 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:09.587436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb4e84-1e81-446a-955e-fd2bc52a6f80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:09.587738 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb4e84-1e81-446a-955e-fd2bc52a6f80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:09.589658 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb4e84-1e81-446a-955e-fd2bc52a6f80 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:09.594268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd1e17-d097-4405-abf0-ca0304d9f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:09.594938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd1e17-d097-4405-abf0-ca0304d9f132 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:09.595220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd1e17-d097-4405-abf0-ca0304d9f132 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:09.595494 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd1e17-d097-4405-abf0-ca0304d9f132 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:09.596714 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd1e17-d097-4405-abf0-ca0304d9f132 None admin] RBAC: Adding query filter params (name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:09.597023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd1e17-d097-4405-abf0-ca0304d9f132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:09.598831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd1e17-d097-4405-abf0-ca0304d9f132 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:09.605390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 341/669] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:09.605390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb4e84-1e81-446a-955e-fd2bc52a6f80 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:09.612327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 329/670] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:02:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:09.613112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd1e17-d097-4405-abf0-ca0304d9f132 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:09.712065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb4e84-1e81-446a-955e-fd2bc52a6f80 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:09.721865 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd1e17-d097-4405-abf0-ca0304d9f132 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:09.750594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcc176-15f9-437b-818e-79d6e54cd063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:09.751375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcc176-15f9-437b-818e-79d6e54cd063 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:09.751758 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcc176-15f9-437b-818e-79d6e54cd063 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:09.752129 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcc176-15f9-437b-818e-79d6e54cd063 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:09.757106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de52a39-919a-4ff4-af28-c53cf415c746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:09.757749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de52a39-919a-4ff4-af28-c53cf415c746 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:09.758058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de52a39-919a-4ff4-af28-c53cf415c746 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:09.758331 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de52a39-919a-4ff4-af28-c53cf415c746 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:09.759159 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de52a39-919a-4ff4-af28-c53cf415c746 None admin] RBAC: Adding query filter params (role.id=0f49ec405a3c42a99beaaa0c79e67c5e, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=cd52ff8138094d64bce9de60c819ab4a) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:09.759467 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de52a39-919a-4ff4-af28-c53cf415c746 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:09.761452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de52a39-919a-4ff4-af28-c53cf415c746 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:09.778307 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 330/671] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:02:09 2022] GET /identity/v3/role_assignments?user.id=cd52ff8138094d64bce9de60c819ab4a&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=0f49ec405a3c42a99beaaa0c79e67c5e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:09.778307 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de52a39-919a-4ff4-af28-c53cf415c746 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:09.800390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:09.836635 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:09.863926 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcc176-15f9-437b-818e-79d6e54cd063 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:09.866667 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcc176-15f9-437b-818e-79d6e54cd063 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:09.908421 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de52a39-919a-4ff4-af28-c53cf415c746 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:09.953613 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca1341-2ece-4671-a8ea-ac1dbe8a960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:09.954601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca1341-2ece-4671-a8ea-ac1dbe8a960a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:09.954977 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca1341-2ece-4671-a8ea-ac1dbe8a960a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:09.955545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca1341-2ece-4671-a8ea-ac1dbe8a960a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:09.963864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca1341-2ece-4671-a8ea-ac1dbe8a960a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:09.965731 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca1341-2ece-4671-a8ea-ac1dbe8a960a None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:09.981320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-4aca1341-2ece-4671-a8ea-ac1dbe8a960a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:09.981320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:09.981320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:09.981320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:09.981320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:09.981320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:09.981320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:09.981320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:09.981320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:09.981320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:09.981320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:09.981320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:09.981320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:09.981320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:09.981320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:09.982251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:09.982251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:09.982251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:09.982251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:09.982251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:09.982251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:09.982251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:09.982251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:09.982251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:09.982251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:09.982251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:09.982251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:09.982251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:09.982251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:09.982251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:09.982251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:09.982251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:09.983172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:09.983172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:09.983172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:09.983172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:09.983172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:09.983172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:09.983172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:09.983172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:09.983172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 331/672] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:09.983633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca1341-2ece-4671-a8ea-ac1dbe8a960a None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:09.991918 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 342/673] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:02:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:02:09.992648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcc176-15f9-437b-818e-79d6e54cd063 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:10.070334 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:10.100674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca1341-2ece-4671-a8ea-ac1dbe8a960a None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:10.109423 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:10.112351 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcc176-15f9-437b-818e-79d6e54cd063 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:10.138626 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2da4a-acfc-4cef-8edc-35eacfe3c378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:10.139415 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2da4a-acfc-4cef-8edc-35eacfe3c378 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:10.139694 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2da4a-acfc-4cef-8edc-35eacfe3c378 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:10.139966 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2da4a-acfc-4cef-8edc-35eacfe3c378 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:10.150172 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c94e3b-50d1-4592-87e5-ea7567462b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:10.150316 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2da4a-acfc-4cef-8edc-35eacfe3c378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:10.150863 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c94e3b-50d1-4592-87e5-ea7567462b4f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:10.151154 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c94e3b-50d1-4592-87e5-ea7567462b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:10.151432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c94e3b-50d1-4592-87e5-ea7567462b4f None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:10.151737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2da4a-acfc-4cef-8edc-35eacfe3c378 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:10.152236 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c94e3b-50d1-4592-87e5-ea7567462b4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:10.152542 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c94e3b-50d1-4592-87e5-ea7567462b4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:10.154570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c94e3b-50d1-4592-87e5-ea7567462b4f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:10.171092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-98d2da4a-acfc-4cef-8edc-35eacfe3c378 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:10.171092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:10.171092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:10.171092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:10.171092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:10.171092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:10.171092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:10.171092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:10.171092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:10.171092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:10.171092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:10.171092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:10.171092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:10.171092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:10.171092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:10.172189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:10.172189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:10.172189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:10.172189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:10.172189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:10.172189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:10.172189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:10.172189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:10.172189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:10.172189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:10.172189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:10.172189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:10.172189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:10.172189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:10.172189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:10.172189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:10.172189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:10.173246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:10.173246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:10.173246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:10.173246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:10.174944 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 332/674] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:10.175056 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2da4a-acfc-4cef-8edc-35eacfe3c378 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:10.176710 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 343/675] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:10.179046 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef75ac-8233-40f9-af1e-1318b3dbcafc None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:10.179441 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef75ac-8233-40f9-af1e-1318b3dbcafc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:10.179820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef75ac-8233-40f9-af1e-1318b3dbcafc None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:10.183096 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 344/676] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:10.183096 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef75ac-8233-40f9-af1e-1318b3dbcafc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:10.308293 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2da4a-acfc-4cef-8edc-35eacfe3c378 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:10.321379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef75ac-8233-40f9-af1e-1318b3dbcafc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:10.347339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f766a14-dc79-4e10-aebc-d8f062d8b6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:10.348612 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f766a14-dc79-4e10-aebc-d8f062d8b6cd None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:10.348901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f766a14-dc79-4e10-aebc-d8f062d8b6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:10.349177 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f766a14-dc79-4e10-aebc-d8f062d8b6cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:10.352280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:10.366234 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f766a14-dc79-4e10-aebc-d8f062d8b6cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:10.367916 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f766a14-dc79-4e10-aebc-d8f062d8b6cd None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:10.371150 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552c132-7ddd-4aad-801f-d470f43aa8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:10.372150 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552c132-7ddd-4aad-801f-d470f43aa8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:10.372464 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552c132-7ddd-4aad-801f-d470f43aa8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:10.372740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552c132-7ddd-4aad-801f-d470f43aa8d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:10.373517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552c132-7ddd-4aad-801f-d470f43aa8d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:10.373823 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552c132-7ddd-4aad-801f-d470f43aa8d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:10.375272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552c132-7ddd-4aad-801f-d470f43aa8d1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:10.387844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-3f766a14-dc79-4e10-aebc-d8f062d8b6cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:10.387844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:10.387844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:10.387844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:10.387844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:10.387844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:10.387844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:10.387844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:10.387844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:10.387844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:10.387844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:10.387844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:10.387844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:10.387844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:10.387844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:10.388929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:10.388929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:10.388929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:10.388929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:10.388929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:10.388929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:10.388929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:10.388929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:10.388929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:10.388929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:10.388929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:10.388929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:10.388929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:10.388929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:10.388929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:10.388929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:10.388929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:10.390131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:10.390131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:10.390131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:10.390131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:10.396084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 345/677] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:10.396084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552c132-7ddd-4aad-801f-d470f43aa8d1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:10.396627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 333/678] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:10.398203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bd0fe-626b-4413-b36f-a1d8df426cc5 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:10.398647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bd0fe-626b-4413-b36f-a1d8df426cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:10.399111 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bd0fe-626b-4413-b36f-a1d8df426cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:10.418179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-ff1bd0fe-626b-4413-b36f-a1d8df426cc5 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:10.419356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ff1bd0fe-626b-4413-b36f-a1d8df426cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:10.422117 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:10.519617 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 334/679] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:02:10.520525 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bd0fe-626b-4413-b36f-a1d8df426cc5 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:10.546398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552c132-7ddd-4aad-801f-d470f43aa8d1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:10.591834 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646af3e1-fb88-4bdd-953b-426850c6b6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:10.592501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646af3e1-fb88-4bdd-953b-426850c6b6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:10.592783 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646af3e1-fb88-4bdd-953b-426850c6b6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:10.593052 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646af3e1-fb88-4bdd-953b-426850c6b6b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:10.593898 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646af3e1-fb88-4bdd-953b-426850c6b6b3 None admin] RBAC: Adding query filter params (role.id=0f49ec405a3c42a99beaaa0c79e67c5e, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=f014af35de5c47ab86ec02ebed360678) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:10.594256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646af3e1-fb88-4bdd-953b-426850c6b6b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:10.596043 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646af3e1-fb88-4bdd-953b-426850c6b6b3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:10.602094 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 346/680] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:02:10 2022] GET /identity/v3/role_assignments?user.id=f014af35de5c47ab86ec02ebed360678&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=0f49ec405a3c42a99beaaa0c79e67c5e => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:10.602933 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646af3e1-fb88-4bdd-953b-426850c6b6b3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:10.650841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bd0fe-626b-4413-b36f-a1d8df426cc5 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:10.676171 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:10.699157 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98165bdc-38f1-404f-80df-c4a0ea55d0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:10.699977 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98165bdc-38f1-404f-80df-c4a0ea55d0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:10.700254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98165bdc-38f1-404f-80df-c4a0ea55d0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:10.700522 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98165bdc-38f1-404f-80df-c4a0ea55d0b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:10.715431 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98165bdc-38f1-404f-80df-c4a0ea55d0b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:10.718036 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98165bdc-38f1-404f-80df-c4a0ea55d0b0 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:10.722676 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:10.744116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-98165bdc-38f1-404f-80df-c4a0ea55d0b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:02:10.744116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:10.744116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:10.744116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:10.744116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:10.744116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:10.744116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:10.744116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:10.744116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:10.744116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:10.744116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:10.744116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:10.744116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:10.744116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:10.744116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:10.744116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:10.745194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:10.745194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:10.745194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:10.745194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:10.745194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:10.745194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:10.745194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:10.745194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:10.745194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:10.745194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:10.745194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:10.745194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:10.745194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:10.745194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:10.745194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:10.745194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:10.745194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:10.745194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:10.746603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:10.746603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:10.746603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:10.746603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:10.746603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:10.746603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:10.746603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:10.746603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:10.746603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:02:10.746603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:10.747170 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646af3e1-fb88-4bdd-953b-426850c6b6b3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:10.750303 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 335/681] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:02:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:10.751494 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98165bdc-38f1-404f-80df-c4a0ea55d0b0 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:10.790960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da805592-48f3-41b2-8c3e-195df885f000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:10.792199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da805592-48f3-41b2-8c3e-195df885f000 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:10.792752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da805592-48f3-41b2-8c3e-195df885f000 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:10.792981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da805592-48f3-41b2-8c3e-195df885f000 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:10.793703 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da805592-48f3-41b2-8c3e-195df885f000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:10.794043 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da805592-48f3-41b2-8c3e-195df885f000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:10.795377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da805592-48f3-41b2-8c3e-195df885f000 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:10.808710 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 347/682] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:10.809832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da805592-48f3-41b2-8c3e-195df885f000 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:10.882278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98165bdc-38f1-404f-80df-c4a0ea55d0b0 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:10.921339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fffdaf-2448-43d5-927f-1e295a4734cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:10.922274 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fffdaf-2448-43d5-927f-1e295a4734cb None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:10.922623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fffdaf-2448-43d5-927f-1e295a4734cb None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:10.922964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fffdaf-2448-43d5-927f-1e295a4734cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:10.929881 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da805592-48f3-41b2-8c3e-195df885f000 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:10.938546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fffdaf-2448-43d5-927f-1e295a4734cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:10.942272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:10.946189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-18fffdaf-2448-43d5-927f-1e295a4734cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:02:10.946189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:10.946189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:10.946189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:10.946189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:10.946189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:10.946189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:10.946189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:10.946189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:10.946189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:10.946189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:10.946189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:10.946189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:10.946189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:10.946189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:10.946189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:10.947179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:10.947179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:10.947179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:10.947179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:10.947179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:10.947179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:10.947179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:10.947179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:10.947179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:10.947179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:10.947179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:10.947179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:10.947179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:10.947179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:10.947179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:10.947179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:10.948828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:10.948828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:10.948828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:10.948828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:10.948828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:10.948828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:10.948828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:10.948828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:10.948828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:10.948828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:10.948828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:02:10.948828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:10.948828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 336/683] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:02:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:10.950135 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fffdaf-2448-43d5-927f-1e295a4734cb None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:10.975609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a516b-5273-43b8-ab5e-8a1a31ffa7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:10.976295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a516b-5273-43b8-ab5e-8a1a31ffa7ad None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:10.976577 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a516b-5273-43b8-ab5e-8a1a31ffa7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:10.976844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a516b-5273-43b8-ab5e-8a1a31ffa7ad None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:10.977680 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a516b-5273-43b8-ab5e-8a1a31ffa7ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:10.977979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a516b-5273-43b8-ab5e-8a1a31ffa7ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:10.979491 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a516b-5273-43b8-ab5e-8a1a31ffa7ad None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:11.004226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 348/684] 10.222.0.48 () {56 vars in 1135 bytes} [Mon Jul 25 12:02:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:11.005303 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a516b-5273-43b8-ab5e-8a1a31ffa7ad None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:11.044747 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:11.093102 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fffdaf-2448-43d5-927f-1e295a4734cb None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:11.124567 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a516b-5273-43b8-ab5e-8a1a31ffa7ad None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:11.126932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fce7a-34fa-4c9d-b057-348d37a88174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:11.127772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fce7a-34fa-4c9d-b057-348d37a88174 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:11.128744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fce7a-34fa-4c9d-b057-348d37a88174 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:11.128744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fce7a-34fa-4c9d-b057-348d37a88174 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:11.136320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fce7a-34fa-4c9d-b057-348d37a88174 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:11.137692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fce7a-34fa-4c9d-b057-348d37a88174 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:11.152674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-092fce7a-34fa-4c9d-b057-348d37a88174 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:11.152674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:11.152674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:11.152674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:11.152674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:11.152674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:11.152674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:11.152674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:11.152674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:11.152674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:11.152674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:11.152674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:11.152674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:11.152674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:11.152674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:11.153586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:11.153586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:11.153586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:11.153586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:11.153586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:11.153586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:11.153586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:11.153586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:11.153586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:11.153586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:11.153586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:11.153586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:11.153586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:11.153586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:11.153586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:11.153586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:11.153586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:11.154493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:11.154493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:11.154493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:11.154493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:11.154493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:11.154493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:11.154493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:11.154493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:11.154493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 337/685] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:11.155512 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fce7a-34fa-4c9d-b057-348d37a88174 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:11.170834 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172bbf2-28fe-4050-9404-c6453faedc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:11.172341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172bbf2-28fe-4050-9404-c6453faedc45 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:11.172912 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172bbf2-28fe-4050-9404-c6453faedc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:11.173391 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172bbf2-28fe-4050-9404-c6453faedc45 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:11.174504 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172bbf2-28fe-4050-9404-c6453faedc45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:11.175279 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172bbf2-28fe-4050-9404-c6453faedc45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:11.176834 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172bbf2-28fe-4050-9404-c6453faedc45 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:11.188684 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 349/686] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:02:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:11.189743 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172bbf2-28fe-4050-9404-c6453faedc45 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:11.221232 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:11.271084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fce7a-34fa-4c9d-b057-348d37a88174 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:11.290589 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172bbf2-28fe-4050-9404-c6453faedc45 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:11.300081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:11.310590 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb6bdd-c02d-4fb5-b6dd-4b4ae5e59c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:11.311577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb6bdd-c02d-4fb5-b6dd-4b4ae5e59c9a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:11.312203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb6bdd-c02d-4fb5-b6dd-4b4ae5e59c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:11.312727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb6bdd-c02d-4fb5-b6dd-4b4ae5e59c9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:11.327058 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2eac3-fa28-4c3d-9366-d69781d6067f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:11.327657 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2eac3-fa28-4c3d-9366-d69781d6067f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:11.328023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2eac3-fa28-4c3d-9366-d69781d6067f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:11.328298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2eac3-fa28-4c3d-9366-d69781d6067f None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:11.329083 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2eac3-fa28-4c3d-9366-d69781d6067f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:11.329391 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2eac3-fa28-4c3d-9366-d69781d6067f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:11.330836 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2eac3-fa28-4c3d-9366-d69781d6067f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:11.347724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 350/687] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:11.348857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2eac3-fa28-4c3d-9366-d69781d6067f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:11.389767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb6bdd-c02d-4fb5-b6dd-4b4ae5e59c9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:11.392048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb6bdd-c02d-4fb5-b6dd-4b4ae5e59c9a None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:11.443823 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:11.458076 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2eac3-fa28-4c3d-9366-d69781d6067f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:11.495964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad3836-290f-4c5c-9bef-172340103c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:11.496761 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad3836-290f-4c5c-9bef-172340103c8a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:11.497036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad3836-290f-4c5c-9bef-172340103c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:11.497305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad3836-290f-4c5c-9bef-172340103c8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:11.505847 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 338/688] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:02:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:02:11.506981 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb6bdd-c02d-4fb5-b6dd-4b4ae5e59c9a None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:11.513977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad3836-290f-4c5c-9bef-172340103c8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:11.515449 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad3836-290f-4c5c-9bef-172340103c8a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:11.530398 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:11.532815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-14ad3836-290f-4c5c-9bef-172340103c8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:11.532815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:11.532815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:11.532815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:11.532815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:11.532815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:11.532815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:11.532815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:11.532815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:11.532815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:11.532815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:11.532815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:11.532815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:11.532815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:11.532815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:11.533652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:11.533652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:11.533652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:11.533652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:11.533652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:11.533652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:11.533652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:11.533652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:11.533652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:11.533652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:11.533652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:11.533652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:11.533652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:11.533652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:11.533652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:11.533652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:11.533652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:11.534565 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:11.534565 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:11.534565 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:11.534565 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:11.538763 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 351/689] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:11.539603 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad3836-290f-4c5c-9bef-172340103c8a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:11.628561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb6bdd-c02d-4fb5-b6dd-4b4ae5e59c9a None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:11.644579 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad3836-290f-4c5c-9bef-172340103c8a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:11.676460 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf5545-1b45-43a1-ac50-0aa3cbbcfe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:11.677551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf5545-1b45-43a1-ac50-0aa3cbbcfe01 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:11.678112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf5545-1b45-43a1-ac50-0aa3cbbcfe01 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:11.678655 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf5545-1b45-43a1-ac50-0aa3cbbcfe01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:11.679821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf5545-1b45-43a1-ac50-0aa3cbbcfe01 None admin] RBAC: Adding query filter params (role.id=0f49ec405a3c42a99beaaa0c79e67c5e, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=fbc9fad7089b4c95ac92e846d46cb5a3) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:11.680123 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2bdd9-caa8-4ff2-ad37-8450d243f69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:11.680524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf5545-1b45-43a1-ac50-0aa3cbbcfe01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:11.681038 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2bdd9-caa8-4ff2-ad37-8450d243f69a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:11.681384 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2bdd9-caa8-4ff2-ad37-8450d243f69a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:11.681821 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2bdd9-caa8-4ff2-ad37-8450d243f69a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:11.683485 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf5545-1b45-43a1-ac50-0aa3cbbcfe01 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:11.691225 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 339/690] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:02:11 2022] GET /identity/v3/role_assignments?user.id=fbc9fad7089b4c95ac92e846d46cb5a3&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=0f49ec405a3c42a99beaaa0c79e67c5e => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:11.692018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:11.693646 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf5545-1b45-43a1-ac50-0aa3cbbcfe01 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:11.701494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2bdd9-caa8-4ff2-ad37-8450d243f69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:11.703051 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2bdd9-caa8-4ff2-ad37-8450d243f69a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:11.754931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-13e2bdd9-caa8-4ff2-ad37-8450d243f69a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:11.754931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:11.754931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:11.754931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:11.754931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:11.754931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:11.754931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:11.754931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:11.754931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:11.754931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:11.754931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:11.754931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:11.754931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:11.754931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:11.754931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:11.755887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:11.755887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:11.755887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:11.755887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:11.755887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:11.755887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:11.755887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:11.755887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:11.755887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:11.755887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:11.755887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:11.755887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:11.755887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:11.755887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:11.755887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:11.755887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:11.755887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:11.756827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:11.756827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:11.756827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:11.756827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:11.758164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 352/691] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:11.767263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2bdd9-caa8-4ff2-ad37-8450d243f69a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:11.834406 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:11.861045 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf5545-1b45-43a1-ac50-0aa3cbbcfe01 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:11.898173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31dfb1c-d6b5-41ff-8725-ecd3aa674f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:11.898764 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dfb1c-d6b5-41ff-8725-ecd3aa674f4d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:11.899043 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dfb1c-d6b5-41ff-8725-ecd3aa674f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:11.899315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dfb1c-d6b5-41ff-8725-ecd3aa674f4d None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:11.900046 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31dfb1c-d6b5-41ff-8725-ecd3aa674f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:11.900351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31dfb1c-d6b5-41ff-8725-ecd3aa674f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:11.901740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31dfb1c-d6b5-41ff-8725-ecd3aa674f4d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:11.914947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 340/692] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:11.919423 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408113-0af1-45d9-b290-73d8e4f90783 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:11.919714 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408113-0af1-45d9-b290-73d8e4f90783 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:11.919993 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408113-0af1-45d9-b290-73d8e4f90783 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:11.925188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 341/693] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:11.925188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e408113-0af1-45d9-b290-73d8e4f90783 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:11.971837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2bdd9-caa8-4ff2-ad37-8450d243f69a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:12.007740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcb062-bc79-4d2b-98be-ecbfcdd4c57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:12.009072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcb062-bc79-4d2b-98be-ecbfcdd4c57c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:12.009354 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcb062-bc79-4d2b-98be-ecbfcdd4c57c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:12.009631 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcb062-bc79-4d2b-98be-ecbfcdd4c57c None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:12.010737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcb062-bc79-4d2b-98be-ecbfcdd4c57c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:12.011051 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcb062-bc79-4d2b-98be-ecbfcdd4c57c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:12.012843 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcb062-bc79-4d2b-98be-ecbfcdd4c57c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:12.034259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 353/694] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:12.034259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad4f2c-826f-4fee-8b2b-3668858820bd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:12.034259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad4f2c-826f-4fee-8b2b-3668858820bd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:12.034259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad4f2c-826f-4fee-8b2b-3668858820bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:12.055162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-32ad4f2c-826f-4fee-8b2b-3668858820bd None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:12.056411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-32ad4f2c-826f-4fee-8b2b-3668858820bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:12.056668 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e408113-0af1-45d9-b290-73d8e4f90783 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:12.098159 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93bff0-0aec-4c57-a383-ca947a392018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:12.099315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93bff0-0aec-4c57-a383-ca947a392018 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:12.099315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93bff0-0aec-4c57-a383-ca947a392018 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:12.099528 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93bff0-0aec-4c57-a383-ca947a392018 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:12.107932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93bff0-0aec-4c57-a383-ca947a392018 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:12.109358 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93bff0-0aec-4c57-a383-ca947a392018 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:12.113157 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:12.124645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-4c93bff0-0aec-4c57-a383-ca947a392018 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:02:12.124645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:12.124645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:12.124645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:12.124645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:12.124645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:12.124645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:12.124645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:12.124645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:12.124645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:12.124645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:12.124645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:12.124645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:12.124645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:12.124645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:12.124645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:12.125811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:12.125811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:12.125811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:12.125811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:12.125811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:12.125811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:12.125811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:12.125811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:12.125811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:12.125811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:12.125811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:12.125811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:12.125811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:12.125811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:12.125811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:12.125811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:12.125811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:12.125811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:12.126867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:12.126867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:12.126867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:12.126867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:12.126867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:12.126867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:12.126867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:12.126867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:12.126867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:02:12.126867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:12.130651 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 342/695] 10.222.0.48 () {56 vars in 1093 bytes} [Mon Jul 25 12:02:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:12.131533 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93bff0-0aec-4c57-a383-ca947a392018 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:12.135666 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:12.142070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 354/696] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:02:12.146941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad4f2c-826f-4fee-8b2b-3668858820bd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:12.239627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93bff0-0aec-4c57-a383-ca947a392018 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:12.270362 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad4f2c-826f-4fee-8b2b-3668858820bd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:12.275768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c2089-5497-4dae-bbd4-c1314f35050b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:12.276564 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c2089-5497-4dae-bbd4-c1314f35050b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:12.276844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c2089-5497-4dae-bbd4-c1314f35050b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:12.277117 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c2089-5497-4dae-bbd4-c1314f35050b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:12.284019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c2089-5497-4dae-bbd4-c1314f35050b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:12.285484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c2089-5497-4dae-bbd4-c1314f35050b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:12.300139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-1d4c2089-5497-4dae-bbd4-c1314f35050b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:12.300139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:12.300139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:12.300139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:12.300139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:12.300139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:12.300139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:12.300139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:12.300139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:12.300139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:12.300139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:12.300139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:12.300139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:12.300139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:12.300139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:12.301052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:12.301052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:12.301052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:12.301052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:12.301052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:12.301052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:12.301052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:12.301052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:12.301052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:12.301052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:12.301052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:12.301052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:12.301052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:12.301052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:12.301052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:12.301052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:12.301052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:12.301913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:12.301913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:12.301913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:12.301913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:12.301913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:12.301913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:12.301913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:12.301913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:12.301913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 343/697] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:12.302994 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c2089-5497-4dae-bbd4-c1314f35050b None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:12.312753 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93629609-1782-4287-b23a-35db472f529a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:12.313437 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93629609-1782-4287-b23a-35db472f529a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:12.313717 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93629609-1782-4287-b23a-35db472f529a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:12.313987 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93629609-1782-4287-b23a-35db472f529a None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:12.314863 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93629609-1782-4287-b23a-35db472f529a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:12.315168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93629609-1782-4287-b23a-35db472f529a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:12.316609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93629609-1782-4287-b23a-35db472f529a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:12.335371 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 355/698] 10.222.0.48 () {56 vars in 1133 bytes} [Mon Jul 25 12:02:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:12.336212 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93629609-1782-4287-b23a-35db472f529a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:12.379237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:12.386349 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:12.413385 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c2089-5497-4dae-bbd4-c1314f35050b None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:12.441288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93629609-1782-4287-b23a-35db472f529a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:12.457755 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7ea97-324a-4688-8c84-95e7d6e6954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:12.458895 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7ea97-324a-4688-8c84-95e7d6e6954d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:12.459435 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7ea97-324a-4688-8c84-95e7d6e6954d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:12.459922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7ea97-324a-4688-8c84-95e7d6e6954d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:12.476607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7ea97-324a-4688-8c84-95e7d6e6954d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:12.478136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7ea97-324a-4688-8c84-95e7d6e6954d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:12.483013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7424581-f94b-4278-9c1c-c73c713bf6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:12.483964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7424581-f94b-4278-9c1c-c73c713bf6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:12.484442 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7424581-f94b-4278-9c1c-c73c713bf6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:12.484908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7424581-f94b-4278-9c1c-c73c713bf6d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:12.485891 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7424581-f94b-4278-9c1c-c73c713bf6d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:12.486945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7424581-f94b-4278-9c1c-c73c713bf6d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:12.489083 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7424581-f94b-4278-9c1c-c73c713bf6d0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:12.497535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-cea7ea97-324a-4688-8c84-95e7d6e6954d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:12.497535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:12.497535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:12.497535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:12.497535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:12.497535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:12.497535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:12.497535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:12.497535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:12.497535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:12.497535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:12.497535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:12.497535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:12.497535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:12.497535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:12.498507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:12.498507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:12.498507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:12.498507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:12.498507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:12.498507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:12.498507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:12.498507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:12.498507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:12.498507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:12.498507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:12.498507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:12.498507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:12.498507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:12.498507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:12.498507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:12.498507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:12.499411 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:12.499411 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:12.499411 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:12.499411 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:12.503564 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 344/699] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:12.504465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7ea97-324a-4688-8c84-95e7d6e6954d None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:12.505694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 356/700] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:12.506747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7424581-f94b-4278-9c1c-c73c713bf6d0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:12.614602 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:12.618067 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7424581-f94b-4278-9c1c-c73c713bf6d0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:12.620559 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7ea97-324a-4688-8c84-95e7d6e6954d None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:12.638649 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:12.654731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9dbf8-9648-4fcd-b46f-ffd6499c97de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:12.655473 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9dbf8-9648-4fcd-b46f-ffd6499c97de None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:12.655738 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9dbf8-9648-4fcd-b46f-ffd6499c97de None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:12.656015 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9dbf8-9648-4fcd-b46f-ffd6499c97de None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:12.656797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9dbf8-9648-4fcd-b46f-ffd6499c97de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:12.657105 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9dbf8-9648-4fcd-b46f-ffd6499c97de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:12.658804 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9dbf8-9648-4fcd-b46f-ffd6499c97de None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:12.660637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d06880-d77d-495f-9e73-d45b03f0136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:12.661514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d06880-d77d-495f-9e73-d45b03f0136a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:12.662080 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d06880-d77d-495f-9e73-d45b03f0136a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:12.662618 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d06880-d77d-495f-9e73-d45b03f0136a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:12.676217 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 357/701] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:12.677267 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9dbf8-9648-4fcd-b46f-ffd6499c97de None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:12.734402 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d06880-d77d-495f-9e73-d45b03f0136a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:12.736237 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d06880-d77d-495f-9e73-d45b03f0136a None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:12.787004 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9dbf8-9648-4fcd-b46f-ffd6499c97de None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:12.825586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62caa3c9-a873-4001-a326-3e4edd0d91b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:12.826660 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62caa3c9-a873-4001-a326-3e4edd0d91b6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:12.827250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62caa3c9-a873-4001-a326-3e4edd0d91b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:12.827739 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62caa3c9-a873-4001-a326-3e4edd0d91b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:12.828784 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62caa3c9-a873-4001-a326-3e4edd0d91b6 None admin] RBAC: Adding query filter params (role.id=0f49ec405a3c42a99beaaa0c79e67c5e, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=e71de21b4b6d4971953f0c1ca92d9f23) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:12.829315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62caa3c9-a873-4001-a326-3e4edd0d91b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:12.830915 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62caa3c9-a873-4001-a326-3e4edd0d91b6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:12.837482 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 358/702] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:02:12 2022] GET /identity/v3/role_assignments?user.id=e71de21b4b6d4971953f0c1ca92d9f23&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=0f49ec405a3c42a99beaaa0c79e67c5e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:12.838308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62caa3c9-a873-4001-a326-3e4edd0d91b6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:12.851120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 345/703] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:02:12.853047 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01fc48-c123-448f-80b9-d8b26a9d51a2 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:12.853525 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01fc48-c123-448f-80b9-d8b26a9d51a2 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:12.854025 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01fc48-c123-448f-80b9-d8b26a9d51a2 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:12.860239 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 346/704] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:12.861530 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01fc48-c123-448f-80b9-d8b26a9d51a2 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:12.882377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:12.885481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:12.985866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01fc48-c123-448f-80b9-d8b26a9d51a2 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:12.986773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62caa3c9-a873-4001-a326-3e4edd0d91b6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:13.031521 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815c06f-baf3-4194-8e8d-bf192a559846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:13.032066 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815c06f-baf3-4194-8e8d-bf192a559846 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:13.032893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815c06f-baf3-4194-8e8d-bf192a559846 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:13.032893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815c06f-baf3-4194-8e8d-bf192a559846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:13.042051 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67387539-c86a-4e22-bdc4-d978addd4a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:13.043224 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67387539-c86a-4e22-bdc4-d978addd4a36 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:13.043710 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67387539-c86a-4e22-bdc4-d978addd4a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:13.044203 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67387539-c86a-4e22-bdc4-d978addd4a36 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:13.045126 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67387539-c86a-4e22-bdc4-d978addd4a36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:13.046768 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67387539-c86a-4e22-bdc4-d978addd4a36 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:13.049210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815c06f-baf3-4194-8e8d-bf192a559846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:13.050669 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815c06f-baf3-4194-8e8d-bf192a559846 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:13.071737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-5815c06f-baf3-4194-8e8d-bf192a559846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:13.071737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:13.071737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:13.071737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:13.071737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:13.071737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:13.071737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:13.071737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:13.071737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:13.071737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:13.071737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:13.071737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:13.071737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:13.071737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:13.071737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:13.073240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:13.073240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:13.073240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:13.073240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:13.073240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:13.073240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:13.073240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:13.073240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:13.073240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:13.073240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:13.073240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:13.073240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:13.073240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:13.073240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:13.073240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:13.073240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:13.073240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:13.074543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:13.074543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:13.074543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:13.074543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:13.074543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 347/705] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:13.074838 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 359/706] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 12:02:12 2022] POST /identity/v3/users => generated 254 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:02:13.075804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c481af9-d91b-4605-b917-802ee335d41d None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:13.075804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c481af9-d91b-4605-b917-802ee335d41d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:13.075804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c481af9-d91b-4605-b917-802ee335d41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:13.080618 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67387539-c86a-4e22-bdc4-d978addd4a36 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:13.097504 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-1c481af9-d91b-4605-b917-802ee335d41d None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:13.099093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-1c481af9-d91b-4605-b917-802ee335d41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:13.183788 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:13.192961 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:13.202495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 348/707] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:02:13.227879 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67387539-c86a-4e22-bdc4-d978addd4a36 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:13.235126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c481af9-d91b-4605-b917-802ee335d41d None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:13.272491 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1b268-64c1-4127-9b41-c8bc31a4de7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:13.273592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1b268-64c1-4127-9b41-c8bc31a4de7a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:13.274226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1b268-64c1-4127-9b41-c8bc31a4de7a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:13.274698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1b268-64c1-4127-9b41-c8bc31a4de7a None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:13.275707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1b268-64c1-4127-9b41-c8bc31a4de7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:13.276354 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1b268-64c1-4127-9b41-c8bc31a4de7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:13.278079 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1b268-64c1-4127-9b41-c8bc31a4de7a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:13.292812 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 360/708] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:13.298551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1b268-64c1-4127-9b41-c8bc31a4de7a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:13.360517 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c481af9-d91b-4605-b917-802ee335d41d None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:13.405480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6e759-4978-478c-aa07-3fdf599f8649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:13.406380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6e759-4978-478c-aa07-3fdf599f8649 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:13.406661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6e759-4978-478c-aa07-3fdf599f8649 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:13.406931 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6e759-4978-478c-aa07-3fdf599f8649 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:13.407589 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6e759-4978-478c-aa07-3fdf599f8649 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:13.408953 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6e759-4978-478c-aa07-3fdf599f8649 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:13.425084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-e1f6e759-4978-478c-aa07-3fdf599f8649 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 12:02:13.425084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:13.425084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:13.425084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:13.425084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:13.425084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:13.425084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:13.425084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:13.425084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 12:02:13.425084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:13.425084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:13.425084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:13.425084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:13.425084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:13.425084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:13.425084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:13.426539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:13.426539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:13.426539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:13.426539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:13.426539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:13.426539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:13.426539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:13.426539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:13.426539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:13.426539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:13.426539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:13.426539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:13.426539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:13.426539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:13.426539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:13.426539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:13.427360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:13.427360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:13.427360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:13.427360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:13.427360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:13.427360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:13.427360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:13.427360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:13.427360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:13.427360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:13.427360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:13.427360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:13.427360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:13.427360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 12:02:13.427360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:13.431069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1b268-64c1-4127-9b41-c8bc31a4de7a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:13.432972 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 349/709] 10.222.0.48 () {56 vars in 1129 bytes} [Mon Jul 25 12:02:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:13.446691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6e759-4978-478c-aa07-3fdf599f8649 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:13.486946 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2ad4d-7dbd-48dc-8b8f-3e0deb183ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:13.487309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2ad4d-7dbd-48dc-8b8f-3e0deb183ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:13.487515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2ad4d-7dbd-48dc-8b8f-3e0deb183ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:13.487788 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2ad4d-7dbd-48dc-8b8f-3e0deb183ca4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:13.497548 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2ad4d-7dbd-48dc-8b8f-3e0deb183ca4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:13.499149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2ad4d-7dbd-48dc-8b8f-3e0deb183ca4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:13.502280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:13.522844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-bff2ad4d-7dbd-48dc-8b8f-3e0deb183ca4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:13.522844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:13.522844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:13.522844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:13.522844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:13.522844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:13.522844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:13.522844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:13.522844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:13.522844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:13.522844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:13.522844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:13.522844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:13.522844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:13.522844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:13.523774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:13.523774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:13.523774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:13.523774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:13.523774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:13.523774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:13.523774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:13.523774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:13.523774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:13.523774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:13.523774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:13.523774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:13.523774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:13.523774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:13.523774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:13.523774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:13.523774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:13.524653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:13.524653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:13.524653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:13.524653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:13.524653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:13.524653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:13.524653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:13.524653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:13.524653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 361/710] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:13.545880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:13.546919 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2ad4d-7dbd-48dc-8b8f-3e0deb183ca4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:13.591647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6e759-4978-478c-aa07-3fdf599f8649 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:13.632979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8be89-d4d3-4cb6-957c-161f36d58424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:13.633659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8be89-d4d3-4cb6-957c-161f36d58424 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:13.633942 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8be89-d4d3-4cb6-957c-161f36d58424 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:13.634264 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8be89-d4d3-4cb6-957c-161f36d58424 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:13.635008 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8be89-d4d3-4cb6-957c-161f36d58424 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:13.635343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8be89-d4d3-4cb6-957c-161f36d58424 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:13.636727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8be89-d4d3-4cb6-957c-161f36d58424 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:13.651526 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 350/711] 10.222.0.48 () {56 vars in 1124 bytes} [Mon Jul 25 12:02:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:13.657949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8be89-d4d3-4cb6-957c-161f36d58424 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:13.759330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2ad4d-7dbd-48dc-8b8f-3e0deb183ca4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:13.828762 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8be89-d4d3-4cb6-957c-161f36d58424 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:13.840838 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffa4ee-e9d9-439d-be1a-40249dd3c669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:13.841503 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffa4ee-e9d9-439d-be1a-40249dd3c669 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:13.841783 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffa4ee-e9d9-439d-be1a-40249dd3c669 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:13.842076 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffa4ee-e9d9-439d-be1a-40249dd3c669 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:13.842873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcffa4ee-e9d9-439d-be1a-40249dd3c669 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:13.843177 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcffa4ee-e9d9-439d-be1a-40249dd3c669 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:13.844621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcffa4ee-e9d9-439d-be1a-40249dd3c669 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:13.864098 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 362/712] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:13.871506 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffa4ee-e9d9-439d-be1a-40249dd3c669 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:13.880786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:13.894791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88599920-577a-431b-9b6b-ca4d5b4678f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:13.895696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88599920-577a-431b-9b6b-ca4d5b4678f2 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:13.896942 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88599920-577a-431b-9b6b-ca4d5b4678f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:13.897373 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88599920-577a-431b-9b6b-ca4d5b4678f2 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:13.899026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88599920-577a-431b-9b6b-ca4d5b4678f2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:13.899717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88599920-577a-431b-9b6b-ca4d5b4678f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:13.902959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88599920-577a-431b-9b6b-ca4d5b4678f2 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:13.909285 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 351/713] 10.222.0.48 () {56 vars in 1124 bytes} [Mon Jul 25 12:02:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:13.918592 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971f44d-15ae-4176-84fb-49f8d0372eb6 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:13.918880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971f44d-15ae-4176-84fb-49f8d0372eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:13.919186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971f44d-15ae-4176-84fb-49f8d0372eb6 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:13.920793 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 352/714] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:13 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:13.926744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382281d7-8da1-48cd-9d2c-779058b063ad None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:13.927031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382281d7-8da1-48cd-9d2c-779058b063ad None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:13.927315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382281d7-8da1-48cd-9d2c-779058b063ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:13.954463 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:13.964235 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-382281d7-8da1-48cd-9d2c-779058b063ad None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:13.965458 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-382281d7-8da1-48cd-9d2c-779058b063ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:14.028463 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffa4ee-e9d9-439d-be1a-40249dd3c669 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:14.063255 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 353/715] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:02:14.103953 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382281d7-8da1-48cd-9d2c-779058b063ad None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:14.108235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8635e8-31aa-4f11-ba74-8ddf554ed43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:14.109218 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8635e8-31aa-4f11-ba74-8ddf554ed43f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:14.109920 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8635e8-31aa-4f11-ba74-8ddf554ed43f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:14.110395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8635e8-31aa-4f11-ba74-8ddf554ed43f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:14.111520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8635e8-31aa-4f11-ba74-8ddf554ed43f None admin] RBAC: Adding query filter params (role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=6d9db26891a04b0bb7e655c21feeffdd) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:14.112101 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8635e8-31aa-4f11-ba74-8ddf554ed43f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:14.113863 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8635e8-31aa-4f11-ba74-8ddf554ed43f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:14.120722 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 363/716] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:02:13 2022] GET /identity/v3/role_assignments?user.id=6d9db26891a04b0bb7e655c21feeffdd&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:14.218998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382281d7-8da1-48cd-9d2c-779058b063ad None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:14.242415 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:14.257232 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84e0c3-67be-45da-beec-a77de58ee9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:14.258055 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84e0c3-67be-45da-beec-a77de58ee9af None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:14.258340 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84e0c3-67be-45da-beec-a77de58ee9af None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:14.258612 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84e0c3-67be-45da-beec-a77de58ee9af None admin] PATH_INFO: `/v3/services/network` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:14.259272 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84e0c3-67be-45da-beec-a77de58ee9af None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:14.261309 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84e0c3-67be-45da-beec-a77de58ee9af None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:14.273952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-8d84e0c3-67be-45da-beec-a77de58ee9af None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 12:02:14.273952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:14.273952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:14.273952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:14.273952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:14.273952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:14.273952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:14.273952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:14.273952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 12:02:14.273952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:14.273952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:14.273952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:14.273952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:14.273952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:14.273952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:14.273952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:14.273952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:14.274992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:14.274992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:14.274992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:14.274992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:14.274992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:14.274992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:14.274992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:14.274992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:14.274992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:14.274992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:14.274992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:14.274992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:14.274992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:14.274992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:14.274992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:14.274992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:14.275841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:14.275841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:14.275841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:14.275841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:14.275841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:14.275841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:14.275841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:14.275841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:14.275841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:14.275841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:14.275841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:14.275841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:14.275841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 12:02:14.275841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:14.275841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 354/717] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:14 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:14.283248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8635e8-31aa-4f11-ba74-8ddf554ed43f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:14.404237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8635e8-31aa-4f11-ba74-8ddf554ed43f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:14.436400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:14.452882 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cd9e8-6087-42cb-b00b-8a6fd5cf8b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:14.453931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cd9e8-6087-42cb-b00b-8a6fd5cf8b9f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:14.454453 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cd9e8-6087-42cb-b00b-8a6fd5cf8b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:14.454927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cd9e8-6087-42cb-b00b-8a6fd5cf8b9f None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:14.455835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cd9e8-6087-42cb-b00b-8a6fd5cf8b9f None admin] RBAC: Adding query filter params (name=network) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:14.456336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cd9e8-6087-42cb-b00b-8a6fd5cf8b9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:14.457949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cd9e8-6087-42cb-b00b-8a6fd5cf8b9f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:14.466119 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 364/718] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 12:02:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:14.475279 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84e0c3-67be-45da-beec-a77de58ee9af None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:14.585256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84e0c3-67be-45da-beec-a77de58ee9af None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:14.623494 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259de2ef-15b4-470d-86dd-e99a8b412571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:14.624162 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259de2ef-15b4-470d-86dd-e99a8b412571 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:14.624444 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259de2ef-15b4-470d-86dd-e99a8b412571 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:14.624720 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259de2ef-15b4-470d-86dd-e99a8b412571 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:14.625432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259de2ef-15b4-470d-86dd-e99a8b412571 None admin] RBAC: Adding query filter params (type=network) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:14.625738 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259de2ef-15b4-470d-86dd-e99a8b412571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:14.627133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259de2ef-15b4-470d-86dd-e99a8b412571 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:14.636108 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 355/719] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 12:02:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:15.523942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e2d6f-723d-4a0d-b1e5-ef5a5c0033d0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:15.524972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e2d6f-723d-4a0d-b1e5-ef5a5c0033d0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:15.525490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e2d6f-723d-4a0d-b1e5-ef5a5c0033d0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:15.527396 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 365/720] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:15.532357 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6bab5-6bfe-42f9-8bf5-0f791d546439 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:15.533191 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6bab5-6bfe-42f9-8bf5-0f791d546439 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:15.533701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6bab5-6bfe-42f9-8bf5-0f791d546439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:15.558528 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-79b6bab5-6bfe-42f9-8bf5-0f791d546439 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:15.560040 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-79b6bab5-6bfe-42f9-8bf5-0f791d546439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:15.622053 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:15.629245 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262141a7-109f-412a-b0c6-af98605aaf02 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:15.629542 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262141a7-109f-412a-b0c6-af98605aaf02 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:15.629887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262141a7-109f-412a-b0c6-af98605aaf02 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:15.631544 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 366/721] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:15.636624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb77aa-9021-471e-831d-1d302c6285be None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:15.637146 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb77aa-9021-471e-831d-1d302c6285be None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:15.637629 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb77aa-9021-471e-831d-1d302c6285be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:15.649296 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 356/722] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:02:15.672407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-77fb77aa-9021-471e-831d-1d302c6285be None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:15.672596 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6bab5-6bfe-42f9-8bf5-0f791d546439 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:15.673616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-77fb77aa-9021-471e-831d-1d302c6285be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:15.803792 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 367/723] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:02:15.843153 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb77aa-9021-471e-831d-1d302c6285be None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:15.864379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6bab5-6bfe-42f9-8bf5-0f791d546439 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:15.947045 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8c328-d893-4312-a9a3-1e340892251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:15.947890 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8c328-d893-4312-a9a3-1e340892251b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:15.948173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8c328-d893-4312-a9a3-1e340892251b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:15.948447 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8c328-d893-4312-a9a3-1e340892251b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:15.965666 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb77aa-9021-471e-831d-1d302c6285be None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:15.982924 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8c328-d893-4312-a9a3-1e340892251b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:15.984481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:15.990798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-7ae8c328-d893-4312-a9a3-1e340892251b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:15.990798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:15.990798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:15.990798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:15.990798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:15.990798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:15.990798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:15.990798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:15.990798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:15.990798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:15.990798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:15.990798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:15.990798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:15.990798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:15.990798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:15.990798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:15.991736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:15.991736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:15.991736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:15.991736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:15.991736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:15.991736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:15.991736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:15.991736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:15.991736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:15.991736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:15.991736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:15.991736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:15.991736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:15.991736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:15.991736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:15.991736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:15.992535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:15.992535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:15.992535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:15.992535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:15.992535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:15.992535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:15.992535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:15.992535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:15.992535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:15.992535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:15.992535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:15.992535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:15.998428 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 357/724] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:02:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:16.003991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8c328-d893-4312-a9a3-1e340892251b None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:16.005728 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1171b09-8a88-4b02-8ddf-6d48798a2fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:16.006756 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1171b09-8a88-4b02-8ddf-6d48798a2fed None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:16.007237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1171b09-8a88-4b02-8ddf-6d48798a2fed None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:16.007688 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1171b09-8a88-4b02-8ddf-6d48798a2fed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:16.027490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1171b09-8a88-4b02-8ddf-6d48798a2fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:16.041160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e1171b09-8a88-4b02-8ddf-6d48798a2fed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:02:16.041160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:16.041160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:16.041160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:16.041160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:16.041160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:16.041160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:16.041160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:16.041160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:16.041160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:16.041160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:16.041160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:16.041160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:16.041160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:16.041160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:16.041160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:16.042902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:16.042902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:16.042902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:16.042902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:16.042902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:16.042902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:16.042902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:16.042902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:16.042902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:16.042902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:16.042902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:16.042902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:16.042902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:16.042902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:16.042902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:16.042902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:16.043740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:16.043740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:16.043740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:16.043740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:16.043740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:16.043740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:16.043740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:16.043740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:16.043740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:16.043740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:16.043740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:02:16.043740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:16.043740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 368/725] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:02:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:16.051698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1171b09-8a88-4b02-8ddf-6d48798a2fed None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:16.075215 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:16.144620 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8c328-d893-4312-a9a3-1e340892251b None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:16.182169 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad576cb-be2e-4285-92ad-b4157ffbdae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:16.183129 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad576cb-be2e-4285-92ad-b4157ffbdae2 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:16.183695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad576cb-be2e-4285-92ad-b4157ffbdae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:16.184112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad576cb-be2e-4285-92ad-b4157ffbdae2 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:16.184994 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad576cb-be2e-4285-92ad-b4157ffbdae2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:16.185436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad576cb-be2e-4285-92ad-b4157ffbdae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:16.186959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad576cb-be2e-4285-92ad-b4157ffbdae2 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:16.195913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 358/726] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:02:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:16.202612 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad576cb-be2e-4285-92ad-b4157ffbdae2 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:16.312501 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:16.316448 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad576cb-be2e-4285-92ad-b4157ffbdae2 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:16.335315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1171b09-8a88-4b02-8ddf-6d48798a2fed None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:16.356139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dce48-5570-45a2-a839-7aecdc0e64ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:16.357203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dce48-5570-45a2-a839-7aecdc0e64ef None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:16.357747 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dce48-5570-45a2-a839-7aecdc0e64ef None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:16.358247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dce48-5570-45a2-a839-7aecdc0e64ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:16.370611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8dce48-5570-45a2-a839-7aecdc0e64ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:16.372663 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8dce48-5570-45a2-a839-7aecdc0e64ef None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:16.392502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-bb8dce48-5570-45a2-a839-7aecdc0e64ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:16.392502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:16.392502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:16.392502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:16.392502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:16.392502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:16.392502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:16.392502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:16.392502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:16.392502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:16.392502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:16.392502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:16.392502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:16.392502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:16.392502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:16.393611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:16.393611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:16.393611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:16.393611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:16.393611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:16.393611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:16.393611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:16.393611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:16.393611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:16.393611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:16.393611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:16.393611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:16.393611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:16.393611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:16.393611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:16.393611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:16.393611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:16.394753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:16.394753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:16.394753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:16.394753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:16.397309 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 359/727] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:16.404318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31b9fd-5995-4f56-a776-f48c406b1d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:16.405279 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31b9fd-5995-4f56-a776-f48c406b1d60 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:16.405546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dce48-5570-45a2-a839-7aecdc0e64ef None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:16.405854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31b9fd-5995-4f56-a776-f48c406b1d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:16.406377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31b9fd-5995-4f56-a776-f48c406b1d60 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:16.407284 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31b9fd-5995-4f56-a776-f48c406b1d60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:16.407740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31b9fd-5995-4f56-a776-f48c406b1d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:16.409559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31b9fd-5995-4f56-a776-f48c406b1d60 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:16.420330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 369/728] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:02:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:16.426260 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31b9fd-5995-4f56-a776-f48c406b1d60 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:16.478024 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:16.548350 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31b9fd-5995-4f56-a776-f48c406b1d60 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:16.568777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dce48-5570-45a2-a839-7aecdc0e64ef None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:16.586207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab897ac1-fc67-46a4-b638-a5d4b9eb1860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:16.587074 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab897ac1-fc67-46a4-b638-a5d4b9eb1860 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:16.587359 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab897ac1-fc67-46a4-b638-a5d4b9eb1860 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:16.587633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab897ac1-fc67-46a4-b638-a5d4b9eb1860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:16.599473 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab897ac1-fc67-46a4-b638-a5d4b9eb1860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:16.601038 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab897ac1-fc67-46a4-b638-a5d4b9eb1860 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:16.604050 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df65ef3-b563-48a6-ba6f-116a4f82fa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:16.604871 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df65ef3-b563-48a6-ba6f-116a4f82fa70 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:16.605154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df65ef3-b563-48a6-ba6f-116a4f82fa70 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:16.605428 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df65ef3-b563-48a6-ba6f-116a4f82fa70 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:16.606182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df65ef3-b563-48a6-ba6f-116a4f82fa70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:16.606487 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df65ef3-b563-48a6-ba6f-116a4f82fa70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:16.607831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df65ef3-b563-48a6-ba6f-116a4f82fa70 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:16.619973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ab897ac1-fc67-46a4-b638-a5d4b9eb1860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:16.619973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:16.619973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:16.619973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:16.619973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:16.619973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:16.619973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:16.619973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:16.619973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:16.619973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:16.619973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:16.619973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:16.619973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:16.619973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:16.619973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:16.620861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:16.620861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:16.620861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:16.620861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:16.620861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:16.620861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:16.620861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:16.620861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:16.620861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:16.620861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:16.620861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:16.620861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:16.620861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:16.620861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:16.620861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:16.620861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:16.620861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:16.621718 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:16.621718 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:16.621718 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:16.621718 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:16.621932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 360/729] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:16.621932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef937e-5094-4d77-9900-efebf454a748 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:16.622514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef937e-5094-4d77-9900-efebf454a748 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:16.622514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef937e-5094-4d77-9900-efebf454a748 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:16.623913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 361/730] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:16.626141 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 370/731] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:16.631309 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805b8bf-271a-4411-a647-c26c0b1d6893 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:16.631598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805b8bf-271a-4411-a647-c26c0b1d6893 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:16.631874 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805b8bf-271a-4411-a647-c26c0b1d6893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:16.634346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab897ac1-fc67-46a4-b638-a5d4b9eb1860 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:16.657745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-a805b8bf-271a-4411-a647-c26c0b1d6893 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:16.659063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a805b8bf-271a-4411-a647-c26c0b1d6893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:16.669100 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:16.736351 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:16.747376 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab897ac1-fc67-46a4-b638-a5d4b9eb1860 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:16.784781 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d6679-2dc5-4c59-82d5-c33ce9fc5ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:16.785607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d6679-2dc5-4c59-82d5-c33ce9fc5ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:16.785888 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d6679-2dc5-4c59-82d5-c33ce9fc5ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:16.786207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d6679-2dc5-4c59-82d5-c33ce9fc5ab7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:16.795326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d6679-2dc5-4c59-82d5-c33ce9fc5ab7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:16.796794 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d6679-2dc5-4c59-82d5-c33ce9fc5ab7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:16.812909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-476d6679-2dc5-4c59-82d5-c33ce9fc5ab7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:02:16.812909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:16.812909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:16.812909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:16.812909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:16.812909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:16.812909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:16.812909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:16.812909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:16.812909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:16.812909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:16.812909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:16.812909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:16.812909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:16.812909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:16.812909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:16.813899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:16.813899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:16.813899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:16.813899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:16.813899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:16.813899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:16.813899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:16.813899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:16.813899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:16.813899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:16.813899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:16.813899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:16.813899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:16.813899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:16.813899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:16.813899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:16.813899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:16.813899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:16.814835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:16.814835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:16.814835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:16.814835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:16.814835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:16.814835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:16.814835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:16.814835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:16.814835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:02:16.814835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:16.814835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 371/732] 10.222.0.48 () {56 vars in 1117 bytes} [Mon Jul 25 12:02:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:16.815407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d6679-2dc5-4c59-82d5-c33ce9fc5ab7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:16.851703 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 362/733] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:02:16.853352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8ed2a-65ca-4b9c-9106-4a3a66380929 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:16.854372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8ed2a-65ca-4b9c-9106-4a3a66380929 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:16.854851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8ed2a-65ca-4b9c-9106-4a3a66380929 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:16.860327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 363/734] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:16.861245 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8ed2a-65ca-4b9c-9106-4a3a66380929 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:16.934423 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d6679-2dc5-4c59-82d5-c33ce9fc5ab7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:16.970335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8ed2a-65ca-4b9c-9106-4a3a66380929 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:16.974949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa64add-e958-414a-a815-81b4dc9878e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:16.975620 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa64add-e958-414a-a815-81b4dc9878e5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:16.975903 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa64add-e958-414a-a815-81b4dc9878e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:16.976178 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa64add-e958-414a-a815-81b4dc9878e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:16.976905 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa64add-e958-414a-a815-81b4dc9878e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:16.977260 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa64add-e958-414a-a815-81b4dc9878e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:16.979252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa64add-e958-414a-a815-81b4dc9878e5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:17.000090 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 372/735] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:17.000090 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741e877-bc30-4a4a-8644-9de382dffadb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:17.000090 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741e877-bc30-4a4a-8644-9de382dffadb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:17.000090 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741e877-bc30-4a4a-8644-9de382dffadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:17.005464 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d441d-b605-42d1-bfad-eb975e873991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:17.006165 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d441d-b605-42d1-bfad-eb975e873991 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:17.006448 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d441d-b605-42d1-bfad-eb975e873991 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:17.006725 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d441d-b605-42d1-bfad-eb975e873991 None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:17.007570 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d441d-b605-42d1-bfad-eb975e873991 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:17.007875 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d441d-b605-42d1-bfad-eb975e873991 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:17.009306 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d441d-b605-42d1-bfad-eb975e873991 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:17.020943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e741e877-bc30-4a4a-8644-9de382dffadb None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:17.022485 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e741e877-bc30-4a4a-8644-9de382dffadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:17.024426 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:17.028804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 364/736] 10.222.0.48 () {56 vars in 1149 bytes} [Mon Jul 25 12:02:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:17.029892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d441d-b605-42d1-bfad-eb975e873991 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:17.034298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:17.098537 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 373/737] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:02:17.099748 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741e877-bc30-4a4a-8644-9de382dffadb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:17.134249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d441d-b605-42d1-bfad-eb975e873991 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:17.168599 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec5fc9-4773-4e68-9ddb-b3ccb5434d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:17.169256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec5fc9-4773-4e68-9ddb-b3ccb5434d11 None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:17.169537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec5fc9-4773-4e68-9ddb-b3ccb5434d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:17.169811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec5fc9-4773-4e68-9ddb-b3ccb5434d11 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:17.170554 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec5fc9-4773-4e68-9ddb-b3ccb5434d11 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:17.171907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec5fc9-4773-4e68-9ddb-b3ccb5434d11 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:17.187737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 365/738] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 12:02:17 2022] POST /identity/v3/services => generated 251 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:02:17.189075 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec5fc9-4773-4e68-9ddb-b3ccb5434d11 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:17.215845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741e877-bc30-4a4a-8644-9de382dffadb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:17.259469 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:17.260608 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd3303-1930-4f8c-adb5-10a2c2c1314e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:17.261431 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd3303-1930-4f8c-adb5-10a2c2c1314e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:17.261761 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd3303-1930-4f8c-adb5-10a2c2c1314e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:17.262205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd3303-1930-4f8c-adb5-10a2c2c1314e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:17.271423 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd3303-1930-4f8c-adb5-10a2c2c1314e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:17.272924 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd3303-1930-4f8c-adb5-10a2c2c1314e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:17.275319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:17.290607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a3cd3303-1930-4f8c-adb5-10a2c2c1314e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:02:17.290607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:17.290607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:17.290607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:17.290607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:17.290607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:17.290607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:17.290607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:17.290607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:17.290607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:17.290607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:17.290607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:17.290607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:17.290607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:17.290607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:17.290607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:17.291621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:17.291621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:17.291621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:17.291621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:17.291621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:17.291621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:17.291621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:17.291621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:17.291621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:17.291621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:17.291621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:17.291621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:17.291621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:17.291621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:17.291621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:17.291621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:17.291621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:17.291621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:17.292778 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:17.292778 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:17.292778 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:17.292778 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:17.292778 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:17.292778 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:17.292778 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:17.292778 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:17.292778 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:02:17.292778 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:17.292778 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 374/739] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:02:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:17.293869 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087b104-d478-42c9-b656-8f1f49cf5fef None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:17.293869 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087b104-d478-42c9-b656-8f1f49cf5fef None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:17.294138 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087b104-d478-42c9-b656-8f1f49cf5fef None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:17.298151 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 375/740] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:17.298151 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087b104-d478-42c9-b656-8f1f49cf5fef None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:17.320416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec5fc9-4773-4e68-9ddb-b3ccb5434d11 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:17.364086 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23b60c-0daa-436c-b925-d60b3e2d3342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:17.364744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23b60c-0daa-436c-b925-d60b3e2d3342 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:17.365026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23b60c-0daa-436c-b925-d60b3e2d3342 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:17.365357 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23b60c-0daa-436c-b925-d60b3e2d3342 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:17.410581 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087b104-d478-42c9-b656-8f1f49cf5fef None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:17.445522 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4a1fc-9b26-472b-b78c-38690e6543e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:17.446026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23b60c-0daa-436c-b925-d60b3e2d3342 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:17.446344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4a1fc-9b26-472b-b78c-38690e6543e4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:17.446624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4a1fc-9b26-472b-b78c-38690e6543e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:17.446895 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4a1fc-9b26-472b-b78c-38690e6543e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:17.448023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23b60c-0daa-436c-b925-d60b3e2d3342 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:17.458084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4a1fc-9b26-472b-b78c-38690e6543e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:17.466080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f5e4a1fc-9b26-472b-b78c-38690e6543e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:02:17.466080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:17.466080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:17.466080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:17.466080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:17.466080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:17.466080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:17.466080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:17.466080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:17.466080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:17.466080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:17.466080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:17.466080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:17.466080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:17.466080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:17.466080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:17.466991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:17.466991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:17.466991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:17.466991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:17.466991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:17.466991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:17.466991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:17.466991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:17.466991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:17.466991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:17.466991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:17.466991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:17.466991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:17.466991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:17.466991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:17.466991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:17.467796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:17.467796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:17.467796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:17.467796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:17.467796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:17.467796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:17.467796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:17.467796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:17.467796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:17.467796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:17.467796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:02:17.467796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:17.472098 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 376/741] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:02:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:17.472479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4a1fc-9b26-472b-b78c-38690e6543e4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:17.512368 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:17.534313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:17.558160 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 366/742] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:02:17 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:02:17.559698 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fbe92-c95e-4c76-ae12-86d83deb524c None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:17.559993 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fbe92-c95e-4c76-ae12-86d83deb524c None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:17.560266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fbe92-c95e-4c76-ae12-86d83deb524c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:17.578025 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-336fbe92-c95e-4c76-ae12-86d83deb524c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:17.579215 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-336fbe92-c95e-4c76-ae12-86d83deb524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:17.585935 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4a1fc-9b26-472b-b78c-38690e6543e4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:17.623185 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cad28-8892-4f3c-9afe-72c346ed19fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:17.624169 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cad28-8892-4f3c-9afe-72c346ed19fd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:17.624453 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cad28-8892-4f3c-9afe-72c346ed19fd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:17.624737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cad28-8892-4f3c-9afe-72c346ed19fd None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:17.625582 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cad28-8892-4f3c-9afe-72c346ed19fd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:17.625890 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cad28-8892-4f3c-9afe-72c346ed19fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:17.627533 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cad28-8892-4f3c-9afe-72c346ed19fd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:17.650587 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 377/743] 10.222.0.48 () {56 vars in 1135 bytes} [Mon Jul 25 12:02:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:17.650587 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cad28-8892-4f3c-9afe-72c346ed19fd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:17.650885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 367/744] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:02:17.650885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fbe92-c95e-4c76-ae12-86d83deb524c None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:17.748774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:17.755895 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cad28-8892-4f3c-9afe-72c346ed19fd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:17.760786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fbe92-c95e-4c76-ae12-86d83deb524c None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:17.776759 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:17.795973 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f12fc-c3b8-4031-bafc-3827e0257d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:17.796313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323581a9-65fa-41e5-b11a-f2205523bff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:17.796763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f12fc-c3b8-4031-bafc-3827e0257d75 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:17.796975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323581a9-65fa-41e5-b11a-f2205523bff0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:17.797086 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f12fc-c3b8-4031-bafc-3827e0257d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:17.797248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323581a9-65fa-41e5-b11a-f2205523bff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:17.797340 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f12fc-c3b8-4031-bafc-3827e0257d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:17.797525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323581a9-65fa-41e5-b11a-f2205523bff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:17.798314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323581a9-65fa-41e5-b11a-f2205523bff0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:17.798621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323581a9-65fa-41e5-b11a-f2205523bff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:17.800055 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323581a9-65fa-41e5-b11a-f2205523bff0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:17.808310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f12fc-c3b8-4031-bafc-3827e0257d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:17.813383 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 378/745] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:02:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:17.813383 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323581a9-65fa-41e5-b11a-f2205523bff0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:17.813594 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f12fc-c3b8-4031-bafc-3827e0257d75 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:17.832987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-e98f12fc-c3b8-4031-bafc-3827e0257d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:17.832987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:17.832987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:17.832987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:17.832987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:17.832987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:17.832987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:17.832987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:17.832987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:17.832987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:17.832987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:17.832987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:17.832987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:17.832987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:17.832987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:17.833877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:17.833877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:17.833877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:17.833877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:17.833877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:17.833877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:17.833877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:17.833877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:17.833877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:17.833877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:17.833877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:17.833877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:17.833877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:17.833877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:17.833877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:17.833877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:17.833877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:17.835467 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:17.835467 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:17.835467 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:17.835467 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:17.835467 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 368/746] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:17.835467 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f12fc-c3b8-4031-bafc-3827e0257d75 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:17.925871 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323581a9-65fa-41e5-b11a-f2205523bff0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:17.942301 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f12fc-c3b8-4031-bafc-3827e0257d75 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:17.960618 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6408565-dbf6-498b-a209-1bc80290abdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:17.961271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6408565-dbf6-498b-a209-1bc80290abdb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:17.961551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6408565-dbf6-498b-a209-1bc80290abdb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:17.961824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6408565-dbf6-498b-a209-1bc80290abdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:17.977668 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500abead-4c3b-4001-8832-a31e5ec5b3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:17.978439 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500abead-4c3b-4001-8832-a31e5ec5b3fc None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:17.979265 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500abead-4c3b-4001-8832-a31e5ec5b3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:17.979532 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500abead-4c3b-4001-8832-a31e5ec5b3fc None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:17.980252 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500abead-4c3b-4001-8832-a31e5ec5b3fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:17.981624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500abead-4c3b-4001-8832-a31e5ec5b3fc None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:18.006137 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 369/747] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 12:02:17 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:02:18.006137 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500abead-4c3b-4001-8832-a31e5ec5b3fc None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:18.006906 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:18.031039 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:18.068858 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6408565-dbf6-498b-a209-1bc80290abdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:18.070906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6408565-dbf6-498b-a209-1bc80290abdb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:18.162372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500abead-4c3b-4001-8832-a31e5ec5b3fc None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:18.196550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 379/748] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:02:17 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:02:18.197836 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6408565-dbf6-498b-a209-1bc80290abdb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:18.215150 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65d5c3-5b5b-4516-9510-02f3b44095a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:18.216182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65d5c3-5b5b-4516-9510-02f3b44095a4 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:18.216629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65d5c3-5b5b-4516-9510-02f3b44095a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:18.217203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65d5c3-5b5b-4516-9510-02f3b44095a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:18.232464 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65d5c3-5b5b-4516-9510-02f3b44095a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:18.234996 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65d5c3-5b5b-4516-9510-02f3b44095a4 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:18.264864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-2b65d5c3-5b5b-4516-9510-02f3b44095a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:18.264864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:18.264864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:18.264864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:18.264864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:18.264864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:18.264864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:18.264864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:18.264864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:18.264864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:18.264864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:18.264864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:18.264864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:18.264864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:18.264864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:18.265852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:18.265852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:18.265852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:18.265852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:18.265852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:18.265852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:18.265852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:18.265852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:18.265852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:18.265852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:18.265852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:18.265852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:18.265852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:18.265852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:18.265852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:18.265852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:18.265852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:18.266750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:18.266750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:18.266750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:18.266750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:18.267330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 370/749] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:18.271838 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65d5c3-5b5b-4516-9510-02f3b44095a4 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:18.298243 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:18.331598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6408565-dbf6-498b-a209-1bc80290abdb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:18.333648 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:18.381168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd5bec-bb4b-459a-8d28-1fdb0bbe7117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:18.382508 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd5bec-bb4b-459a-8d28-1fdb0bbe7117 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:18.383229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd5bec-bb4b-459a-8d28-1fdb0bbe7117 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:18.384113 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd5bec-bb4b-459a-8d28-1fdb0bbe7117 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:18.385870 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd5bec-bb4b-459a-8d28-1fdb0bbe7117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:18.386413 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd5bec-bb4b-459a-8d28-1fdb0bbe7117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:18.387101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65d5c3-5b5b-4516-9510-02f3b44095a4 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:18.388275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd5bec-bb4b-459a-8d28-1fdb0bbe7117 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:18.408792 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 380/750] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:18.410572 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd5bec-bb4b-459a-8d28-1fdb0bbe7117 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:18.427784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae9eb5-7d52-45dd-a9dc-914fe06771e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:18.428740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae9eb5-7d52-45dd-a9dc-914fe06771e4 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:18.429023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae9eb5-7d52-45dd-a9dc-914fe06771e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:18.429296 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae9eb5-7d52-45dd-a9dc-914fe06771e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:18.440336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae9eb5-7d52-45dd-a9dc-914fe06771e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:18.441770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae9eb5-7d52-45dd-a9dc-914fe06771e4 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:18.460201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-50ae9eb5-7d52-45dd-a9dc-914fe06771e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:18.460201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:18.460201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:18.460201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:18.460201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:18.460201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:18.460201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:18.460201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:18.460201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:18.460201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:18.460201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:18.460201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:18.460201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:18.460201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:18.460201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:18.461120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:18.461120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:18.461120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:18.461120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:18.461120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:18.461120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:18.461120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:18.461120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:18.461120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:18.461120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:18.461120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:18.461120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:18.461120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:18.461120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:18.461120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:18.461120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:18.461120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:18.462452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:18.462452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:18.462452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:18.462452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:18.462452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 371/751] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:18.462452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae9eb5-7d52-45dd-a9dc-914fe06771e4 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:18.540034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd5bec-bb4b-459a-8d28-1fdb0bbe7117 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:18.574606 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2617511-82c0-41d2-b195-1d619ae3e422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:18.575412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2617511-82c0-41d2-b195-1d619ae3e422 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:18.575792 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2617511-82c0-41d2-b195-1d619ae3e422 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:18.576164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2617511-82c0-41d2-b195-1d619ae3e422 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:18.576989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2617511-82c0-41d2-b195-1d619ae3e422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:18.577386 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2617511-82c0-41d2-b195-1d619ae3e422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:18.578905 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2617511-82c0-41d2-b195-1d619ae3e422 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:18.580821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae9eb5-7d52-45dd-a9dc-914fe06771e4 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:18.582885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:18.586813 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:18.598977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 381/752] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:18.600039 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2617511-82c0-41d2-b195-1d619ae3e422 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:18.625832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144aeb37-414c-4db9-a679-2a66c35ed9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:18.627225 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144aeb37-414c-4db9-a679-2a66c35ed9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:18.627633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144aeb37-414c-4db9-a679-2a66c35ed9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:18.627918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144aeb37-414c-4db9-a679-2a66c35ed9d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:18.638292 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144aeb37-414c-4db9-a679-2a66c35ed9d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:18.639743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144aeb37-414c-4db9-a679-2a66c35ed9d3 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:18.659173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-144aeb37-414c-4db9-a679-2a66c35ed9d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:18.659173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:18.659173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:18.659173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:18.659173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:18.659173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:18.659173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:18.659173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:18.659173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:18.659173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:18.659173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:18.659173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:18.659173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:18.659173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:18.659173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:18.660114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:18.660114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:18.660114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:18.660114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:18.660114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:18.660114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:18.660114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:18.660114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:18.660114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:18.660114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:18.660114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:18.660114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:18.660114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:18.660114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:18.660114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:18.660114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:18.660114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:18.661005 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:18.661005 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:18.661005 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:18.661005 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:18.661005 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:18.661005 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:18.661005 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:18.661005 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:18.661005 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 372/753] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:18.666889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144aeb37-414c-4db9-a679-2a66c35ed9d3 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:18.724091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2617511-82c0-41d2-b195-1d619ae3e422 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:18.760734 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5793e9-3a7e-4ff1-9a12-3be79afe30cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:18.761758 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5793e9-3a7e-4ff1-9a12-3be79afe30cf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:18.762300 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5793e9-3a7e-4ff1-9a12-3be79afe30cf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:18.762798 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5793e9-3a7e-4ff1-9a12-3be79afe30cf None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:18.763722 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5793e9-3a7e-4ff1-9a12-3be79afe30cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:18.764245 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5793e9-3a7e-4ff1-9a12-3be79afe30cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:18.765820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5793e9-3a7e-4ff1-9a12-3be79afe30cf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:18.770922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144aeb37-414c-4db9-a679-2a66c35ed9d3 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:18.778644 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 382/754] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:18.779744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5793e9-3a7e-4ff1-9a12-3be79afe30cf None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:18.812630 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7497e9a-6af5-445f-9399-7848fcef8abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:18.813531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7497e9a-6af5-445f-9399-7848fcef8abc None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:18.813644 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7497e9a-6af5-445f-9399-7848fcef8abc None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:18.813869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7497e9a-6af5-445f-9399-7848fcef8abc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:18.823741 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7497e9a-6af5-445f-9399-7848fcef8abc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:18.825207 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7497e9a-6af5-445f-9399-7848fcef8abc None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:18.842845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:18.843671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-e7497e9a-6af5-445f-9399-7848fcef8abc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:02:18.843671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:18.843671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:18.843671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:18.843671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:18.843671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:18.843671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:18.843671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:18.843671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:18.843671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:18.843671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:18.843671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:18.843671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:18.843671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:18.843671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:18.843671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:18.844608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:18.844608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:18.844608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:18.844608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:18.844608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:18.844608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:18.844608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:18.844608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:18.844608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:18.844608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:18.844608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:18.844608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:18.844608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:18.844608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:18.844608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:18.844608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:18.844608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:18.844608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:18.845529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:18.845529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:18.845529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:18.845529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:18.845529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:18.845529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:18.845529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:18.845529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:18.845529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:02:18.845529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:18.849472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 373/755] 10.222.0.48 () {56 vars in 1093 bytes} [Mon Jul 25 12:02:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:18.850318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7497e9a-6af5-445f-9399-7848fcef8abc None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:18.882361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:18.896291 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5793e9-3a7e-4ff1-9a12-3be79afe30cf None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:18.935834 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d47f48-0caf-4997-aa67-dbf1eda0b505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:18.936860 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d47f48-0caf-4997-aa67-dbf1eda0b505 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:18.937361 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d47f48-0caf-4997-aa67-dbf1eda0b505 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:18.937839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d47f48-0caf-4997-aa67-dbf1eda0b505 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:18.938841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d47f48-0caf-4997-aa67-dbf1eda0b505 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:18.939346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d47f48-0caf-4997-aa67-dbf1eda0b505 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:18.941064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d47f48-0caf-4997-aa67-dbf1eda0b505 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:18.959928 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 383/756] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:18.961069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d47f48-0caf-4997-aa67-dbf1eda0b505 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:18.979505 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7497e9a-6af5-445f-9399-7848fcef8abc None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:19.024756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d9773-9a4e-425f-afe5-c08a87abf48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:19.025622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d9773-9a4e-425f-afe5-c08a87abf48f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:19.025906 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d9773-9a4e-425f-afe5-c08a87abf48f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:19.026210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d9773-9a4e-425f-afe5-c08a87abf48f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:19.033164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d9773-9a4e-425f-afe5-c08a87abf48f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:19.034661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d9773-9a4e-425f-afe5-c08a87abf48f None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:19.049624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-da2d9773-9a4e-425f-afe5-c08a87abf48f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:19.049624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:19.049624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:19.049624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:19.049624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:19.049624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:19.049624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:19.049624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:19.049624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:19.049624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:19.049624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:19.049624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:19.049624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:19.049624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:19.049624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:19.050740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:19.050740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:19.050740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:19.050740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:19.050740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:19.050740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:19.050740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:19.050740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:19.050740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:19.050740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:19.050740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:19.050740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:19.050740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:19.050740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:19.050740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:19.050740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:19.050740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:19.051622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:19.051622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:19.051622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:19.051622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:19.051622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:19.051622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:19.051622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:19.051622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:19.055581 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 374/757] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:19.056421 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d9773-9a4e-425f-afe5-c08a87abf48f None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:19.075185 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d47f48-0caf-4997-aa67-dbf1eda0b505 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:19.093533 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:19.113460 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4f954-9790-4617-82b3-92ce11ec514c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:19.114546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4f954-9790-4617-82b3-92ce11ec514c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:19.115032 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4f954-9790-4617-82b3-92ce11ec514c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:19.115505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4f954-9790-4617-82b3-92ce11ec514c None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:19.116544 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4f954-9790-4617-82b3-92ce11ec514c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:19.117068 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4f954-9790-4617-82b3-92ce11ec514c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:19.118758 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4f954-9790-4617-82b3-92ce11ec514c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:19.137496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 384/758] 10.222.0.48 () {56 vars in 1133 bytes} [Mon Jul 25 12:02:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:19.138674 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4f954-9790-4617-82b3-92ce11ec514c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:19.147714 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:19.170717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d9773-9a4e-425f-afe5-c08a87abf48f None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:19.208334 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377b216-bb73-4479-be79-cedd4bc1b2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:19.209050 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377b216-bb73-4479-be79-cedd4bc1b2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:19.209271 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377b216-bb73-4479-be79-cedd4bc1b2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:19.209545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377b216-bb73-4479-be79-cedd4bc1b2e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:19.210410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377b216-bb73-4479-be79-cedd4bc1b2e6 None admin] RBAC: Adding query filter params (role.id=0f49ec405a3c42a99beaaa0c79e67c5e, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=30c0516b85e74bdb829a3019e71e6ea6) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:19.210731 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377b216-bb73-4479-be79-cedd4bc1b2e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:19.212117 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377b216-bb73-4479-be79-cedd4bc1b2e6 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:19.218253 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 375/759] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:02:19 2022] GET /identity/v3/role_assignments?user.id=30c0516b85e74bdb829a3019e71e6ea6&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=0f49ec405a3c42a99beaaa0c79e67c5e => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:19.219112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377b216-bb73-4479-be79-cedd4bc1b2e6 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:19.252719 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4f954-9790-4617-82b3-92ce11ec514c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:19.299628 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4e99a-a653-4e24-b768-f0214f2b6f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:19.300695 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e99a-a653-4e24-b768-f0214f2b6f78 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:19.301185 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e99a-a653-4e24-b768-f0214f2b6f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:19.301690 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e99a-a653-4e24-b768-f0214f2b6f78 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:19.302749 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4e99a-a653-4e24-b768-f0214f2b6f78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:19.303289 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4e99a-a653-4e24-b768-f0214f2b6f78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:19.305734 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4e99a-a653-4e24-b768-f0214f2b6f78 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:19.324996 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 385/760] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:19.326862 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649b38e-7797-4e26-a52a-c7c82e228f29 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:19.327360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649b38e-7797-4e26-a52a-c7c82e228f29 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:19.327857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649b38e-7797-4e26-a52a-c7c82e228f29 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:19.329667 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 386/761] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:19.331210 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649b38e-7797-4e26-a52a-c7c82e228f29 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:19.338415 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377b216-bb73-4479-be79-cedd4bc1b2e6 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:19.382461 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:19.384323 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb701a-1a91-4d6a-aa94-78f5e2af124c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:19.384488 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb701a-1a91-4d6a-aa94-78f5e2af124c None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:19.384762 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb701a-1a91-4d6a-aa94-78f5e2af124c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:19.385138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb701a-1a91-4d6a-aa94-78f5e2af124c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:19.399501 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb701a-1a91-4d6a-aa94-78f5e2af124c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:19.401134 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb701a-1a91-4d6a-aa94-78f5e2af124c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:19.411496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:19.429671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-70eb701a-1a91-4d6a-aa94-78f5e2af124c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:19.429671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:19.429671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:19.429671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:19.429671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:19.429671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:19.429671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:19.429671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:19.429671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:19.429671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:19.429671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:19.429671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:19.429671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:19.429671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:19.429671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:19.430614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:19.430614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:19.430614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:19.430614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:19.430614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:19.430614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:19.430614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:19.430614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:19.430614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:19.430614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:19.430614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:19.430614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:19.430614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:19.430614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:19.430614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:19.430614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:19.430614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:19.431477 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:19.431477 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:19.431477 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:19.431477 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:19.436235 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 376/762] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:19.438169 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fd98e-b6ac-49e0-96cb-8a297e94c6ee None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:19.438459 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fd98e-b6ac-49e0-96cb-8a297e94c6ee None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:19.438737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fd98e-b6ac-49e0-96cb-8a297e94c6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:19.460656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-e21fd98e-b6ac-49e0-96cb-8a297e94c6ee None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:19.462621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-e21fd98e-b6ac-49e0-96cb-8a297e94c6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:19.475355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649b38e-7797-4e26-a52a-c7c82e228f29 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:19.514610 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b7dcf-7705-4aa5-9151-6710fee00e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:19.515435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b7dcf-7705-4aa5-9151-6710fee00e25 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:19.515812 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b7dcf-7705-4aa5-9151-6710fee00e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:19.516303 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b7dcf-7705-4aa5-9151-6710fee00e25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:19.517219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b7dcf-7705-4aa5-9151-6710fee00e25 None admin] RBAC: Adding query filter params (role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=e71de21b4b6d4971953f0c1ca92d9f23) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:19.517616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b7dcf-7705-4aa5-9151-6710fee00e25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:19.519265 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b7dcf-7705-4aa5-9151-6710fee00e25 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:19.526407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 387/763] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:02:19 2022] GET /identity/v3/role_assignments?user.id=e71de21b4b6d4971953f0c1ca92d9f23&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:19.527211 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b7dcf-7705-4aa5-9151-6710fee00e25 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:19.564658 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 377/764] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:19.648959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fd98e-b6ac-49e0-96cb-8a297e94c6ee None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:19.677888 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b7dcf-7705-4aa5-9151-6710fee00e25 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:19.679699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:19.728003 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74a16f-2e1f-489b-be8d-da6e7a5e9591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:19.731267 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74a16f-2e1f-489b-be8d-da6e7a5e9591 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:19.731557 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74a16f-2e1f-489b-be8d-da6e7a5e9591 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:19.731835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74a16f-2e1f-489b-be8d-da6e7a5e9591 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:19.732578 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74a16f-2e1f-489b-be8d-da6e7a5e9591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:19.732886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74a16f-2e1f-489b-be8d-da6e7a5e9591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:19.734324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74a16f-2e1f-489b-be8d-da6e7a5e9591 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:19.748290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 388/765] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:19.753759 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74a16f-2e1f-489b-be8d-da6e7a5e9591 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:19.809080 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fd98e-b6ac-49e0-96cb-8a297e94c6ee None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:19.840473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:19.848720 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe4786-a6b2-4571-a94f-4d0a6e71339c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:19.849628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe4786-a6b2-4571-a94f-4d0a6e71339c None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:19.850017 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe4786-a6b2-4571-a94f-4d0a6e71339c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:19.850366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe4786-a6b2-4571-a94f-4d0a6e71339c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:19.851898 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe4786-a6b2-4571-a94f-4d0a6e71339c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:19.853481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe4786-a6b2-4571-a94f-4d0a6e71339c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:19.867126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-83fe4786-a6b2-4571-a94f-4d0a6e71339c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 12:02:19.867126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:19.867126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:19.867126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:19.867126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:19.867126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:19.867126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:19.867126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:19.867126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 12:02:19.867126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:19.867126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:19.867126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:19.867126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:19.867126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:19.867126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:19.867126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:19.868076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:19.868076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:19.868076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:19.868076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:19.868076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:19.868076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:19.868076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:19.868076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:19.868076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:19.868076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:19.868076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:19.868076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:19.868076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:19.868076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:19.868076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:19.868076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:19.868910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:19.868910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:19.868910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:19.868910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:19.868910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:19.868910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:19.868910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:19.868910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:19.868910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:19.868910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:19.868910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:19.868910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:19.868910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:19.868910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 12:02:19.868910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:19.869703 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 378/766] 10.222.0.48 () {56 vars in 1129 bytes} [Mon Jul 25 12:02:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:19.874886 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe4786-a6b2-4571-a94f-4d0a6e71339c None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:19.945653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74a16f-2e1f-489b-be8d-da6e7a5e9591 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:19.985506 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe4786-a6b2-4571-a94f-4d0a6e71339c None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:20.022310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4297c-92de-4bd4-ade0-3573b1f59dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:20.023404 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4297c-92de-4bd4-ade0-3573b1f59dfe None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:20.023758 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4297c-92de-4bd4-ade0-3573b1f59dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:20.024101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4297c-92de-4bd4-ade0-3573b1f59dfe None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:20.024888 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4297c-92de-4bd4-ade0-3573b1f59dfe None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:20.025264 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4297c-92de-4bd4-ade0-3573b1f59dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:20.027614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4297c-92de-4bd4-ade0-3573b1f59dfe None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:20.032749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 379/767] 10.222.0.48 () {56 vars in 1124 bytes} [Mon Jul 25 12:02:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:20.038590 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4297c-92de-4bd4-ade0-3573b1f59dfe None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:20.074711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b13510-8609-42a9-be66-50f31ed3e6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:20.075577 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b13510-8609-42a9-be66-50f31ed3e6ce None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:20.075859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b13510-8609-42a9-be66-50f31ed3e6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:20.076133 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b13510-8609-42a9-be66-50f31ed3e6ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:20.089310 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b13510-8609-42a9-be66-50f31ed3e6ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:20.091835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b13510-8609-42a9-be66-50f31ed3e6ce None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:20.103741 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:20.134025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d3b13510-8609-42a9-be66-50f31ed3e6ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:20.134025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:20.134025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:20.134025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:20.134025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:20.134025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:20.134025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:20.134025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:20.134025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:20.134025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:20.134025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:20.134025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:20.134025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:20.134025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:20.134025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:20.136380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:20.136380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:20.136380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:20.136380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:20.136380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:20.136380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:20.136380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:20.136380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:20.136380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:20.136380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:20.136380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:20.136380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:20.136380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:20.136380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:20.136380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:20.136380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:20.136380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:20.137245 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:20.137245 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:20.137245 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:20.137245 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:20.137245 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:20.137245 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:20.137245 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:20.137245 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:20.137245 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 389/768] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:20.137245 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b13510-8609-42a9-be66-50f31ed3e6ce None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:20.172965 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4297c-92de-4bd4-ade0-3573b1f59dfe None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:20.182640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:20.239345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257692f-4e07-4888-857b-887643ae8986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:20.240176 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257692f-4e07-4888-857b-887643ae8986 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:20.240560 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257692f-4e07-4888-857b-887643ae8986 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:20.240933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257692f-4e07-4888-857b-887643ae8986 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:20.241750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257692f-4e07-4888-857b-887643ae8986 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:20.242201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257692f-4e07-4888-857b-887643ae8986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:20.244079 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257692f-4e07-4888-857b-887643ae8986 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:20.254281 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 380/769] 10.222.0.48 () {56 vars in 1124 bytes} [Mon Jul 25 12:02:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:20.256154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5997b-7901-47a4-b899-47bea0e19732 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:20.256454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5997b-7901-47a4-b899-47bea0e19732 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:20.256734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5997b-7901-47a4-b899-47bea0e19732 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:20.258180 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 381/770] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:20.261051 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5997b-7901-47a4-b899-47bea0e19732 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:20.281313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b13510-8609-42a9-be66-50f31ed3e6ce None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:20.325650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232eb0c-2c50-45d0-b3f4-cc273cfd0e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:20.326868 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232eb0c-2c50-45d0-b3f4-cc273cfd0e93 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:20.327667 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232eb0c-2c50-45d0-b3f4-cc273cfd0e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:20.328456 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232eb0c-2c50-45d0-b3f4-cc273cfd0e93 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:20.329452 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232eb0c-2c50-45d0-b3f4-cc273cfd0e93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:20.329963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232eb0c-2c50-45d0-b3f4-cc273cfd0e93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:20.332312 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232eb0c-2c50-45d0-b3f4-cc273cfd0e93 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:20.349029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 390/771] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:20.350676 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750382ba-3aac-4de6-806d-3811a034eb38 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:20.351196 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750382ba-3aac-4de6-806d-3811a034eb38 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:20.351670 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750382ba-3aac-4de6-806d-3811a034eb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:20.373360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5997b-7901-47a4-b899-47bea0e19732 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:20.374193 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-750382ba-3aac-4de6-806d-3811a034eb38 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:20.376575 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-750382ba-3aac-4de6-806d-3811a034eb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:20.396242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:20.412586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd072ac6-a3ad-4a4e-955e-6a2e4c9c60b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:20.413254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd072ac6-a3ad-4a4e-955e-6a2e4c9c60b0 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:20.413675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd072ac6-a3ad-4a4e-955e-6a2e4c9c60b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:20.413851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd072ac6-a3ad-4a4e-955e-6a2e4c9c60b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:20.414690 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd072ac6-a3ad-4a4e-955e-6a2e4c9c60b0 None admin] RBAC: Adding query filter params (interface=public, service_id=75af6ef637bb48b99e7987a6d2134e37, region_id=RegionOne) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:20.415001 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd072ac6-a3ad-4a4e-955e-6a2e4c9c60b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:20.416747 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd072ac6-a3ad-4a4e-955e-6a2e4c9c60b0 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:20.429220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 382/772] 10.222.0.48 () {56 vars in 1251 bytes} [Mon Jul 25 12:02:20 2022] GET /identity/v3/endpoints?service_id=75af6ef637bb48b99e7987a6d2134e37&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:20.429220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd072ac6-a3ad-4a4e-955e-6a2e4c9c60b0 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:20.482076 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 391/773] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:20.483177 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750382ba-3aac-4de6-806d-3811a034eb38 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:20.511798 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:20.561777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd072ac6-a3ad-4a4e-955e-6a2e4c9c60b0 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:20.611181 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4fe21-626f-4132-a294-e5c6a07f17e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:20.612354 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4fe21-626f-4132-a294-e5c6a07f17e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:20.612639 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4fe21-626f-4132-a294-e5c6a07f17e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:20.612912 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4fe21-626f-4132-a294-e5c6a07f17e8 None admin] PATH_INFO: `/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/6d9db26891a04b0bb7e655c21feeffdd/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:20.615581 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4fe21-626f-4132-a294-e5c6a07f17e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c80b9db7ace42c0a0cd1f31901599fd, user_id=6d9db26891a04b0bb7e655c21feeffdd, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:20.617255 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4fe21-626f-4132-a294-e5c6a07f17e8 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:20.618046 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750382ba-3aac-4de6-806d-3811a034eb38 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:20.642045 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 383/774] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:02:20 2022] PUT /identity/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/6d9db26891a04b0bb7e655c21feeffdd/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:02:20.642045 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4fe21-626f-4132-a294-e5c6a07f17e8 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:20.677791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c1d52-ad75-4879-aead-80aa65466733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:20.678946 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c1d52-ad75-4879-aead-80aa65466733 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:20.679871 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c1d52-ad75-4879-aead-80aa65466733 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:20.680354 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c1d52-ad75-4879-aead-80aa65466733 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:20.681297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c1d52-ad75-4879-aead-80aa65466733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:20.683476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c1d52-ad75-4879-aead-80aa65466733 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:20.696584 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:20.697138 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 392/775] 10.222.0.48 () {56 vars in 1087 bytes} [Mon Jul 25 12:02:20 2022] GET /identity/v3/services => generated 772 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:20.783697 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4fe21-626f-4132-a294-e5c6a07f17e8 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:20.822086 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4a89f-11c2-43f7-8c28-11b75469fc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:20.823199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4a89f-11c2-43f7-8c28-11b75469fc38 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:20.823653 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4a89f-11c2-43f7-8c28-11b75469fc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:20.824074 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4a89f-11c2-43f7-8c28-11b75469fc38 None admin] PATH_INFO: `/v3/services/network` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:20.824887 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4a89f-11c2-43f7-8c28-11b75469fc38 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:20.826533 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4a89f-11c2-43f7-8c28-11b75469fc38 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:20.839734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-e6c4a89f-11c2-43f7-8c28-11b75469fc38 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 12:02:20.839734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:20.839734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:20.839734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:20.839734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:20.839734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:20.839734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:20.839734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:20.839734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 12:02:20.839734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:20.839734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:20.839734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:20.839734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:20.839734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:20.839734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:20.839734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:20.839734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:20.840998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:20.840998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:20.840998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:20.840998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:20.840998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:20.840998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:20.840998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:20.840998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:20.840998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:20.840998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:20.840998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:20.840998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:20.840998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:20.840998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:20.840998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:20.840998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:20.842033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:20.842033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:20.842033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:20.842033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:20.842033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:20.842033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:20.842033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:20.842033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:20.842033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:20.842033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:20.842033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:20.842033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:20.842033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 12:02:20.842033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:20.843615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 384/776] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:20 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:20.849875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c1d52-ad75-4879-aead-80aa65466733 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:20.937073 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:20.966936 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c1d52-ad75-4879-aead-80aa65466733 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:21.002914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbaa28-5c83-4917-8f87-bc3d06424c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:21.003941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbaa28-5c83-4917-8f87-bc3d06424c88 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:21.004424 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbaa28-5c83-4917-8f87-bc3d06424c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:21.004930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbaa28-5c83-4917-8f87-bc3d06424c88 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:21.005852 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbaa28-5c83-4917-8f87-bc3d06424c88 None admin] RBAC: Adding query filter params (name=network) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:21.006423 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbaa28-5c83-4917-8f87-bc3d06424c88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:21.008000 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbaa28-5c83-4917-8f87-bc3d06424c88 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:21.013473 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 393/777] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 12:02:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:21.019276 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4a89f-11c2-43f7-8c28-11b75469fc38 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:21.167881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4a89f-11c2-43f7-8c28-11b75469fc38 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:21.183023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:21.221223 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c5bf6-1765-4fbc-97d4-8c853c4bd249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:21.221902 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c5bf6-1765-4fbc-97d4-8c853c4bd249 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:21.222220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c5bf6-1765-4fbc-97d4-8c853c4bd249 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:21.222496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c5bf6-1765-4fbc-97d4-8c853c4bd249 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:21.223221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c5bf6-1765-4fbc-97d4-8c853c4bd249 None admin] RBAC: Adding query filter params (type=network) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:21.223526 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c5bf6-1765-4fbc-97d4-8c853c4bd249 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:21.224897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c5bf6-1765-4fbc-97d4-8c853c4bd249 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:21.230735 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 385/778] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 12:02:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:21.239304 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbaa28-5c83-4917-8f87-bc3d06424c88 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:21.374552 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbaa28-5c83-4917-8f87-bc3d06424c88 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:21.411256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3610dd-04ac-489b-994f-a6a8f242678a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:21.412285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3610dd-04ac-489b-994f-a6a8f242678a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:21.412768 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3610dd-04ac-489b-994f-a6a8f242678a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:21.413240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3610dd-04ac-489b-994f-a6a8f242678a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:21.414295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3610dd-04ac-489b-994f-a6a8f242678a None admin] RBAC: Adding query filter params (interface=public, service_id=1840b2f296954719b9bedf81e49e9aad, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:21.414827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3610dd-04ac-489b-994f-a6a8f242678a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:21.416923 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3610dd-04ac-489b-994f-a6a8f242678a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:21.425531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 394/779] 10.222.0.48 () {56 vars in 1251 bytes} [Mon Jul 25 12:02:21 2022] GET /identity/v3/endpoints?service_id=1840b2f296954719b9bedf81e49e9aad&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:21.431193 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c5bf6-1765-4fbc-97d4-8c853c4bd249 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:21.449407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0b759-6937-4037-8078-35bc0094b5ea None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:21.450032 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0b759-6937-4037-8078-35bc0094b5ea None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:21.450451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0b759-6937-4037-8078-35bc0094b5ea None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:21.452229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 395/780] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:02:21.457785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36662400-eb70-4aeb-9ade-41ef8c630cd6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:21.458471 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36662400-eb70-4aeb-9ade-41ef8c630cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:21.458897 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36662400-eb70-4aeb-9ade-41ef8c630cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:21.466723 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:21.482699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-36662400-eb70-4aeb-9ade-41ef8c630cd6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:21.483912 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-36662400-eb70-4aeb-9ade-41ef8c630cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:21.559600 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 396/781] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:02:21.616631 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36662400-eb70-4aeb-9ade-41ef8c630cd6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:21.629110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c5bf6-1765-4fbc-97d4-8c853c4bd249 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:21.678866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326604a5-f47e-4a87-bb82-d25d6c158346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:21.679580 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326604a5-f47e-4a87-bb82-d25d6c158346 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:21.679960 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326604a5-f47e-4a87-bb82-d25d6c158346 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:21.680324 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326604a5-f47e-4a87-bb82-d25d6c158346 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:21.681088 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326604a5-f47e-4a87-bb82-d25d6c158346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:21.683172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326604a5-f47e-4a87-bb82-d25d6c158346 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:21.688892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 386/782] 10.222.0.48 () {56 vars in 1087 bytes} [Mon Jul 25 12:02:21 2022] GET /identity/v3/services => generated 772 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:21.690194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5eb43f-56ef-4b72-8c09-2dd283c245b9 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:21.690485 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5eb43f-56ef-4b72-8c09-2dd283c245b9 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:21.690761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5eb43f-56ef-4b72-8c09-2dd283c245b9 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:21.693932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 387/783] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:21.704665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa832e-979c-40d6-9af2-17aa3aba2bd1 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:21.705311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa832e-979c-40d6-9af2-17aa3aba2bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:21.705311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa832e-979c-40d6-9af2-17aa3aba2bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:21.742603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-defa832e-979c-40d6-9af2-17aa3aba2bd1 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:21.745603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-defa832e-979c-40d6-9af2-17aa3aba2bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:21.806746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36662400-eb70-4aeb-9ade-41ef8c630cd6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:21.810783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:21.867061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:21.876879 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8d729-b260-4e2f-aab7-cdfdb58e5c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:21.877680 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8d729-b260-4e2f-aab7-cdfdb58e5c70 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:21.877958 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8d729-b260-4e2f-aab7-cdfdb58e5c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:21.878260 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8d729-b260-4e2f-aab7-cdfdb58e5c70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:21.885291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 388/784] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:02:21.892300 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8d729-b260-4e2f-aab7-cdfdb58e5c70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:21.899953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-34f8d729-b260-4e2f-aab7-cdfdb58e5c70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:21.899953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:21.899953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:21.899953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:21.899953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:21.899953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:21.899953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:21.899953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:21.899953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:21.899953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:21.899953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:21.899953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:21.899953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:21.899953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:21.899953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:21.899953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:21.901412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:21.901412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:21.901412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:21.901412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:21.901412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:21.901412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:21.901412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:21.901412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:21.901412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:21.901412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:21.901412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:21.901412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:21.901412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:21.901412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:21.901412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:21.901412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:21.902235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:21.902235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:21.902235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:21.902235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:21.902235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:21.902235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:21.902235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:21.902235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:21.902235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:21.902235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:21.902235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:21.902235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:21.902235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 397/785] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:02:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:21.907503 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa832e-979c-40d6-9af2-17aa3aba2bd1 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:21.917421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8d729-b260-4e2f-aab7-cdfdb58e5c70 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:22.019341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8d729-b260-4e2f-aab7-cdfdb58e5c70 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:22.025490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa832e-979c-40d6-9af2-17aa3aba2bd1 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:22.054766 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0676447-534a-4821-9c4b-c22801001c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:22.055504 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0676447-534a-4821-9c4b-c22801001c16 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:22.055782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0676447-534a-4821-9c4b-c22801001c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:22.056050 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0676447-534a-4821-9c4b-c22801001c16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:22.066890 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c287104-ccd9-4c05-838c-4e485e66d26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:22.067542 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0676447-534a-4821-9c4b-c22801001c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:22.068077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c287104-ccd9-4c05-838c-4e485e66d26b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:22.068592 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c287104-ccd9-4c05-838c-4e485e66d26b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:22.069067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c287104-ccd9-4c05-838c-4e485e66d26b None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:22.070053 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c287104-ccd9-4c05-838c-4e485e66d26b None admin] RBAC: Adding query filter params (name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:22.070562 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c287104-ccd9-4c05-838c-4e485e66d26b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:22.072199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c287104-ccd9-4c05-838c-4e485e66d26b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:22.075824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d0676447-534a-4821-9c4b-c22801001c16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:02:22.075824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:22.075824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:22.075824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:22.075824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:22.075824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:22.075824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:22.075824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:22.075824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:22.075824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:22.075824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:22.075824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:22.075824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:22.075824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:22.075824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:22.075824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:22.076762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:22.076762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:22.076762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:22.076762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:22.076762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:22.076762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:22.076762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:22.076762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:22.076762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:22.076762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:22.076762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:22.076762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:22.076762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:22.076762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:22.076762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:22.076762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:22.077570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:22.077570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:22.077570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:22.077570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:22.077570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:22.077570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:22.077570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:22.077570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:22.077570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:22.077570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:22.077570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:02:22.077570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:22.077570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 398/786] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:02:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:22.082985 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0676447-534a-4821-9c4b-c22801001c16 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:22.085691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 389/787] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:02:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:22.091485 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c287104-ccd9-4c05-838c-4e485e66d26b None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:22.137808 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:22.157023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:22.225709 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0676447-534a-4821-9c4b-c22801001c16 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:22.294265 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb8c42-c630-4ad2-b81f-635911485c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:22.294852 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb8c42-c630-4ad2-b81f-635911485c8b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:22.295130 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb8c42-c630-4ad2-b81f-635911485c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:22.295400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb8c42-c630-4ad2-b81f-635911485c8b None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:22.296145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb8c42-c630-4ad2-b81f-635911485c8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:22.296445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb8c42-c630-4ad2-b81f-635911485c8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:22.297817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb8c42-c630-4ad2-b81f-635911485c8b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:22.307430 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 399/788] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:02:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:22.312194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c287104-ccd9-4c05-838c-4e485e66d26b None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:22.312850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb8c42-c630-4ad2-b81f-635911485c8b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:22.387506 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca84e8-a4f7-4774-bd73-981fd4e1dc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:22.388306 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca84e8-a4f7-4774-bd73-981fd4e1dc40 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:22.388584 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca84e8-a4f7-4774-bd73-981fd4e1dc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:22.388856 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca84e8-a4f7-4774-bd73-981fd4e1dc40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:22.408397 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca84e8-a4f7-4774-bd73-981fd4e1dc40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:22.409831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca84e8-a4f7-4774-bd73-981fd4e1dc40 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:22.444608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-a1ca84e8-a4f7-4774-bd73-981fd4e1dc40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:22.444608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:22.444608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:22.444608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:22.444608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:22.444608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:22.444608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:22.444608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:22.444608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:22.444608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:22.444608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:22.444608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:22.444608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:22.444608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:22.444608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:22.445557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:22.445557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:22.445557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:22.445557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:22.445557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:22.445557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:22.445557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:22.445557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:22.445557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:22.445557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:22.445557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:22.445557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:22.445557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:22.445557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:22.445557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:22.445557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:22.445557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:22.446479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:22.446479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:22.446479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:22.446479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:22.450862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 390/789] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:22.456128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca84e8-a4f7-4774-bd73-981fd4e1dc40 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:22.506051 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb8c42-c630-4ad2-b81f-635911485c8b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:22.539432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:22.591465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:22.602714 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e29c44-b768-4a03-9c6b-82775f6187d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:22.603567 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e29c44-b768-4a03-9c6b-82775f6187d6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:22.604019 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e29c44-b768-4a03-9c6b-82775f6187d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:22.604216 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e29c44-b768-4a03-9c6b-82775f6187d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:22.622317 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca84e8-a4f7-4774-bd73-981fd4e1dc40 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:22.632999 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e29c44-b768-4a03-9c6b-82775f6187d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:22.634491 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e29c44-b768-4a03-9c6b-82775f6187d6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:22.658419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c5e29c44-b768-4a03-9c6b-82775f6187d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:22.658419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:22.658419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:22.658419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:22.658419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:22.658419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:22.658419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:22.658419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:22.658419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:22.658419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:22.658419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:22.658419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:22.658419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:22.658419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:22.658419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:22.659336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:22.659336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:22.659336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:22.659336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:22.659336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:22.659336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:22.659336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:22.659336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:22.659336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:22.659336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:22.659336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:22.659336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:22.659336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:22.659336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:22.659336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:22.659336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:22.659336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:22.660283 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:22.660283 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:22.660283 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:22.660283 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:22.675465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 400/790] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:22.676393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e29c44-b768-4a03-9c6b-82775f6187d6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:22.700415 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e604059-a949-4a06-9ec4-146e72d26cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:22.701084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e604059-a949-4a06-9ec4-146e72d26cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:22.701364 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e604059-a949-4a06-9ec4-146e72d26cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:22.701634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e604059-a949-4a06-9ec4-146e72d26cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:22.702392 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e604059-a949-4a06-9ec4-146e72d26cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:22.702696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e604059-a949-4a06-9ec4-146e72d26cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:22.704058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e604059-a949-4a06-9ec4-146e72d26cc0 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:22.728135 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 391/791] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:22.735012 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e604059-a949-4a06-9ec4-146e72d26cc0 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:22.812160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e29c44-b768-4a03-9c6b-82775f6187d6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:22.850874 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b77f66-4a0f-40d7-b331-2e371d58ff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:22.851583 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b77f66-4a0f-40d7-b331-2e371d58ff86 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:22.851871 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b77f66-4a0f-40d7-b331-2e371d58ff86 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:22.852146 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b77f66-4a0f-40d7-b331-2e371d58ff86 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:22.852869 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b77f66-4a0f-40d7-b331-2e371d58ff86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:22.853173 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b77f66-4a0f-40d7-b331-2e371d58ff86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:22.855309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b77f66-4a0f-40d7-b331-2e371d58ff86 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:22.881526 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 401/792] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:22.883424 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b77f66-4a0f-40d7-b331-2e371d58ff86 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:22.900947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e604059-a949-4a06-9ec4-146e72d26cc0 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:22.911473 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:22.974865 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fd0f8-dc4b-4f2a-bea8-9fd69aaae760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:22.976784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fd0f8-dc4b-4f2a-bea8-9fd69aaae760 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:22.977067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fd0f8-dc4b-4f2a-bea8-9fd69aaae760 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:22.977340 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fd0f8-dc4b-4f2a-bea8-9fd69aaae760 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:22.988979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fd0f8-dc4b-4f2a-bea8-9fd69aaae760 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:22.991242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fd0f8-dc4b-4f2a-bea8-9fd69aaae760 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:22.994075 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:23.000839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b77f66-4a0f-40d7-b331-2e371d58ff86 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:23.012830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-247fd0f8-dc4b-4f2a-bea8-9fd69aaae760 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:02:23.012830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:23.012830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:23.012830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:23.012830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:23.012830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:23.012830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:23.012830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:23.012830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:23.012830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:23.012830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:23.012830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:23.012830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:23.012830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:23.012830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:23.012830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:23.013779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:23.013779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:23.013779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:23.013779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:23.013779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:23.013779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:23.013779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:23.013779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:23.013779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:23.013779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:23.013779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:23.013779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:23.013779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:23.013779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:23.013779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:23.013779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:23.013779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:23.013779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:23.014728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:23.014728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:23.014728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:23.014728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:23.014728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:23.014728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:23.014728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:23.014728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:23.014728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:02:23.014728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:23.021914 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 392/793] 10.222.0.48 () {56 vars in 1117 bytes} [Mon Jul 25 12:02:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:23.023635 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fd0f8-dc4b-4f2a-bea8-9fd69aaae760 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:23.094300 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d72df6-32bf-4bac-810a-ae9bc439a221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:23.095133 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d72df6-32bf-4bac-810a-ae9bc439a221 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:23.095417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d72df6-32bf-4bac-810a-ae9bc439a221 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:23.095689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d72df6-32bf-4bac-810a-ae9bc439a221 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:23.112019 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d72df6-32bf-4bac-810a-ae9bc439a221 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:23.113398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d72df6-32bf-4bac-810a-ae9bc439a221 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:23.128755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c2d72df6-32bf-4bac-810a-ae9bc439a221 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:02:23.128755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:23.128755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:23.128755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:23.128755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:23.128755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:23.128755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:23.128755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:23.128755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:23.128755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:23.128755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:23.128755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:23.128755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:23.128755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:23.128755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:23.128755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:23.129693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:23.129693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:23.129693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:23.129693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:23.129693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:23.129693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:23.129693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:23.129693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:23.129693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:23.129693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:23.129693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:23.129693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:23.129693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:23.129693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:23.129693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:23.129693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:23.129693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:23.129693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:23.131226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:23.131226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:23.131226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:23.131226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:23.131226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:23.131226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:23.131226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:23.131226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:23.131226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:02:23.131226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:23.131226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 402/794] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:02:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:23.131799 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78891d0e-dd0a-4b7a-9ec6-cc947f983905 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:23.131799 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78891d0e-dd0a-4b7a-9ec6-cc947f983905 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:23.132122 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78891d0e-dd0a-4b7a-9ec6-cc947f983905 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:23.133456 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 403/795] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:23.138513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78891d0e-dd0a-4b7a-9ec6-cc947f983905 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:23.144242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fd0f8-dc4b-4f2a-bea8-9fd69aaae760 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:23.184719 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b746f-0355-4e88-8ea9-8094617d67a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:23.185749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b746f-0355-4e88-8ea9-8094617d67a6 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:23.186311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b746f-0355-4e88-8ea9-8094617d67a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:23.186891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b746f-0355-4e88-8ea9-8094617d67a6 None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:23.188122 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b746f-0355-4e88-8ea9-8094617d67a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:23.188639 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b746f-0355-4e88-8ea9-8094617d67a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:23.190389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b746f-0355-4e88-8ea9-8094617d67a6 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:23.208801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 393/796] 10.222.0.48 () {56 vars in 1149 bytes} [Mon Jul 25 12:02:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:23.214178 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f11e71-8cdd-4b8c-99b6-8dc4c2cbef59 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:23.214541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f11e71-8cdd-4b8c-99b6-8dc4c2cbef59 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:23.214826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f11e71-8cdd-4b8c-99b6-8dc4c2cbef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:23.232669 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-e1f11e71-8cdd-4b8c-99b6-8dc4c2cbef59 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:23.233851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-e1f11e71-8cdd-4b8c-99b6-8dc4c2cbef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:23.246979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:23.264938 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78891d0e-dd0a-4b7a-9ec6-cc947f983905 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:23.289610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:23.302677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fda6f4-96d1-4bf2-9567-a49feb1114b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:23.303348 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fda6f4-96d1-4bf2-9567-a49feb1114b9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:23.303632 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fda6f4-96d1-4bf2-9567-a49feb1114b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:23.303910 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fda6f4-96d1-4bf2-9567-a49feb1114b9 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:23.305090 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fda6f4-96d1-4bf2-9567-a49feb1114b9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:23.305200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 394/797] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:23.305295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fda6f4-96d1-4bf2-9567-a49feb1114b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:23.306581 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fda6f4-96d1-4bf2-9567-a49feb1114b9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:23.308137 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf0765-e05c-4bec-9039-96d641592c24 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:23.308947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf0765-e05c-4bec-9039-96d641592c24 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:23.309437 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf0765-e05c-4bec-9039-96d641592c24 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:23.315343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 395/798] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:23.315343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf0765-e05c-4bec-9039-96d641592c24 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:23.334621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 404/799] 10.222.0.48 () {56 vars in 1135 bytes} [Mon Jul 25 12:02:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:23.336516 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659d010-bf17-4762-ac54-c765a51b871b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:23.337013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659d010-bf17-4762-ac54-c765a51b871b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:23.337512 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659d010-bf17-4762-ac54-c765a51b871b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:23.355410 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8659d010-bf17-4762-ac54-c765a51b871b None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:23.356817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8659d010-bf17-4762-ac54-c765a51b871b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:23.425328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 405/800] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:23.426145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659d010-bf17-4762-ac54-c765a51b871b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:23.435681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf0765-e05c-4bec-9039-96d641592c24 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:23.482625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77304d73-c9d6-4817-92a1-f08b3151ad36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:23.483423 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77304d73-c9d6-4817-92a1-f08b3151ad36 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:23.483704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77304d73-c9d6-4817-92a1-f08b3151ad36 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:23.483980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77304d73-c9d6-4817-92a1-f08b3151ad36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:23.495947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77304d73-c9d6-4817-92a1-f08b3151ad36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:23.497380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77304d73-c9d6-4817-92a1-f08b3151ad36 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:23.509028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:23.515759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-77304d73-c9d6-4817-92a1-f08b3151ad36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:23.515759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:23.515759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:23.515759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:23.515759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:23.515759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:23.515759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:23.515759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:23.515759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:23.515759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:23.515759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:23.515759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:23.515759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:23.515759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:23.515759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:23.516661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:23.516661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:23.516661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:23.516661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:23.516661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:23.516661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:23.516661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:23.516661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:23.516661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:23.516661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:23.516661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:23.516661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:23.516661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:23.516661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:23.516661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:23.516661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:23.516661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:23.518294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:23.518294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:23.518294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:23.518294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:23.518294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 396/801] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:23.518294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77304d73-c9d6-4817-92a1-f08b3151ad36 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:23.541810 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659d010-bf17-4762-ac54-c765a51b871b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:23.559150 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:23.578597 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e1817-e88f-48e6-b984-a85bfa021f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:23.579423 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e1817-e88f-48e6-b984-a85bfa021f1e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:23.579682 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e1817-e88f-48e6-b984-a85bfa021f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:23.579962 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e1817-e88f-48e6-b984-a85bfa021f1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:23.590422 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e1817-e88f-48e6-b984-a85bfa021f1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:23.598057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c96e1817-e88f-48e6-b984-a85bfa021f1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:02:23.598057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:23.598057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:23.598057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:23.598057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:23.598057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:23.598057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:23.598057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:23.598057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:23.598057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:23.598057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:23.598057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:23.598057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:23.598057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:23.598057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:23.598057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:23.598989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:23.598989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:23.598989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:23.598989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:23.598989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:23.598989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:23.598989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:23.598989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:23.598989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:23.598989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:23.598989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:23.598989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:23.598989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:23.598989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:23.598989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:23.598989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:23.599811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:23.599811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:23.599811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:23.599811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:23.599811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:23.599811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:23.599811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:23.599811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:23.599811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:23.599811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:23.599811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:02:23.599811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:23.599811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 406/802] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:02:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:23.600494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e1817-e88f-48e6-b984-a85bfa021f1e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:23.624567 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77304d73-c9d6-4817-92a1-f08b3151ad36 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:23.662424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b627e-5e0d-45ff-ae2b-d08743c6896f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:23.663225 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b627e-5e0d-45ff-ae2b-d08743c6896f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:23.663508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b627e-5e0d-45ff-ae2b-d08743c6896f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:23.663783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b627e-5e0d-45ff-ae2b-d08743c6896f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:23.674546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b627e-5e0d-45ff-ae2b-d08743c6896f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:23.676040 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b627e-5e0d-45ff-ae2b-d08743c6896f None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:23.694479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-b39b627e-5e0d-45ff-ae2b-d08743c6896f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:23.694479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:23.694479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:23.694479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:23.694479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:23.694479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:23.694479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:23.694479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:23.694479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:23.694479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:23.694479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:23.694479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:23.694479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:23.694479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:23.694479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:23.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:23.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:23.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:23.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:23.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:23.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:23.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:23.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:23.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:23.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:23.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:23.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:23.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:23.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:23.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:23.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:23.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:23.696259 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:23.696259 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:23.696259 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:23.696259 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:23.696259 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 397/803] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:23.696524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b627e-5e0d-45ff-ae2b-d08743c6896f None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:23.713331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e1817-e88f-48e6-b984-a85bfa021f1e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:23.749447 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd51abf-9184-41e0-899c-6a883a0bcdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:23.750281 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd51abf-9184-41e0-899c-6a883a0bcdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:23.750557 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd51abf-9184-41e0-899c-6a883a0bcdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:23.750826 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd51abf-9184-41e0-899c-6a883a0bcdc7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:23.751534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd51abf-9184-41e0-899c-6a883a0bcdc7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:23.752824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd51abf-9184-41e0-899c-6a883a0bcdc7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:23.754849 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:23.767850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8cd51abf-9184-41e0-899c-6a883a0bcdc7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 12:02:23.767850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:23.767850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:23.767850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:23.767850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:23.767850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:23.767850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:23.767850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:23.767850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 12:02:23.767850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:23.767850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:23.767850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:23.767850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:23.767850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:23.767850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:23.767850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:23.768791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:23.768791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:23.768791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:23.768791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:23.768791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:23.768791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:23.768791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:23.768791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:23.768791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:23.768791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:23.768791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:23.768791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:23.768791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:23.768791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:23.768791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:23.768791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:23.775005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:23.775005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:23.775005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:23.775005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:23.775005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:23.775005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:23.775005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:23.775005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:23.775005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:23.775005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:23.775005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:23.775005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:23.775005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:23.775005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 12:02:23.775005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:23.775005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 407/804] 10.222.0.48 () {56 vars in 1129 bytes} [Mon Jul 25 12:02:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:23.775872 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd51abf-9184-41e0-899c-6a883a0bcdc7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:23.803237 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:23.814265 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b627e-5e0d-45ff-ae2b-d08743c6896f None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:23.849490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f21e74-d09a-4e9c-875d-e8fa06916f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:23.849490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f21e74-d09a-4e9c-875d-e8fa06916f24 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:23.849808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f21e74-d09a-4e9c-875d-e8fa06916f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:23.850044 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f21e74-d09a-4e9c-875d-e8fa06916f24 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:23.850767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f21e74-d09a-4e9c-875d-e8fa06916f24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:23.851068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f21e74-d09a-4e9c-875d-e8fa06916f24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:23.852419 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f21e74-d09a-4e9c-875d-e8fa06916f24 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:23.868858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 398/805] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:23.870370 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f21e74-d09a-4e9c-875d-e8fa06916f24 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:23.882236 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd51abf-9184-41e0-899c-6a883a0bcdc7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:23.919703 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f16f6e-5618-41d6-988b-8e66394ae672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:23.920364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f16f6e-5618-41d6-988b-8e66394ae672 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:23.920670 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f16f6e-5618-41d6-988b-8e66394ae672 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:23.920969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f16f6e-5618-41d6-988b-8e66394ae672 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:23.921715 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f16f6e-5618-41d6-988b-8e66394ae672 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:23.922098 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f16f6e-5618-41d6-988b-8e66394ae672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:23.923482 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f16f6e-5618-41d6-988b-8e66394ae672 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:23.933034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 408/806] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:02:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:23.933624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f16f6e-5618-41d6-988b-8e66394ae672 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:23.980001 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f21e74-d09a-4e9c-875d-e8fa06916f24 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:23.994684 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:24.016646 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3590c9-5659-47fb-9c83-b47f264fb805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:24.017300 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3590c9-5659-47fb-9c83-b47f264fb805 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:24.017582 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3590c9-5659-47fb-9c83-b47f264fb805 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:24.017856 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3590c9-5659-47fb-9c83-b47f264fb805 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:24.018711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3590c9-5659-47fb-9c83-b47f264fb805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:24.019016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3590c9-5659-47fb-9c83-b47f264fb805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:24.020376 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3590c9-5659-47fb-9c83-b47f264fb805 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:24.033204 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 399/807] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:24.033852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3590c9-5659-47fb-9c83-b47f264fb805 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:24.048303 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f16f6e-5618-41d6-988b-8e66394ae672 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:24.049968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:24.083431 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a49692-b285-49ae-9dad-44d67dc16054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:24.084095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a49692-b285-49ae-9dad-44d67dc16054 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:24.084391 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a49692-b285-49ae-9dad-44d67dc16054 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:24.084633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a49692-b285-49ae-9dad-44d67dc16054 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:24.085331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a49692-b285-49ae-9dad-44d67dc16054 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:24.085651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a49692-b285-49ae-9dad-44d67dc16054 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:24.087100 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a49692-b285-49ae-9dad-44d67dc16054 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:24.096909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 409/808] 10.222.0.48 () {56 vars in 1124 bytes} [Mon Jul 25 12:02:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:24.096909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a49692-b285-49ae-9dad-44d67dc16054 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:24.145750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3590c9-5659-47fb-9c83-b47f264fb805 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:24.181709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c152a-b667-4ff1-bc72-da2d5efb7b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:24.182570 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c152a-b667-4ff1-bc72-da2d5efb7b16 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:24.182853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c152a-b667-4ff1-bc72-da2d5efb7b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:24.183181 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c152a-b667-4ff1-bc72-da2d5efb7b16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:24.190065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c152a-b667-4ff1-bc72-da2d5efb7b16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:24.191503 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c152a-b667-4ff1-bc72-da2d5efb7b16 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:24.200613 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a49692-b285-49ae-9dad-44d67dc16054 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:24.205197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-5d7c152a-b667-4ff1-bc72-da2d5efb7b16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:24.205197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:24.205197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:24.205197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:24.205197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:24.205197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:24.205197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:24.205197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:24.205197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:24.205197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:24.205197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:24.205197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:24.205197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:24.205197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:24.205197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:24.206243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:24.206243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:24.206243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:24.206243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:24.206243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:24.206243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:24.206243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:24.206243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:24.206243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:24.206243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:24.206243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:24.206243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:24.206243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:24.206243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:24.206243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:24.206243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:24.206243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:24.207275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:24.207275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:24.207275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:24.207275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:24.207275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:24.207275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:24.207275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:24.207275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:24.207275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 400/809] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:24.208063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c152a-b667-4ff1-bc72-da2d5efb7b16 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:24.225275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:24.236373 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000a841-1453-4261-bbee-2005d1502859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:24.237163 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000a841-1453-4261-bbee-2005d1502859 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:24.237446 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000a841-1453-4261-bbee-2005d1502859 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:24.237719 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000a841-1453-4261-bbee-2005d1502859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:24.248822 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000a841-1453-4261-bbee-2005d1502859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:24.250265 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000a841-1453-4261-bbee-2005d1502859 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:24.266789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b000a841-1453-4261-bbee-2005d1502859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:24.266789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:24.266789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:24.266789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:24.266789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:24.266789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:24.266789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:24.266789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:24.266789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:24.266789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:24.266789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:24.266789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:24.266789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:24.266789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:24.266789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:24.267796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:24.267796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:24.267796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:24.267796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:24.267796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:24.267796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:24.267796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:24.267796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:24.267796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:24.267796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:24.267796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:24.267796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:24.267796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:24.267796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:24.267796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:24.267796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:24.267796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:24.268858 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:24.268858 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:24.268858 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:24.268858 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:24.268858 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 410/810] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:24.269181 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000a841-1453-4261-bbee-2005d1502859 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:24.280372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:24.310229 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c152a-b667-4ff1-bc72-da2d5efb7b16 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:24.345313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6198ed2-6edc-4ccc-9504-9e2fcddc6f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:24.346196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198ed2-6edc-4ccc-9504-9e2fcddc6f0c None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:24.346477 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198ed2-6edc-4ccc-9504-9e2fcddc6f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:24.346749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198ed2-6edc-4ccc-9504-9e2fcddc6f0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:24.353382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6198ed2-6edc-4ccc-9504-9e2fcddc6f0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:24.354888 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6198ed2-6edc-4ccc-9504-9e2fcddc6f0c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:24.367462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000a841-1453-4261-bbee-2005d1502859 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:24.368798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-a6198ed2-6edc-4ccc-9504-9e2fcddc6f0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:24.368798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:24.368798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:24.368798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:24.368798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:24.368798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:24.368798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:24.368798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:24.368798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:24.368798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:24.368798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:24.368798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:24.368798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:24.368798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:24.368798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:24.369636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:24.369636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:24.369636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:24.369636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:24.369636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:24.369636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:24.369636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:24.369636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:24.369636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:24.369636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:24.369636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:24.369636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:24.369636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:24.369636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:24.369636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:24.369636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:24.369636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:24.370970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:24.370970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:24.370970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:24.370970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:24.370970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:24.370970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:24.370970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:24.370970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:24.370970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 401/811] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:24.371551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb7d68-748c-46ad-9670-5017ec25c7c2 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:24.371551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb7d68-748c-46ad-9670-5017ec25c7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:24.371726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb7d68-748c-46ad-9670-5017ec25c7c2 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:24.372982 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 402/812] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:24.373671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb7d68-748c-46ad-9670-5017ec25c7c2 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:24.406358 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada3bfe-9b3a-4a6e-a35a-0e0cc842ae85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:24.407023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada3bfe-9b3a-4a6e-a35a-0e0cc842ae85 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:24.407301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada3bfe-9b3a-4a6e-a35a-0e0cc842ae85 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:24.407574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada3bfe-9b3a-4a6e-a35a-0e0cc842ae85 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:24.408269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada3bfe-9b3a-4a6e-a35a-0e0cc842ae85 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:24.408570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada3bfe-9b3a-4a6e-a35a-0e0cc842ae85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:24.409922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada3bfe-9b3a-4a6e-a35a-0e0cc842ae85 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:24.415725 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 411/813] 10.222.0.48 () {56 vars in 1124 bytes} [Mon Jul 25 12:02:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:24.416324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada3bfe-9b3a-4a6e-a35a-0e0cc842ae85 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:24.459229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:24.480935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb7d68-748c-46ad-9670-5017ec25c7c2 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:24.509767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:24.515703 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039382a1-9337-4ae0-9994-ca2058da36a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:24.516355 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039382a1-9337-4ae0-9994-ca2058da36a1 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:24.516638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039382a1-9337-4ae0-9994-ca2058da36a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:24.516912 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039382a1-9337-4ae0-9994-ca2058da36a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:24.517696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039382a1-9337-4ae0-9994-ca2058da36a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:24.518025 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039382a1-9337-4ae0-9994-ca2058da36a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:24.519092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada3bfe-9b3a-4a6e-a35a-0e0cc842ae85 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:24.519438 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039382a1-9337-4ae0-9994-ca2058da36a1 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:24.531597 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 403/814] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:24.532398 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039382a1-9337-4ae0-9994-ca2058da36a1 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:24.557355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfb02d-b6c9-4547-a2c4-027ed806995b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:24.558044 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfb02d-b6c9-4547-a2c4-027ed806995b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:24.558336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfb02d-b6c9-4547-a2c4-027ed806995b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:24.558604 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfb02d-b6c9-4547-a2c4-027ed806995b None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:24.559326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfb02d-b6c9-4547-a2c4-027ed806995b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:24.559632 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfb02d-b6c9-4547-a2c4-027ed806995b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:24.560991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfb02d-b6c9-4547-a2c4-027ed806995b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:24.572952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 412/815] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:24.574168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d751a6-944d-46e0-9c0e-b442c2b978c3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:24.574451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d751a6-944d-46e0-9c0e-b442c2b978c3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:24.574724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d751a6-944d-46e0-9c0e-b442c2b978c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:24.591826 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c0d751a6-944d-46e0-9c0e-b442c2b978c3 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:24.593003 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c0d751a6-944d-46e0-9c0e-b442c2b978c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:24.632383 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039382a1-9337-4ae0-9994-ca2058da36a1 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:24.657856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 413/816] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:24.658680 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d751a6-944d-46e0-9c0e-b442c2b978c3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:24.665578 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34ec23-e2ae-4f1a-81dd-a57df0637f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:24.666348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34ec23-e2ae-4f1a-81dd-a57df0637f0d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:24.666638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34ec23-e2ae-4f1a-81dd-a57df0637f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:24.666940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34ec23-e2ae-4f1a-81dd-a57df0637f0d None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:24.668011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34ec23-e2ae-4f1a-81dd-a57df0637f0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:24.668318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34ec23-e2ae-4f1a-81dd-a57df0637f0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:24.669736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34ec23-e2ae-4f1a-81dd-a57df0637f0d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:24.687114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 404/817] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:24.687114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34ec23-e2ae-4f1a-81dd-a57df0637f0d None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:24.693215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:24.733572 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:24.761268 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d751a6-944d-46e0-9c0e-b442c2b978c3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:24.780232 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34ec23-e2ae-4f1a-81dd-a57df0637f0d None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:24.794021 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedc248-1db8-4db5-9259-4ad68565a96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:24.794707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedc248-1db8-4db5-9259-4ad68565a96e None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:24.794975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedc248-1db8-4db5-9259-4ad68565a96e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:24.795249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedc248-1db8-4db5-9259-4ad68565a96e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:24.795969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedc248-1db8-4db5-9259-4ad68565a96e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:24.797327 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedc248-1db8-4db5-9259-4ad68565a96e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:24.816206 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dd700-a78c-4bf7-80b5-339b852068f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:24.817097 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dd700-a78c-4bf7-80b5-339b852068f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:24.817376 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dd700-a78c-4bf7-80b5-339b852068f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:24.817650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dd700-a78c-4bf7-80b5-339b852068f1 None admin] PATH_INFO: `/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/30c0516b85e74bdb829a3019e71e6ea6/roles/0f49ec405a3c42a99beaaa0c79e67c5e` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:24.823313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 414/818] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:02:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:02:24.823313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedc248-1db8-4db5-9259-4ad68565a96e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:24.839167 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2dd700-a78c-4bf7-80b5-339b852068f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c80b9db7ace42c0a0cd1f31901599fd, user_id=30c0516b85e74bdb829a3019e71e6ea6, role_id=0f49ec405a3c42a99beaaa0c79e67c5e)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:24.840706 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2dd700-a78c-4bf7-80b5-339b852068f1 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:24.858639 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 405/819] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:02:24 2022] PUT /identity/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/30c0516b85e74bdb829a3019e71e6ea6/roles/0f49ec405a3c42a99beaaa0c79e67c5e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:02:24.859499 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dd700-a78c-4bf7-80b5-339b852068f1 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:24.973000 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:24.985592 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dd700-a78c-4bf7-80b5-339b852068f1 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:24.987588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:25.002927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedc248-1db8-4db5-9259-4ad68565a96e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:25.041463 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e7318-6a10-4d66-863c-823a3972154c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:25.043231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e7318-6a10-4d66-863c-823a3972154c None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:25.043712 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e7318-6a10-4d66-863c-823a3972154c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:25.044665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e7318-6a10-4d66-863c-823a3972154c None admin] PATH_INFO: `/v3/services/network` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:25.046494 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e7318-6a10-4d66-863c-823a3972154c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:25.048263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af699d0-8acc-48a1-b13a-8196829748ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:25.048646 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e7318-6a10-4d66-863c-823a3972154c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:25.049069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af699d0-8acc-48a1-b13a-8196829748ac None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:25.049350 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af699d0-8acc-48a1-b13a-8196829748ac None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:25.049621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af699d0-8acc-48a1-b13a-8196829748ac None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:25.058955 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af699d0-8acc-48a1-b13a-8196829748ac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:25.059800 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af699d0-8acc-48a1-b13a-8196829748ac None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:25.063757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-1f2e7318-6a10-4d66-863c-823a3972154c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 12:02:25.063757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:25.063757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:25.063757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:25.063757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:25.063757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:25.063757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:25.063757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:25.063757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 12:02:25.063757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:25.063757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:25.063757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:25.063757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:25.063757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:25.063757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:25.063757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:25.063757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:25.064704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:25.064704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:25.064704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:25.064704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:25.064704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:25.064704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:25.064704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:25.064704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:25.064704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:25.064704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:25.064704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:25.064704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:25.064704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:25.064704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:25.064704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:25.064704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:25.065591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:25.065591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:25.065591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:25.065591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:25.065591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:25.065591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:25.065591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:25.065591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:25.065591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:25.065591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:25.065591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:25.065591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:25.065591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 12:02:25.065591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:25.069891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 406/820] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:24 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:25.070903 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e7318-6a10-4d66-863c-823a3972154c None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:25.077093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7af699d0-8acc-48a1-b13a-8196829748ac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:02:25.077093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:25.077093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:25.077093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:25.077093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:25.077093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:25.077093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:25.077093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:25.077093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:25.077093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:25.077093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:25.077093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:25.077093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:25.077093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:25.077093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:25.077093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:25.078065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:25.078065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:25.078065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:25.078065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:25.078065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:25.078065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:25.078065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:25.078065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:25.078065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:25.078065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:25.078065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:25.078065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:25.078065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:25.078065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:25.078065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:25.078065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:25.078065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:25.078065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:25.078997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:25.078997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:25.078997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:25.078997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:25.078997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:25.078997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:25.078997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:25.078997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:25.078997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:02:25.078997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:25.078997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 415/821] 10.222.0.48 () {56 vars in 1093 bytes} [Mon Jul 25 12:02:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:25.079577 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af699d0-8acc-48a1-b13a-8196829748ac None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:25.192002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e7318-6a10-4d66-863c-823a3972154c None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:25.201069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af699d0-8acc-48a1-b13a-8196829748ac None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:25.227453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df6d02-ee6e-4cf6-85ca-74d77217a0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:25.229206 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df6d02-ee6e-4cf6-85ca-74d77217a0e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:25.229711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df6d02-ee6e-4cf6-85ca-74d77217a0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:25.230220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df6d02-ee6e-4cf6-85ca-74d77217a0e6 None admin] PATH_INFO: `/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/e71de21b4b6d4971953f0c1ca92d9f23/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:25.232814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df6d02-ee6e-4cf6-85ca-74d77217a0e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c80b9db7ace42c0a0cd1f31901599fd, user_id=e71de21b4b6d4971953f0c1ca92d9f23, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:25.234489 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df6d02-ee6e-4cf6-85ca-74d77217a0e6 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:25.238253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d6385-b590-4e6c-b8d7-eb26f1fdd3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:25.239040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d6385-b590-4e6c-b8d7-eb26f1fdd3fe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:25.239395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d6385-b590-4e6c-b8d7-eb26f1fdd3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:25.239735 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d6385-b590-4e6c-b8d7-eb26f1fdd3fe None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:25.240625 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d6385-b590-4e6c-b8d7-eb26f1fdd3fe None admin] RBAC: Adding query filter params (name=network) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:25.241035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d6385-b590-4e6c-b8d7-eb26f1fdd3fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:25.242513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d6385-b590-4e6c-b8d7-eb26f1fdd3fe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:25.248595 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 416/822] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 12:02:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:25.249576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d6385-b590-4e6c-b8d7-eb26f1fdd3fe None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:25.252542 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 407/823] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:02:25 2022] PUT /identity/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/e71de21b4b6d4971953f0c1ca92d9f23/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:02:25.254266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df6d02-ee6e-4cf6-85ca-74d77217a0e6 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:25.259299 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:25.289128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:25.375432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d6385-b590-4e6c-b8d7-eb26f1fdd3fe None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:25.375979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df6d02-ee6e-4cf6-85ca-74d77217a0e6 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:25.412988 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc736ee-79f2-4c94-9811-01679769fb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:25.413768 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc736ee-79f2-4c94-9811-01679769fb0e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:25.414164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc736ee-79f2-4c94-9811-01679769fb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:25.414513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc736ee-79f2-4c94-9811-01679769fb0e None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:25.415430 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc736ee-79f2-4c94-9811-01679769fb0e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:25.415648 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f8cf5-42be-4052-9e38-ed9a572a00b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:25.415812 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc736ee-79f2-4c94-9811-01679769fb0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:25.417190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f8cf5-42be-4052-9e38-ed9a572a00b5 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:25.417653 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f8cf5-42be-4052-9e38-ed9a572a00b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:25.418311 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc736ee-79f2-4c94-9811-01679769fb0e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:25.418589 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f8cf5-42be-4052-9e38-ed9a572a00b5 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:25.419479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f8cf5-42be-4052-9e38-ed9a572a00b5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:25.419962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f8cf5-42be-4052-9e38-ed9a572a00b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:25.421664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f8cf5-42be-4052-9e38-ed9a572a00b5 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:25.427751 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 408/824] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 12:02:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:25.434452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f8cf5-42be-4052-9e38-ed9a572a00b5 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:25.438757 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 417/825] 10.222.0.48 () {56 vars in 1133 bytes} [Mon Jul 25 12:02:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:25.448093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc736ee-79f2-4c94-9811-01679769fb0e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:25.516924 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:25.566077 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc736ee-79f2-4c94-9811-01679769fb0e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:25.609661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:25.615874 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b5ef8-295c-4d16-8aa3-a26c198366c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:25.617017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b5ef8-295c-4d16-8aa3-a26c198366c3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:25.617377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b5ef8-295c-4d16-8aa3-a26c198366c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:25.617965 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b5ef8-295c-4d16-8aa3-a26c198366c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:25.623635 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f8cf5-42be-4052-9e38-ed9a572a00b5 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:25.687381 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34812d2d-6b50-40f9-8153-d981486c1166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:25.688064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34812d2d-6b50-40f9-8153-d981486c1166 None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:25.688348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34812d2d-6b50-40f9-8153-d981486c1166 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:25.688623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34812d2d-6b50-40f9-8153-d981486c1166 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:25.689567 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34812d2d-6b50-40f9-8153-d981486c1166 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:25.691017 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34812d2d-6b50-40f9-8153-d981486c1166 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:25.700048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b5ef8-295c-4d16-8aa3-a26c198366c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:25.701513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b5ef8-295c-4d16-8aa3-a26c198366c3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:25.739522 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 409/826] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:02:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:02:25.772865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:25.813310 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 418/827] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:02:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 12:02:25.818719 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34812d2d-6b50-40f9-8153-d981486c1166 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:25.979018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34812d2d-6b50-40f9-8153-d981486c1166 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:26.025373 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a43ea-70b4-4b0c-a191-74dcb35d3146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:26.026681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a43ea-70b4-4b0c-a191-74dcb35d3146 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:26.026963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a43ea-70b4-4b0c-a191-74dcb35d3146 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:26.027239 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a43ea-70b4-4b0c-a191-74dcb35d3146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:26.037955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a43ea-70b4-4b0c-a191-74dcb35d3146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:26.039420 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a43ea-70b4-4b0c-a191-74dcb35d3146 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:26.041149 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:26.058894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-1b8a43ea-70b4-4b0c-a191-74dcb35d3146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:26.058894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:26.058894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:26.058894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:26.058894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:26.058894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:26.058894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:26.058894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:26.058894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:26.058894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:26.058894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:26.058894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:26.058894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:26.058894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:26.058894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:26.059891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:26.059891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:26.059891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:26.059891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:26.059891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:26.059891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:26.059891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:26.059891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:26.059891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:26.059891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:26.059891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:26.059891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:26.059891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:26.059891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:26.059891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:26.059891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:26.059891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:26.060772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:26.060772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:26.060772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:26.060772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:26.060772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 410/828] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:26.065967 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b5ef8-295c-4d16-8aa3-a26c198366c3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:26.177411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b5ef8-295c-4d16-8aa3-a26c198366c3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:26.214259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f75bb-5423-403c-9d16-8b2f1d16a73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:26.214930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f75bb-5423-403c-9d16-8b2f1d16a73a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:26.215210 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f75bb-5423-403c-9d16-8b2f1d16a73a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:26.215483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f75bb-5423-403c-9d16-8b2f1d16a73a None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:26.216205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f75bb-5423-403c-9d16-8b2f1d16a73a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:26.216507 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f75bb-5423-403c-9d16-8b2f1d16a73a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:26.217871 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f75bb-5423-403c-9d16-8b2f1d16a73a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:26.235836 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 419/829] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:26.241340 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a43ea-70b4-4b0c-a191-74dcb35d3146 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:26.349878 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a43ea-70b4-4b0c-a191-74dcb35d3146 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:26.385765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cb751-9ccb-4e64-86b0-b17f8dc329a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:26.386592 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cb751-9ccb-4e64-86b0-b17f8dc329a3 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:26.387010 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cb751-9ccb-4e64-86b0-b17f8dc329a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:26.387283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cb751-9ccb-4e64-86b0-b17f8dc329a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:26.394064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cb751-9ccb-4e64-86b0-b17f8dc329a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:26.395502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cb751-9ccb-4e64-86b0-b17f8dc329a3 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:26.409128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-ea4cb751-9ccb-4e64-86b0-b17f8dc329a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:26.409128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:26.409128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:26.409128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:26.409128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:26.409128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:26.409128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:26.409128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:26.409128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:26.409128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:26.409128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:26.409128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:26.409128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:26.409128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:26.409128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:26.409980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:26.409980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:26.409980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:26.409980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:26.409980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:26.409980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:26.409980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:26.409980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:26.409980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:26.409980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:26.409980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:26.409980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:26.409980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:26.409980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:26.409980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:26.409980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:26.409980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:26.410873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:26.410873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:26.410873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:26.410873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:26.410873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:26.410873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:26.410873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:26.410873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:26.410873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 411/830] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:26.416339 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f75bb-5423-403c-9d16-8b2f1d16a73a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:26.442122 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:26.516598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f75bb-5423-403c-9d16-8b2f1d16a73a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:26.550037 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62103da-f027-4eec-9c27-6bfc2a3f0c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:26.550707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62103da-f027-4eec-9c27-6bfc2a3f0c62 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:26.550987 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62103da-f027-4eec-9c27-6bfc2a3f0c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:26.551257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62103da-f027-4eec-9c27-6bfc2a3f0c62 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:26.552042 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62103da-f027-4eec-9c27-6bfc2a3f0c62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:26.552345 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62103da-f027-4eec-9c27-6bfc2a3f0c62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:26.553776 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62103da-f027-4eec-9c27-6bfc2a3f0c62 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:26.566084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 420/831] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:26.571953 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cb751-9ccb-4e64-86b0-b17f8dc329a3 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:26.633022 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:26.679380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cb751-9ccb-4e64-86b0-b17f8dc329a3 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:26.713956 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8391b-7958-4bbb-a952-4f0331fb8399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:26.719474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8391b-7958-4bbb-a952-4f0331fb8399 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:26.719474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8391b-7958-4bbb-a952-4f0331fb8399 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:26.719474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8391b-7958-4bbb-a952-4f0331fb8399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:26.719474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8391b-7958-4bbb-a952-4f0331fb8399 None admin] RBAC: Adding query filter params (role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=6d9db26891a04b0bb7e655c21feeffdd) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:26.719474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8391b-7958-4bbb-a952-4f0331fb8399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:26.719474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8391b-7958-4bbb-a952-4f0331fb8399 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:26.724689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 412/832] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:02:26 2022] GET /identity/v3/role_assignments?user.id=6d9db26891a04b0bb7e655c21feeffdd&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:27.079035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52756b-c03d-4a73-a6e1-e33fc4d72baf None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:27.079556 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52756b-c03d-4a73-a6e1-e33fc4d72baf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:27.079556 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52756b-c03d-4a73-a6e1-e33fc4d72baf None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:27.081214 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 421/833] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:27.086515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03684712-1681-4946-9c33-eb9ee16a3f26 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:27.087328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03684712-1681-4946-9c33-eb9ee16a3f26 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:27.087810 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03684712-1681-4946-9c33-eb9ee16a3f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:27.107607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-03684712-1681-4946-9c33-eb9ee16a3f26 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:27.109165 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-03684712-1681-4946-9c33-eb9ee16a3f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:27.138477 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f7ade-5aac-4343-9927-662c1d55c389 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:27.138776 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f7ade-5aac-4343-9927-662c1d55c389 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:27.139041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f7ade-5aac-4343-9927-662c1d55c389 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:27.140661 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 422/834] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:27.145430 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1653614-9118-4d27-9fff-07b0bbc38969 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:27.145725 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1653614-9118-4d27-9fff-07b0bbc38969 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:27.146029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1653614-9118-4d27-9fff-07b0bbc38969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:27.164979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a1653614-9118-4d27-9fff-07b0bbc38969 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:27.166715 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a1653614-9118-4d27-9fff-07b0bbc38969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:27.184609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 413/835] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:27.207371 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03684712-1681-4946-9c33-eb9ee16a3f26 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:27.239793 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 423/836] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:27.258085 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:27.262872 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1653614-9118-4d27-9fff-07b0bbc38969 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:27.279001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:27.318949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03684712-1681-4946-9c33-eb9ee16a3f26 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:27.356602 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea782c0-7f99-4793-bded-9ec0238d4b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:27.357322 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea782c0-7f99-4793-bded-9ec0238d4b42 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:27.357608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea782c0-7f99-4793-bded-9ec0238d4b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:27.357886 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea782c0-7f99-4793-bded-9ec0238d4b42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:27.369021 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea782c0-7f99-4793-bded-9ec0238d4b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:27.372946 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1653614-9118-4d27-9fff-07b0bbc38969 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:27.377765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-5ea782c0-7f99-4793-bded-9ec0238d4b42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:27.377765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:27.377765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:27.377765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:27.377765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:27.377765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:27.377765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:27.377765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:27.377765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:27.377765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:27.377765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:27.377765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:27.377765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:27.377765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:27.377765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:27.377765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:27.378822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:27.378822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:27.378822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:27.378822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:27.378822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:27.378822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:27.378822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:27.378822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:27.378822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:27.378822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:27.378822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:27.378822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:27.378822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:27.378822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:27.378822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:27.378822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:27.379636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:27.379636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:27.379636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:27.379636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:27.379636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:27.379636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:27.379636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:27.379636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:27.379636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:27.379636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:27.379636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:02:27.379636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:27.379636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 414/837] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:02:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:27.385068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea782c0-7f99-4793-bded-9ec0238d4b42 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:27.412895 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510abce-0593-48e9-9044-ef859d350e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:27.414096 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510abce-0593-48e9-9044-ef859d350e8f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:27.414583 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510abce-0593-48e9-9044-ef859d350e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:27.415123 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510abce-0593-48e9-9044-ef859d350e8f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:27.416081 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510abce-0593-48e9-9044-ef859d350e8f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:27.418666 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510abce-0593-48e9-9044-ef859d350e8f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:27.431934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b510abce-0593-48e9-9044-ef859d350e8f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 12:02:27.431934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:27.431934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:27.431934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:27.431934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:27.431934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:27.431934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:27.431934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:27.431934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 12:02:27.431934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:27.431934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:27.431934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:27.431934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:27.431934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:27.431934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:27.431934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:27.431934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:27.433411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:27.433411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:27.433411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:27.433411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:27.433411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:27.433411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:27.433411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:27.433411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:27.433411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:27.433411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:27.433411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:27.433411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:27.433411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:27.433411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:27.433411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:27.433411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:27.434273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:27.434273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:27.434273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:27.434273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:27.434273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:27.434273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:27.434273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:27.434273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:27.434273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:27.434273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:27.434273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:27.434273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:27.434273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 12:02:27.434273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:27.437105 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 424/838] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:02:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:27.447985 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510abce-0593-48e9-9044-ef859d350e8f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:27.496827 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea782c0-7f99-4793-bded-9ec0238d4b42 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:27.507111 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:27.534926 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7027861-e57d-45a5-af8a-2eebd864337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:27.535588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7027861-e57d-45a5-af8a-2eebd864337c None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:27.535867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7027861-e57d-45a5-af8a-2eebd864337c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:27.536139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7027861-e57d-45a5-af8a-2eebd864337c None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:27.536998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7027861-e57d-45a5-af8a-2eebd864337c None admin] RBAC: Adding query filter params (name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:27.537306 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7027861-e57d-45a5-af8a-2eebd864337c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:27.538823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7027861-e57d-45a5-af8a-2eebd864337c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:27.553133 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:27.553298 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 415/839] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:02:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:27.555210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7027861-e57d-45a5-af8a-2eebd864337c None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:27.582979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510abce-0593-48e9-9044-ef859d350e8f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:27.625260 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9507a-ca8f-4109-9877-31b4e3338ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:27.625937 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9507a-ca8f-4109-9877-31b4e3338ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:27.626363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9507a-ca8f-4109-9877-31b4e3338ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:27.626919 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9507a-ca8f-4109-9877-31b4e3338ff7 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:27.628091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9507a-ca8f-4109-9877-31b4e3338ff7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:27.628466 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9507a-ca8f-4109-9877-31b4e3338ff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:27.630223 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9507a-ca8f-4109-9877-31b4e3338ff7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:27.638036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 425/840] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:02:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:27.641961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9507a-ca8f-4109-9877-31b4e3338ff7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:27.685983 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7027861-e57d-45a5-af8a-2eebd864337c None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:27.732422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb28efe-d76d-46d7-829f-4cfeeec61ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:27.734075 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb28efe-d76d-46d7-829f-4cfeeec61ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:27.734542 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb28efe-d76d-46d7-829f-4cfeeec61ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:27.735430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb28efe-d76d-46d7-829f-4cfeeec61ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:27.748331 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb28efe-d76d-46d7-829f-4cfeeec61ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:27.749763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb28efe-d76d-46d7-829f-4cfeeec61ef6 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:27.758435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9507a-ca8f-4109-9877-31b4e3338ff7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:27.766623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-2bb28efe-d76d-46d7-829f-4cfeeec61ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:27.766623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:27.766623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:27.766623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:27.766623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:27.766623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:27.766623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:27.766623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:27.766623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:27.766623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:27.766623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:27.766623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:27.766623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:27.766623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:27.766623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:27.767490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:27.767490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:27.767490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:27.767490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:27.767490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:27.767490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:27.767490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:27.767490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:27.767490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:27.767490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:27.767490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:27.767490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:27.767490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:27.767490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:27.767490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:27.767490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:27.767490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:27.768348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:27.768348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:27.768348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:27.768348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:27.768348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 416/841] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:27.769146 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044376de-6f2d-4d86-a04d-af86c27dc6f9 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:27.769347 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044376de-6f2d-4d86-a04d-af86c27dc6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:27.769624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044376de-6f2d-4d86-a04d-af86c27dc6f9 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:27.771078 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 417/842] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:27.774048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044376de-6f2d-4d86-a04d-af86c27dc6f9 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:27.800014 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:27.806904 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de056b28-a6b8-485c-abe3-1416bd2cf0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:27.807583 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de056b28-a6b8-485c-abe3-1416bd2cf0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:27.807870 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de056b28-a6b8-485c-abe3-1416bd2cf0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:27.808162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de056b28-a6b8-485c-abe3-1416bd2cf0f3 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:27.808852 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de056b28-a6b8-485c-abe3-1416bd2cf0f3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:27.809158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de056b28-a6b8-485c-abe3-1416bd2cf0f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:27.810635 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de056b28-a6b8-485c-abe3-1416bd2cf0f3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:27.822202 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 426/843] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:02:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:27.824638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94030c4d-8b1e-46c7-8d95-bf03786f2c6a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:27.825219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94030c4d-8b1e-46c7-8d95-bf03786f2c6a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:27.826438 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94030c4d-8b1e-46c7-8d95-bf03786f2c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:27.848610 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:27.849686 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-94030c4d-8b1e-46c7-8d95-bf03786f2c6a None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:27.850938 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-94030c4d-8b1e-46c7-8d95-bf03786f2c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:27.895415 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044376de-6f2d-4d86-a04d-af86c27dc6f9 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:27.929352 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 427/844] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:27.937746 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e0b81-1df2-4137-be82-e5a6d65efe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:27.938487 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e0b81-1df2-4137-be82-e5a6d65efe53 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:27.938773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e0b81-1df2-4137-be82-e5a6d65efe53 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:27.939047 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e0b81-1df2-4137-be82-e5a6d65efe53 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:27.939859 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e0b81-1df2-4137-be82-e5a6d65efe53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:27.940168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e0b81-1df2-4137-be82-e5a6d65efe53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:27.941619 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e0b81-1df2-4137-be82-e5a6d65efe53 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:27.954685 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94030c4d-8b1e-46c7-8d95-bf03786f2c6a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:27.955528 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 418/845] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:27.967086 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e0b81-1df2-4137-be82-e5a6d65efe53 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:28.074349 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:28.082956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94030c4d-8b1e-46c7-8d95-bf03786f2c6a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:28.103851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e0b81-1df2-4137-be82-e5a6d65efe53 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:28.127258 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effbe5d-318e-4adb-ad28-c4cde129f6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:28.128066 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effbe5d-318e-4adb-ad28-c4cde129f6ef None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:28.128345 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effbe5d-318e-4adb-ad28-c4cde129f6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:28.128625 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effbe5d-318e-4adb-ad28-c4cde129f6ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:28.132540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:28.145264 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effbe5d-318e-4adb-ad28-c4cde129f6ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:28.145652 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2e273-4879-490c-8355-6a022d9ccfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:28.146669 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2e273-4879-490c-8355-6a022d9ccfb0 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:28.147100 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2e273-4879-490c-8355-6a022d9ccfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:28.147700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2e273-4879-490c-8355-6a022d9ccfb0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:28.155049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1effbe5d-318e-4adb-ad28-c4cde129f6ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:02:28.155049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:28.155049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:28.155049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:28.155049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:28.155049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:28.155049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:28.155049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:28.155049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:28.155049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:28.155049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:28.155049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:28.155049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:28.155049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:28.155049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:28.155049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:28.156070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:28.156070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:28.156070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:28.156070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:28.156070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:28.156070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:28.156070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:28.156070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:28.156070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:28.156070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:28.156070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:28.156070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:28.156070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:28.156070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:28.156070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:28.156070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:28.156931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:28.156931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:28.156931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:28.156931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:28.156931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:28.156931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:28.156931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:28.156931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:28.156931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:28.156931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:28.156931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:02:28.156931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:28.161893 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 428/846] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:02:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:28.163107 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effbe5d-318e-4adb-ad28-c4cde129f6ef None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:28.163627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2e273-4879-490c-8355-6a022d9ccfb0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:28.165711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2e273-4879-490c-8355-6a022d9ccfb0 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:28.182832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-bde2e273-4879-490c-8355-6a022d9ccfb0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:02:28.182832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:28.182832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:28.182832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:28.182832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:28.182832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:28.182832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:28.182832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:28.182832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:28.182832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:28.182832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:28.182832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:28.182832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:28.182832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:28.182832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:28.182832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:28.183844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:28.183844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:28.183844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:28.183844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:28.183844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:28.183844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:28.183844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:28.183844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:28.183844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:28.183844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:28.183844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:28.183844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:28.183844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:28.183844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:28.183844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:28.183844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:28.183844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:28.183844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:28.184807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:28.184807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:28.184807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:28.184807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:28.184807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:28.184807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:28.184807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:28.184807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:28.184807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:02:28.184807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:28.187634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 419/847] 10.222.0.48 () {56 vars in 1117 bytes} [Mon Jul 25 12:02:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:28.193839 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2e273-4879-490c-8355-6a022d9ccfb0 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:28.282428 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effbe5d-318e-4adb-ad28-c4cde129f6ef None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:28.327196 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be19901-0708-4cf5-9fb5-5dba81980256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:28.327869 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be19901-0708-4cf5-9fb5-5dba81980256 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:28.328159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be19901-0708-4cf5-9fb5-5dba81980256 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:28.328434 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be19901-0708-4cf5-9fb5-5dba81980256 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:28.329179 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be19901-0708-4cf5-9fb5-5dba81980256 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:28.329489 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be19901-0708-4cf5-9fb5-5dba81980256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:28.330899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be19901-0708-4cf5-9fb5-5dba81980256 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:28.344641 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 429/848] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:02:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:28.345745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be19901-0708-4cf5-9fb5-5dba81980256 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:28.357094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2e273-4879-490c-8355-6a022d9ccfb0 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:28.405600 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076144d-b6b0-4687-8ac7-a7ed0815f67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:28.406897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076144d-b6b0-4687-8ac7-a7ed0815f67a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:28.407810 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076144d-b6b0-4687-8ac7-a7ed0815f67a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:28.408591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076144d-b6b0-4687-8ac7-a7ed0815f67a None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:28.409820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:28.410362 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076144d-b6b0-4687-8ac7-a7ed0815f67a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:28.412189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076144d-b6b0-4687-8ac7-a7ed0815f67a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:28.414337 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076144d-b6b0-4687-8ac7-a7ed0815f67a None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:28.435189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:28.446189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 420/849] 10.222.0.48 () {56 vars in 1149 bytes} [Mon Jul 25 12:02:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:28.450071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076144d-b6b0-4687-8ac7-a7ed0815f67a None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:28.475724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be19901-0708-4cf5-9fb5-5dba81980256 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:28.525767 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4f0a0-dec5-4eb3-94dc-3337d6b3cebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:28.528045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4f0a0-dec5-4eb3-94dc-3337d6b3cebc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:28.528546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4f0a0-dec5-4eb3-94dc-3337d6b3cebc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:28.529056 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4f0a0-dec5-4eb3-94dc-3337d6b3cebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:28.544290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4f0a0-dec5-4eb3-94dc-3337d6b3cebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:28.546620 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4f0a0-dec5-4eb3-94dc-3337d6b3cebc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:28.558723 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076144d-b6b0-4687-8ac7-a7ed0815f67a None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:28.571432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-78a4f0a0-dec5-4eb3-94dc-3337d6b3cebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:28.571432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:28.571432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:28.571432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:28.571432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:28.571432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:28.571432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:28.571432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:28.571432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:28.571432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:28.571432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:28.571432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:28.571432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:28.571432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:28.571432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:28.572333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:28.572333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:28.572333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:28.572333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:28.572333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:28.572333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:28.572333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:28.572333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:28.572333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:28.572333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:28.572333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:28.572333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:28.572333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:28.572333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:28.572333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:28.572333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:28.572333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:28.573895 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:28.573895 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:28.573895 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:28.573895 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:28.580199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 430/850] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:28.580832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4f0a0-dec5-4eb3-94dc-3337d6b3cebc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:28.607746 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678568a-dda8-4a0d-bdeb-1e30969d016c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:28.608960 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678568a-dda8-4a0d-bdeb-1e30969d016c None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:28.609684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678568a-dda8-4a0d-bdeb-1e30969d016c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:28.610171 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678568a-dda8-4a0d-bdeb-1e30969d016c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:28.681522 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:28.685330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678568a-dda8-4a0d-bdeb-1e30969d016c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:28.687734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678568a-dda8-4a0d-bdeb-1e30969d016c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:28.694767 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4f0a0-dec5-4eb3-94dc-3337d6b3cebc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:28.706465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:28.732459 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de1243-c6d0-4406-b16c-57cbcc9f11ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:28.733279 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de1243-c6d0-4406-b16c-57cbcc9f11ad None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:28.733667 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de1243-c6d0-4406-b16c-57cbcc9f11ad None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:28.734089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de1243-c6d0-4406-b16c-57cbcc9f11ad None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:28.734925 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de1243-c6d0-4406-b16c-57cbcc9f11ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:28.735336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de1243-c6d0-4406-b16c-57cbcc9f11ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:28.736805 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de1243-c6d0-4406-b16c-57cbcc9f11ad None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:28.754921 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 431/851] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:28.755911 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de1243-c6d0-4406-b16c-57cbcc9f11ad None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:28.795424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 421/852] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:02:28 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:02:28.801327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678568a-dda8-4a0d-bdeb-1e30969d016c None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:28.864438 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de1243-c6d0-4406-b16c-57cbcc9f11ad None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:28.899155 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259ba18-0901-43a6-b7c1-677df43a1907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:28.899983 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ba18-0901-43a6-b7c1-677df43a1907 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:28.900268 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ba18-0901-43a6-b7c1-677df43a1907 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:28.900543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ba18-0901-43a6-b7c1-677df43a1907 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:28.911682 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259ba18-0901-43a6-b7c1-677df43a1907 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:28.913031 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259ba18-0901-43a6-b7c1-677df43a1907 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:28.920326 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:28.923545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678568a-dda8-4a0d-bdeb-1e30969d016c None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:28.929305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6259ba18-0901-43a6-b7c1-677df43a1907 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:02:28.929305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:28.929305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:28.929305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:28.929305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:28.929305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:28.929305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:28.929305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:28.929305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:28.929305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:28.929305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:28.929305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:28.929305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:28.929305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:28.929305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:28.929305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:28.930263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:28.930263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:28.930263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:28.930263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:28.930263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:28.930263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:28.930263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:28.930263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:28.930263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:28.930263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:28.930263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:28.930263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:28.930263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:28.930263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:28.930263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:28.930263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:28.930263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:28.930263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:28.931149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:28.931149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:28.931149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:28.931149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:28.931149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:28.931149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:28.931149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:28.931149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:28.931149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:02:28.931149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:28.935911 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 432/853] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:02:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:28.937234 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fc872-8075-426b-ac8f-f8b9549693f0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:28.937495 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fc872-8075-426b-ac8f-f8b9549693f0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:28.937776 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fc872-8075-426b-ac8f-f8b9549693f0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:28.943837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 433/854] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:28.944904 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fc872-8075-426b-ac8f-f8b9549693f0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:28.963782 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee73b3-c6a1-4bd3-a9c0-046a930ddab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:28.964680 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee73b3-c6a1-4bd3-a9c0-046a930ddab9 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:28.965035 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee73b3-c6a1-4bd3-a9c0-046a930ddab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:28.965430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee73b3-c6a1-4bd3-a9c0-046a930ddab9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:28.976275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee73b3-c6a1-4bd3-a9c0-046a930ddab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:28.977017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:28.977711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee73b3-c6a1-4bd3-a9c0-046a930ddab9 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:28.996341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-0dee73b3-c6a1-4bd3-a9c0-046a930ddab9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:28.996341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:28.996341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:28.996341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:28.996341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:28.996341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:28.996341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:28.996341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:28.996341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:28.996341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:28.996341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:28.996341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:28.996341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:28.996341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:28.996341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:28.997247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:28.997247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:28.997247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:28.997247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:28.997247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:28.997247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:28.997247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:28.997247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:28.997247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:28.997247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:28.997247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:28.997247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:28.997247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:28.997247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:28.997247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:28.997247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:28.997247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:28.998711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:28.998711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:28.998711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:28.998711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:28.998711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 422/855] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:28.998993 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adbf97-0945-485e-ab53-e7f38e534797 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:28.998993 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adbf97-0945-485e-ab53-e7f38e534797 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:28.999280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adbf97-0945-485e-ab53-e7f38e534797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:29.017285 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-a3adbf97-0945-485e-ab53-e7f38e534797 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:29.018494 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a3adbf97-0945-485e-ab53-e7f38e534797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:29.063532 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fc872-8075-426b-ac8f-f8b9549693f0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:29.090164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 423/856] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:29.090164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adbf97-0945-485e-ab53-e7f38e534797 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:29.101939 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038030ad-70e0-41b8-8d1f-ecf6dcf4aa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:29.102742 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038030ad-70e0-41b8-8d1f-ecf6dcf4aa31 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:29.103030 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038030ad-70e0-41b8-8d1f-ecf6dcf4aa31 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:29.103312 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038030ad-70e0-41b8-8d1f-ecf6dcf4aa31 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:29.104733 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038030ad-70e0-41b8-8d1f-ecf6dcf4aa31 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:29.105042 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038030ad-70e0-41b8-8d1f-ecf6dcf4aa31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:29.106756 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038030ad-70e0-41b8-8d1f-ecf6dcf4aa31 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:29.128842 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 434/857] 10.222.0.48 () {56 vars in 1135 bytes} [Mon Jul 25 12:02:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:29.134114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038030ad-70e0-41b8-8d1f-ecf6dcf4aa31 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:29.184398 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:29.203201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adbf97-0945-485e-ab53-e7f38e534797 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:29.231446 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:29.238363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2618758-6016-4bcc-b816-69c77f8704f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:29.239026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2618758-6016-4bcc-b816-69c77f8704f1 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:29.239305 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2618758-6016-4bcc-b816-69c77f8704f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:29.239576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2618758-6016-4bcc-b816-69c77f8704f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:29.240298 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2618758-6016-4bcc-b816-69c77f8704f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:29.240710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2618758-6016-4bcc-b816-69c77f8704f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:29.241969 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2618758-6016-4bcc-b816-69c77f8704f1 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:29.246282 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038030ad-70e0-41b8-8d1f-ecf6dcf4aa31 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:29.257486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 424/858] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:29.257486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2618758-6016-4bcc-b816-69c77f8704f1 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:29.287172 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7ef9c-6f5a-4613-bd94-959be1c0bb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:29.288084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7ef9c-6f5a-4613-bd94-959be1c0bb84 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:29.288365 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7ef9c-6f5a-4613-bd94-959be1c0bb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:29.288797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7ef9c-6f5a-4613-bd94-959be1c0bb84 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:29.289363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7ef9c-6f5a-4613-bd94-959be1c0bb84 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:29.290674 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7ef9c-6f5a-4613-bd94-959be1c0bb84 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:29.303844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-76b7ef9c-6f5a-4613-bd94-959be1c0bb84 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 12:02:29.303844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:29.303844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:29.303844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:29.303844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:29.303844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:29.303844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:29.303844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:29.303844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 12:02:29.303844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:29.303844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:29.303844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:29.303844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:29.303844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:29.303844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:29.303844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:29.304750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:29.304750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:29.304750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:29.304750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:29.304750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:29.304750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:29.304750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:29.304750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:29.304750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:29.304750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:29.304750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:29.304750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:29.304750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:29.304750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:29.304750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:29.304750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:29.305593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:29.305593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:29.305593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:29.305593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:29.305593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:29.305593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:29.305593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:29.305593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:29.305593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:29.305593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:29.305593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:29.305593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:29.305593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:29.305593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 12:02:29.305593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:29.305593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 435/859] 10.222.0.48 () {56 vars in 1132 bytes} [Mon Jul 25 12:02:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:29.307080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7ef9c-6f5a-4613-bd94-959be1c0bb84 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:29.371644 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2618758-6016-4bcc-b816-69c77f8704f1 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:29.409921 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dbad2-bf5b-4ddb-b81d-7557bdc329ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:29.410598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7ef9c-6f5a-4613-bd94-959be1c0bb84 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:29.411188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dbad2-bf5b-4ddb-b81d-7557bdc329ca None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:29.411703 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dbad2-bf5b-4ddb-b81d-7557bdc329ca None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:29.412202 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dbad2-bf5b-4ddb-b81d-7557bdc329ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:29.425563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:29.453055 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576bdd0-140f-4b9c-81e0-362a06c7617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:29.453909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576bdd0-140f-4b9c-81e0-362a06c7617d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:29.454170 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576bdd0-140f-4b9c-81e0-362a06c7617d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:29.454446 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576bdd0-140f-4b9c-81e0-362a06c7617d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:29.461374 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576bdd0-140f-4b9c-81e0-362a06c7617d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:29.462849 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576bdd0-140f-4b9c-81e0-362a06c7617d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:29.481400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8576bdd0-140f-4b9c-81e0-362a06c7617d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:29.481400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:29.481400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:29.481400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:29.481400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:29.481400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:29.481400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:29.481400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:29.481400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:29.481400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:29.481400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:29.481400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:29.481400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:29.481400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:29.481400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:29.482287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:29.482287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:29.482287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:29.482287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:29.482287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:29.482287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:29.482287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:29.482287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:29.482287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:29.482287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:29.482287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:29.482287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:29.482287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:29.482287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:29.482287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:29.482287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:29.482287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:29.483145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:29.483145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:29.483145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:29.483145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:29.483145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:29.483145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:29.483145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:29.483145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:29.483145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 436/860] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:29.483688 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576bdd0-140f-4b9c-81e0-362a06c7617d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:29.497408 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dbad2-bf5b-4ddb-b81d-7557bdc329ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:29.499437 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:29.500106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dbad2-bf5b-4ddb-b81d-7557bdc329ca None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:29.592489 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576bdd0-140f-4b9c-81e0-362a06c7617d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:29.606877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 425/861] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:02:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:02:29.607558 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dbad2-bf5b-4ddb-b81d-7557bdc329ca None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:29.631096 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a42e4-72f6-454b-9470-4871c50f1a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:29.631769 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a42e4-72f6-454b-9470-4871c50f1a1d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:29.632060 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a42e4-72f6-454b-9470-4871c50f1a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:29.632337 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a42e4-72f6-454b-9470-4871c50f1a1d None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:29.633053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a42e4-72f6-454b-9470-4871c50f1a1d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:29.633363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a42e4-72f6-454b-9470-4871c50f1a1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:29.634770 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a42e4-72f6-454b-9470-4871c50f1a1d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:29.639845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 437/862] 10.222.0.48 () {56 vars in 1126 bytes} [Mon Jul 25 12:02:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:29.640609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a42e4-72f6-454b-9470-4871c50f1a1d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:29.657012 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:29.715726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dbad2-bf5b-4ddb-b81d-7557bdc329ca None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:29.724078 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:29.749186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a42e4-72f6-454b-9470-4871c50f1a1d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:29.751483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47e4cf-10ba-41b4-b94f-c09e899928c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:29.752140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47e4cf-10ba-41b4-b94f-c09e899928c9 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:29.752421 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47e4cf-10ba-41b4-b94f-c09e899928c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:29.752693 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47e4cf-10ba-41b4-b94f-c09e899928c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:29.753475 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47e4cf-10ba-41b4-b94f-c09e899928c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:29.753777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47e4cf-10ba-41b4-b94f-c09e899928c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:29.755218 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47e4cf-10ba-41b4-b94f-c09e899928c9 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:29.767100 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 426/863] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:29.767709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47e4cf-10ba-41b4-b94f-c09e899928c9 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:29.788758 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807b267-0ad6-4126-bf2a-ffa8faa61006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:29.790026 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807b267-0ad6-4126-bf2a-ffa8faa61006 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:29.790544 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807b267-0ad6-4126-bf2a-ffa8faa61006 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:29.791025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807b267-0ad6-4126-bf2a-ffa8faa61006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:29.804435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807b267-0ad6-4126-bf2a-ffa8faa61006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:29.806243 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807b267-0ad6-4126-bf2a-ffa8faa61006 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:29.825832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3807b267-0ad6-4126-bf2a-ffa8faa61006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:29.825832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:29.825832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:29.825832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:29.825832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:29.825832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:29.825832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:29.825832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:29.825832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:29.825832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:29.825832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:29.825832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:29.825832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:29.825832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:29.825832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:29.826906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:29.826906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:29.826906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:29.826906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:29.826906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:29.826906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:29.826906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:29.826906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:29.826906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:29.826906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:29.826906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:29.826906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:29.826906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:29.826906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:29.826906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:29.826906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:29.826906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:29.827976 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:29.827976 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:29.827976 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:29.827976 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:29.834752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 438/864] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:29.835612 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807b267-0ad6-4126-bf2a-ffa8faa61006 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:29.868494 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47e4cf-10ba-41b4-b94f-c09e899928c9 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:29.871398 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:29.903716 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65354b61-eb46-4d38-a05a-fa76ab29e4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:29.904381 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65354b61-eb46-4d38-a05a-fa76ab29e4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:29.904665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65354b61-eb46-4d38-a05a-fa76ab29e4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:29.904944 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65354b61-eb46-4d38-a05a-fa76ab29e4e4 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:29.905650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65354b61-eb46-4d38-a05a-fa76ab29e4e4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:29.905956 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65354b61-eb46-4d38-a05a-fa76ab29e4e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:29.907338 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65354b61-eb46-4d38-a05a-fa76ab29e4e4 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:29.911733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 427/865] 10.222.0.48 () {56 vars in 1126 bytes} [Mon Jul 25 12:02:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:29.912502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65354b61-eb46-4d38-a05a-fa76ab29e4e4 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:29.943482 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807b267-0ad6-4126-bf2a-ffa8faa61006 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:29.976832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:29.987841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6cf66-c2bf-48e6-93c4-dbe75502a50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:29.988438 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6cf66-c2bf-48e6-93c4-dbe75502a50a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:29.988803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6cf66-c2bf-48e6-93c4-dbe75502a50a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:29.989044 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6cf66-c2bf-48e6-93c4-dbe75502a50a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:29.989861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6cf66-c2bf-48e6-93c4-dbe75502a50a None admin] RBAC: Adding query filter params (role.id=0f49ec405a3c42a99beaaa0c79e67c5e, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=30c0516b85e74bdb829a3019e71e6ea6) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:29.990212 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6cf66-c2bf-48e6-93c4-dbe75502a50a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:29.991684 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6cf66-c2bf-48e6-93c4-dbe75502a50a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:29.998615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 439/866] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:02:29 2022] GET /identity/v3/role_assignments?user.id=30c0516b85e74bdb829a3019e71e6ea6&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=0f49ec405a3c42a99beaaa0c79e67c5e => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:29.999814 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbeb34-32d4-4d72-8278-76f80a5ca58f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:30.000112 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbeb34-32d4-4d72-8278-76f80a5ca58f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:30.000388 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbeb34-32d4-4d72-8278-76f80a5ca58f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:30.001813 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 440/867] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:30.011979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45812a1-9dc6-4c85-a6ca-5b0275ade045 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:30.012309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45812a1-9dc6-4c85-a6ca-5b0275ade045 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:30.012542 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45812a1-9dc6-4c85-a6ca-5b0275ade045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:30.034039 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b45812a1-9dc6-4c85-a6ca-5b0275ade045 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:30.035434 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b45812a1-9dc6-4c85-a6ca-5b0275ade045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:30.044277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65354b61-eb46-4d38-a05a-fa76ab29e4e4 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:30.099699 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c5e17-a325-4ec9-92f5-a6dc970e1004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:30.100395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c5e17-a325-4ec9-92f5-a6dc970e1004 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:30.100685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c5e17-a325-4ec9-92f5-a6dc970e1004 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:30.100964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c5e17-a325-4ec9-92f5-a6dc970e1004 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:30.102481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c5e17-a325-4ec9-92f5-a6dc970e1004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:30.102481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c5e17-a325-4ec9-92f5-a6dc970e1004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:30.104508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c5e17-a325-4ec9-92f5-a6dc970e1004 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:30.125164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 428/868] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:30.131746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 441/869] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:02:30.132793 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c5e17-a325-4ec9-92f5-a6dc970e1004 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:30.158054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45812a1-9dc6-4c85-a6ca-5b0275ade045 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:30.172183 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:30.264350 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c5e17-a325-4ec9-92f5-a6dc970e1004 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:30.280123 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45812a1-9dc6-4c85-a6ca-5b0275ade045 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:30.305184 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:30.310377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cde560-0d24-4d7f-a383-bfb43504d761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:30.311626 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cde560-0d24-4d7f-a383-bfb43504d761 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:30.312485 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cde560-0d24-4d7f-a383-bfb43504d761 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:30.312485 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cde560-0d24-4d7f-a383-bfb43504d761 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:30.319080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42909587-6e87-4f97-a212-c4caec1cdc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:30.319754 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42909587-6e87-4f97-a212-c4caec1cdc07 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:30.320041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42909587-6e87-4f97-a212-c4caec1cdc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:30.320316 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42909587-6e87-4f97-a212-c4caec1cdc07 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:30.320885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cde560-0d24-4d7f-a383-bfb43504d761 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:30.321050 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42909587-6e87-4f97-a212-c4caec1cdc07 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:30.322381 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cde560-0d24-4d7f-a383-bfb43504d761 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:30.322484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42909587-6e87-4f97-a212-c4caec1cdc07 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:30.337800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-16cde560-0d24-4d7f-a383-bfb43504d761 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:30.337800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:30.337800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:30.337800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:30.337800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:30.337800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:30.337800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:30.337800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:30.337800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:30.337800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:30.337800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:30.337800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:30.337800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:30.337800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:30.337800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:30.339543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:30.339543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:30.339543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:30.339543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:30.339543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:30.339543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:30.339543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:30.339543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:30.339543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:30.339543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:30.339543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:30.339543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:30.339543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:30.339543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:30.339543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:30.339543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:30.339543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:30.340474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:30.340474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:30.340474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:30.340474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:30.340474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:30.340474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:30.340474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:30.340474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:30.340474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 429/870] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:30.346610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cde560-0d24-4d7f-a383-bfb43504d761 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:30.347320 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 442/871] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 12:02:30 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:02:30.447267 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:30.465679 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cde560-0d24-4d7f-a383-bfb43504d761 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:30.509437 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d03d8-6362-4b9d-ad5f-2989bb0183d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:30.511149 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d03d8-6362-4b9d-ad5f-2989bb0183d1 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:30.511689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d03d8-6362-4b9d-ad5f-2989bb0183d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:30.512164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d03d8-6362-4b9d-ad5f-2989bb0183d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:30.513196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d03d8-6362-4b9d-ad5f-2989bb0183d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:30.513697 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d03d8-6362-4b9d-ad5f-2989bb0183d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:30.515462 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d03d8-6362-4b9d-ad5f-2989bb0183d1 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:30.530776 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 430/872] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:30.536359 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42909587-6e87-4f97-a212-c4caec1cdc07 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:30.644522 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42909587-6e87-4f97-a212-c4caec1cdc07 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:30.679581 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab604aa5-77e9-4f40-a188-a68d822136dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:30.680633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab604aa5-77e9-4f40-a188-a68d822136dc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:30.681114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab604aa5-77e9-4f40-a188-a68d822136dc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:30.681583 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab604aa5-77e9-4f40-a188-a68d822136dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:30.683219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab604aa5-77e9-4f40-a188-a68d822136dc None admin] RBAC: Adding query filter params (role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=e71de21b4b6d4971953f0c1ca92d9f23) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:30.683747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab604aa5-77e9-4f40-a188-a68d822136dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:30.685394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab604aa5-77e9-4f40-a188-a68d822136dc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:30.692313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 443/873] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:02:30 2022] GET /identity/v3/role_assignments?user.id=e71de21b4b6d4971953f0c1ca92d9f23&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:31.997077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818fddd-ec19-488a-8750-dd2cb18617a5 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:31.998102 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818fddd-ec19-488a-8750-dd2cb18617a5 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:31.998611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818fddd-ec19-488a-8750-dd2cb18617a5 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:32.000465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 431/874] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:32.005988 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866f7c9-c40b-4967-baf6-fd25785b495a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:32.006811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866f7c9-c40b-4967-baf6-fd25785b495a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:32.007383 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866f7c9-c40b-4967-baf6-fd25785b495a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:32.026955 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7866f7c9-c40b-4967-baf6-fd25785b495a None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:32.028472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7866f7c9-c40b-4967-baf6-fd25785b495a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:32.071499 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:32.100333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 444/875] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:02:32.121745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818fddd-ec19-488a-8750-dd2cb18617a5 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:32.183073 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2725cea-ee83-45ba-bf62-86f73622f77a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:32.183518 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2725cea-ee83-45ba-bf62-86f73622f77a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:32.183900 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2725cea-ee83-45ba-bf62-86f73622f77a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:32.185388 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 445/876] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:02:32.191768 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce6ea4-86d3-47ab-8510-06b15a507166 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:32.192186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce6ea4-86d3-47ab-8510-06b15a507166 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:32.192527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce6ea4-86d3-47ab-8510-06b15a507166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:32.211445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-71ce6ea4-86d3-47ab-8510-06b15a507166 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:32.212840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-71ce6ea4-86d3-47ab-8510-06b15a507166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:32.233377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818fddd-ec19-488a-8750-dd2cb18617a5 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:32.276580 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1410f5-c31b-4895-a986-a18807e94adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:32.277250 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1410f5-c31b-4895-a986-a18807e94adb None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:32.277751 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1410f5-c31b-4895-a986-a18807e94adb None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:32.278116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1410f5-c31b-4895-a986-a18807e94adb None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:32.279258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1410f5-c31b-4895-a986-a18807e94adb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:32.281126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1410f5-c31b-4895-a986-a18807e94adb None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:32.291121 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 446/877] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:02:32.300272 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 432/878] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 12:02:32 2022] POST /identity/v3/services => generated 269 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:02:32.313276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce6ea4-86d3-47ab-8510-06b15a507166 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:32.431202 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce6ea4-86d3-47ab-8510-06b15a507166 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:32.446406 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:32.479469 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea1239-7bb5-403d-ba7d-05b025a75e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:32.479908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea1239-7bb5-403d-ba7d-05b025a75e3f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:32.480179 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea1239-7bb5-403d-ba7d-05b025a75e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:32.480451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea1239-7bb5-403d-ba7d-05b025a75e3f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:32.491416 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea1239-7bb5-403d-ba7d-05b025a75e3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:32.500238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1eea1239-7bb5-403d-ba7d-05b025a75e3f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:02:32.500238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:32.500238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:32.500238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:32.500238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:32.500238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:32.500238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:32.500238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:32.500238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:32.500238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:32.500238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:32.500238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:32.500238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:32.500238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:32.500238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:32.500238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:32.501124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:32.501124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:32.501124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:32.501124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:32.501124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:32.501124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:32.501124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:32.501124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:32.501124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:32.501124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:32.501124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:32.501124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:32.501124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:32.501124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:32.501124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:32.501124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:32.502099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:32.502099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:32.502099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:32.502099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:32.502099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:32.502099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:32.502099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:32.502099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:32.502099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:32.502099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:32.502099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:02:32.502099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:32.502099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 447/879] 10.222.0.48 () {56 vars in 1120 bytes} [Mon Jul 25 12:02:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:32.509633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1410f5-c31b-4895-a986-a18807e94adb None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:32.513313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:32.541095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59461c6-3abc-4f8e-b0ae-85d916ab07c9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:32.541403 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59461c6-3abc-4f8e-b0ae-85d916ab07c9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:32.541625 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59461c6-3abc-4f8e-b0ae-85d916ab07c9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:32.543441 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 448/880] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:32.548397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd21a4-21fe-4f70-ae44-c754d94439ba None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:32.549891 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd21a4-21fe-4f70-ae44-c754d94439ba None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:32.551048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd21a4-21fe-4f70-ae44-c754d94439ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:32.571591 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fcfd21a4-21fe-4f70-ae44-c754d94439ba None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:32.573583 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fcfd21a4-21fe-4f70-ae44-c754d94439ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:32.637979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1410f5-c31b-4895-a986-a18807e94adb None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:32.655761 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 449/881] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:02:32.674947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61286f-390e-43a4-89ab-5cbd8a6d7fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:32.675622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61286f-390e-43a4-89ab-5cbd8a6d7fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:32.675904 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61286f-390e-43a4-89ab-5cbd8a6d7fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:32.676176 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61286f-390e-43a4-89ab-5cbd8a6d7fd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:32.676982 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61286f-390e-43a4-89ab-5cbd8a6d7fd9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:32.677359 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61286f-390e-43a4-89ab-5cbd8a6d7fd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:32.678555 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd21a4-21fe-4f70-ae44-c754d94439ba None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:32.678735 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61286f-390e-43a4-89ab-5cbd8a6d7fd9 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:32.692514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 433/882] 10.222.0.48 () {56 vars in 1115 bytes} [Mon Jul 25 12:02:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:32.694367 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61286f-390e-43a4-89ab-5cbd8a6d7fd9 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:32.766979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:32.786376 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:32.797252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd21a4-21fe-4f70-ae44-c754d94439ba None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:32.809269 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61286f-390e-43a4-89ab-5cbd8a6d7fd9 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:32.833036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc085e1-3631-4a01-b7e4-c99f5658d1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:32.833837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc085e1-3631-4a01-b7e4-c99f5658d1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:32.834149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc085e1-3631-4a01-b7e4-c99f5658d1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:32.834427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc085e1-3631-4a01-b7e4-c99f5658d1e7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:32.835078 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc085e1-3631-4a01-b7e4-c99f5658d1e7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:32.836455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc085e1-3631-4a01-b7e4-c99f5658d1e7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:32.845079 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fc91e-2c14-45d5-9d08-a57f7a401426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:32.845870 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fc91e-2c14-45d5-9d08-a57f7a401426 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:32.846181 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fc91e-2c14-45d5-9d08-a57f7a401426 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:32.846455 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fc91e-2c14-45d5-9d08-a57f7a401426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:32.848233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fcc085e1-3631-4a01-b7e4-c99f5658d1e7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 12:02:32.848233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:32.848233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:32.848233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:32.848233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:32.848233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:32.848233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:32.848233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:32.848233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 12:02:32.848233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:32.848233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:32.848233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:32.848233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:32.848233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:32.848233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:32.848233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:32.848233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:32.849330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:32.849330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:32.849330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:32.849330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:32.849330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:32.849330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:32.849330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:32.849330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:32.849330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:32.849330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:32.849330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:32.849330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:32.849330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:32.849330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:32.849330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:32.849330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:32.850594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:32.850594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:32.850594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:32.850594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:32.850594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:32.850594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:32.850594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:32.850594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:32.850594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:32.850594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:32.850594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:32.850594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:32.850594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 12:02:32.850594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:32.850594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 450/883] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:02:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:32.851410 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c728609-dc21-4680-a180-bbd4b80d62a7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:32.851410 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c728609-dc21-4680-a180-bbd4b80d62a7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:32.851410 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c728609-dc21-4680-a180-bbd4b80d62a7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:32.852583 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 451/884] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:32.855993 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c728609-dc21-4680-a180-bbd4b80d62a7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:32.864537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fc91e-2c14-45d5-9d08-a57f7a401426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:32.865980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fc91e-2c14-45d5-9d08-a57f7a401426 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:32.883863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-292fc91e-2c14-45d5-9d08-a57f7a401426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:32.883863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:32.883863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:32.883863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:32.883863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:32.883863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:32.883863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:32.883863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:32.883863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:32.883863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:32.883863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:32.883863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:32.883863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:32.883863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:32.883863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:32.884733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:32.884733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:32.884733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:32.884733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:32.884733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:32.884733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:32.884733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:32.884733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:32.884733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:32.884733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:32.884733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:32.884733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:32.884733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:32.884733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:32.884733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:32.884733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:32.884733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:32.886287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:32.886287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:32.886287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:32.886287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:32.886287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 434/885] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:32.886644 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e98cd-00d8-40eb-bb9e-b6a23a1587a7 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:32.891726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e98cd-00d8-40eb-bb9e-b6a23a1587a7 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:32.891726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e98cd-00d8-40eb-bb9e-b6a23a1587a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:32.906142 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-fd8e98cd-00d8-40eb-bb9e-b6a23a1587a7 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:32.907314 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-fd8e98cd-00d8-40eb-bb9e-b6a23a1587a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:32.976315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c728609-dc21-4680-a180-bbd4b80d62a7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:32.978059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 435/886] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:32.978059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e98cd-00d8-40eb-bb9e-b6a23a1587a7 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:33.025254 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f7c02-1c84-47cb-b43a-530b7d623eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:33.026705 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f7c02-1c84-47cb-b43a-530b7d623eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:33.026816 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f7c02-1c84-47cb-b43a-530b7d623eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:33.027178 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f7c02-1c84-47cb-b43a-530b7d623eb5 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:33.027764 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:33.028131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f7c02-1c84-47cb-b43a-530b7d623eb5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:33.028205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f7c02-1c84-47cb-b43a-530b7d623eb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:33.029546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f7c02-1c84-47cb-b43a-530b7d623eb5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:33.035253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 452/887] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:02:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:33.035875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f7c02-1c84-47cb-b43a-530b7d623eb5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:33.058861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:33.090860 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e98cd-00d8-40eb-bb9e-b6a23a1587a7 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:33.126952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2c07a-88b7-444d-b091-870bdeebabda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:33.127619 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2c07a-88b7-444d-b091-870bdeebabda None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:33.127900 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2c07a-88b7-444d-b091-870bdeebabda None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:33.128170 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2c07a-88b7-444d-b091-870bdeebabda None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:33.128888 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2c07a-88b7-444d-b091-870bdeebabda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:33.129190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2c07a-88b7-444d-b091-870bdeebabda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:33.130578 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2c07a-88b7-444d-b091-870bdeebabda None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:33.142108 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 436/888] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:33.142829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2c07a-88b7-444d-b091-870bdeebabda None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:33.152622 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f7c02-1c84-47cb-b43a-530b7d623eb5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:33.188578 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f4201-c831-4ab1-a7de-e81ac14fedb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:33.189377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f4201-c831-4ab1-a7de-e81ac14fedb5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:33.189655 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f4201-c831-4ab1-a7de-e81ac14fedb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:33.189924 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f4201-c831-4ab1-a7de-e81ac14fedb5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:33.190715 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f4201-c831-4ab1-a7de-e81ac14fedb5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:33.192204 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f4201-c831-4ab1-a7de-e81ac14fedb5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:33.204953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c69f4201-c831-4ab1-a7de-e81ac14fedb5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:02:33.204953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:33.204953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:33.204953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:33.204953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:33.204953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:33.204953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:33.204953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:33.204953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:02:33.204953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:33.204953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:33.204953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:33.204953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:33.204953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:33.204953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:33.204953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:33.204953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:33.205953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:33.205953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:33.205953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:33.205953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:33.205953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:33.205953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:33.205953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:33.205953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:33.205953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:33.205953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:33.205953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:33.205953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:33.205953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:33.205953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:33.205953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:33.205953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:33.206848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:33.206848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:33.206848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:33.206848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:33.206848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:33.206848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:33.206848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:33.206848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:33.206848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:33.206848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:33.206848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:33.206848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:33.206848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:02:33.206848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:33.206848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 453/889] 10.222.0.48 () {56 vars in 1126 bytes} [Mon Jul 25 12:02:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:33.207626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f4201-c831-4ab1-a7de-e81ac14fedb5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:33.250534 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2c07a-88b7-444d-b091-870bdeebabda None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:33.257812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:33.287936 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf403d7-feee-4bb6-9ec8-22de2b8cbb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:33.288667 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf403d7-feee-4bb6-9ec8-22de2b8cbb8e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:33.289028 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf403d7-feee-4bb6-9ec8-22de2b8cbb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:33.289372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf403d7-feee-4bb6-9ec8-22de2b8cbb8e None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:33.290183 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf403d7-feee-4bb6-9ec8-22de2b8cbb8e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:33.290561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf403d7-feee-4bb6-9ec8-22de2b8cbb8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:33.292541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf403d7-feee-4bb6-9ec8-22de2b8cbb8e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:33.293426 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:33.302801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 437/890] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:02:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:33.302801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf403d7-feee-4bb6-9ec8-22de2b8cbb8e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:33.315567 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f4201-c831-4ab1-a7de-e81ac14fedb5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:33.349127 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd42c0-4eb7-42b7-8391-2d6abcc65252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:33.350109 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd42c0-4eb7-42b7-8391-2d6abcc65252 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:33.350487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd42c0-4eb7-42b7-8391-2d6abcc65252 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:33.350860 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd42c0-4eb7-42b7-8391-2d6abcc65252 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:33.358398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd42c0-4eb7-42b7-8391-2d6abcc65252 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:33.359942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd42c0-4eb7-42b7-8391-2d6abcc65252 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:33.374540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a0fd42c0-4eb7-42b7-8391-2d6abcc65252 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:02:33.374540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:33.374540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:33.374540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:33.374540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:33.374540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:33.374540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:33.374540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:33.374540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:33.374540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:33.374540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:33.374540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:33.374540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:33.374540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:33.374540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:33.374540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:33.375481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:33.375481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:33.375481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:33.375481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:33.375481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:33.375481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:33.375481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:33.375481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:33.375481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:33.375481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:33.375481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:33.375481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:33.375481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:33.375481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:33.375481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:33.375481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:33.375481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:33.375481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:33.376395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:33.376395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:33.376395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:33.376395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:33.376395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:33.376395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:33.376395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:33.376395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:33.376395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:02:33.376395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:33.376395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 454/891] 10.222.0.48 () {56 vars in 1117 bytes} [Mon Jul 25 12:02:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:33.376967 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd42c0-4eb7-42b7-8391-2d6abcc65252 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:33.403828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf403d7-feee-4bb6-9ec8-22de2b8cbb8e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:33.439414 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49470020-a173-47d9-9a35-dbbfde9a9cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:33.440238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49470020-a173-47d9-9a35-dbbfde9a9cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:33.440622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49470020-a173-47d9-9a35-dbbfde9a9cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:33.440996 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49470020-a173-47d9-9a35-dbbfde9a9cd2 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:33.441809 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49470020-a173-47d9-9a35-dbbfde9a9cd2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:33.442251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49470020-a173-47d9-9a35-dbbfde9a9cd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:33.443711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49470020-a173-47d9-9a35-dbbfde9a9cd2 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:33.453573 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 438/892] 10.222.0.48 () {56 vars in 1122 bytes} [Mon Jul 25 12:02:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:33.453573 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49470020-a173-47d9-9a35-dbbfde9a9cd2 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:33.489801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:33.499371 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd42c0-4eb7-42b7-8391-2d6abcc65252 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:33.537354 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02af48e-7199-4f0b-88fc-0480000fffa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:33.538049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02af48e-7199-4f0b-88fc-0480000fffa6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:33.538342 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02af48e-7199-4f0b-88fc-0480000fffa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:33.538975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02af48e-7199-4f0b-88fc-0480000fffa6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:33.539783 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02af48e-7199-4f0b-88fc-0480000fffa6 None admin] RBAC: Adding query filter params (interface=public, service_id=7196a0d82e284df8ae179a4364ef09a5, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:33.540418 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02af48e-7199-4f0b-88fc-0480000fffa6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:33.541845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02af48e-7199-4f0b-88fc-0480000fffa6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:33.547407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 455/893] 10.222.0.48 () {56 vars in 1251 bytes} [Mon Jul 25 12:02:33 2022] GET /identity/v3/endpoints?service_id=7196a0d82e284df8ae179a4364ef09a5&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:33.547407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02af48e-7199-4f0b-88fc-0480000fffa6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:33.562283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49470020-a173-47d9-9a35-dbbfde9a9cd2 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:33.563981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:33.601907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ee2e1-8596-4769-b742-3046be45a72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:33.602694 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ee2e1-8596-4769-b742-3046be45a72f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:33.603098 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ee2e1-8596-4769-b742-3046be45a72f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:33.603379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ee2e1-8596-4769-b742-3046be45a72f None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:33.604244 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ee2e1-8596-4769-b742-3046be45a72f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:33.604617 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ee2e1-8596-4769-b742-3046be45a72f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:33.606219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ee2e1-8596-4769-b742-3046be45a72f None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:33.629138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 439/894] 10.222.0.48 () {56 vars in 1149 bytes} [Mon Jul 25 12:02:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:33.629138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ee2e1-8596-4769-b742-3046be45a72f None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:33.664660 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02af48e-7199-4f0b-88fc-0480000fffa6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:33.698621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc89cd8-7816-4f11-93c1-dac435ff2c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:33.699281 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc89cd8-7816-4f11-93c1-dac435ff2c8f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:33.699561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc89cd8-7816-4f11-93c1-dac435ff2c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:33.699832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc89cd8-7816-4f11-93c1-dac435ff2c8f None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:33.700528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc89cd8-7816-4f11-93c1-dac435ff2c8f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:33.700827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc89cd8-7816-4f11-93c1-dac435ff2c8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:33.702207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc89cd8-7816-4f11-93c1-dac435ff2c8f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:33.706785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 456/895] 10.222.0.48 () {56 vars in 1122 bytes} [Mon Jul 25 12:02:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:33.707556 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc89cd8-7816-4f11-93c1-dac435ff2c8f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:33.730794 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:33.747878 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ee2e1-8596-4769-b742-3046be45a72f None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:33.790407 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117743c-73fb-4c4c-8be1-7158d9e2fcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:33.791906 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117743c-73fb-4c4c-8be1-7158d9e2fcb0 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:33.792411 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117743c-73fb-4c4c-8be1-7158d9e2fcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:33.792869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117743c-73fb-4c4c-8be1-7158d9e2fcb0 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:33.794020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117743c-73fb-4c4c-8be1-7158d9e2fcb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:33.796581 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117743c-73fb-4c4c-8be1-7158d9e2fcb0 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:33.806202 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 440/896] 10.222.0.48 () {56 vars in 1087 bytes} [Mon Jul 25 12:02:33 2022] GET /identity/v3/services => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:02:33.824770 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:33.863794 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc89cd8-7816-4f11-93c1-dac435ff2c8f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:33.902577 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd073c-329d-445c-afea-2caf285f14c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:33.903666 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd073c-329d-445c-afea-2caf285f14c0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:33.904146 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd073c-329d-445c-afea-2caf285f14c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:33.904698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd073c-329d-445c-afea-2caf285f14c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:33.979513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd073c-329d-445c-afea-2caf285f14c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:33.980972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd073c-329d-445c-afea-2caf285f14c0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:34.050543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:34.086132 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 457/897] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:02:33 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:02:34.091425 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117743c-73fb-4c4c-8be1-7158d9e2fcb0 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:34.199786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117743c-73fb-4c4c-8be1-7158d9e2fcb0 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:34.236490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d487e-993d-4d19-be33-faa04f206a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:34.237679 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d487e-993d-4d19-be33-faa04f206a18 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:34.238187 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d487e-993d-4d19-be33-faa04f206a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:34.238682 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d487e-993d-4d19-be33-faa04f206a18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:34.250989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d487e-993d-4d19-be33-faa04f206a18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:34.252709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d487e-993d-4d19-be33-faa04f206a18 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:34.270451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-7f9d487e-993d-4d19-be33-faa04f206a18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:34.270451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:34.270451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:34.270451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:34.270451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:34.270451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:34.270451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:34.270451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:34.270451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:34.270451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:34.270451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:34.270451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:34.270451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:34.270451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:34.270451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:34.271352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:34.271352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:34.271352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:34.271352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:34.271352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:34.271352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:34.271352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:34.271352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:34.271352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:34.271352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:34.271352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:34.271352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:34.271352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:34.271352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:34.271352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:34.271352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:34.271352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:34.272319 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:34.272319 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:34.272319 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:34.272319 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:34.274597 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 441/898] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:34.286052 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd073c-329d-445c-afea-2caf285f14c0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:34.388029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd073c-329d-445c-afea-2caf285f14c0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:34.425491 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd9976-7ad5-4ece-ae9d-f827a75c2923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:34.426203 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd9976-7ad5-4ece-ae9d-f827a75c2923 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:34.426487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd9976-7ad5-4ece-ae9d-f827a75c2923 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:34.426762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd9976-7ad5-4ece-ae9d-f827a75c2923 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:34.427492 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd9976-7ad5-4ece-ae9d-f827a75c2923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:34.427796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd9976-7ad5-4ece-ae9d-f827a75c2923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:34.429169 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd9976-7ad5-4ece-ae9d-f827a75c2923 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:34.441467 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 458/899] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:34.447055 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98fd06-29bb-4143-8860-631baa4d0c79 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:34.447176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd9976-7ad5-4ece-ae9d-f827a75c2923 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:34.447356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98fd06-29bb-4143-8860-631baa4d0c79 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:34.447757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98fd06-29bb-4143-8860-631baa4d0c79 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:34.449346 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 442/900] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:02:34.458405 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a44dfe-0983-44aa-818e-e8d8334ba10f None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:34.458628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a44dfe-0983-44aa-818e-e8d8334ba10f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:34.458896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a44dfe-0983-44aa-818e-e8d8334ba10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:34.479420 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-80a44dfe-0983-44aa-818e-e8d8334ba10f None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:34.480722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-80a44dfe-0983-44aa-818e-e8d8334ba10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:34.482947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:34.487436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:34.572850 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 443/901] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:34.573570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd9976-7ad5-4ece-ae9d-f827a75c2923 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:34.595543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a44dfe-0983-44aa-818e-e8d8334ba10f None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:34.617095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532f285-7d04-4776-bfa0-6f4ef4f2f39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:34.617901 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532f285-7d04-4776-bfa0-6f4ef4f2f39a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:34.618735 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532f285-7d04-4776-bfa0-6f4ef4f2f39a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:34.619020 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532f285-7d04-4776-bfa0-6f4ef4f2f39a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:34.628744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532f285-7d04-4776-bfa0-6f4ef4f2f39a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:34.630524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532f285-7d04-4776-bfa0-6f4ef4f2f39a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:34.649353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c532f285-7d04-4776-bfa0-6f4ef4f2f39a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:34.649353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:34.649353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:34.649353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:34.649353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:34.649353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:34.649353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:34.649353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:34.649353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:34.649353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:34.649353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:34.649353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:34.649353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:34.649353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:34.649353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:34.650248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:34.650248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:34.650248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:34.650248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:34.650248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:34.650248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:34.650248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:34.650248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:34.650248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:34.650248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:34.650248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:34.650248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:34.650248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:34.650248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:34.650248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:34.650248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:34.650248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:34.651664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:34.651664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:34.651664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:34.651664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:34.651664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:34.651664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:34.651664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:34.651664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:34.654084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 459/902] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:34.656649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532f285-7d04-4776-bfa0-6f4ef4f2f39a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:34.707266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a44dfe-0983-44aa-818e-e8d8334ba10f None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:34.743899 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946965b9-3b93-47e4-ae15-a32efa9dcd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:34.744741 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946965b9-3b93-47e4-ae15-a32efa9dcd19 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:34.745095 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946965b9-3b93-47e4-ae15-a32efa9dcd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:34.745376 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946965b9-3b93-47e4-ae15-a32efa9dcd19 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:34.746052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946965b9-3b93-47e4-ae15-a32efa9dcd19 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:34.747415 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946965b9-3b93-47e4-ae15-a32efa9dcd19 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:34.759901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-946965b9-3b93-47e4-ae15-a32efa9dcd19 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 12:02:34.759901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:34.759901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:34.759901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:34.759901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:34.759901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:34.759901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:34.759901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:34.759901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 12:02:34.759901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:34.759901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:34.759901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:34.759901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:34.759901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:34.759901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:34.759901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:34.760866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:34.760866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:34.760866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:34.760866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:34.760866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:34.760866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:34.760866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:34.760866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:34.760866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:34.760866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:34.760866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:34.760866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:34.760866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:34.760866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:34.760866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:34.760866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:34.761687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:34.761687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:34.761687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:34.761687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:34.761687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:34.761687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:34.761687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:34.761687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:34.761687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:34.761687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:34.761687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:34.761687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:34.761687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:34.761687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 12:02:34.761687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:34.766085 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 444/903] 10.222.0.48 () {56 vars in 1132 bytes} [Mon Jul 25 12:02:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:34.767336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946965b9-3b93-47e4-ae15-a32efa9dcd19 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:34.770307 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:34.784545 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:34.795947 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532f285-7d04-4776-bfa0-6f4ef4f2f39a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:34.831313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975b7e8-af7d-4b2a-bfc3-694c7570ef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:34.831983 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975b7e8-af7d-4b2a-bfc3-694c7570ef4b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:34.832267 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975b7e8-af7d-4b2a-bfc3-694c7570ef4b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:34.832542 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975b7e8-af7d-4b2a-bfc3-694c7570ef4b None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:34.833325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975b7e8-af7d-4b2a-bfc3-694c7570ef4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:34.833632 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975b7e8-af7d-4b2a-bfc3-694c7570ef4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:34.835143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975b7e8-af7d-4b2a-bfc3-694c7570ef4b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:34.852302 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 460/904] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:34.854427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975b7e8-af7d-4b2a-bfc3-694c7570ef4b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:34.902119 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946965b9-3b93-47e4-ae15-a32efa9dcd19 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:34.940661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3be72-ccdf-4c9f-aa36-d2eae2a41664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:34.941358 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3be72-ccdf-4c9f-aa36-d2eae2a41664 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:34.941644 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3be72-ccdf-4c9f-aa36-d2eae2a41664 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:34.941920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3be72-ccdf-4c9f-aa36-d2eae2a41664 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:34.942834 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3be72-ccdf-4c9f-aa36-d2eae2a41664 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:34.943144 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3be72-ccdf-4c9f-aa36-d2eae2a41664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:34.945118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3be72-ccdf-4c9f-aa36-d2eae2a41664 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:34.952366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 445/905] 10.222.0.48 () {56 vars in 1126 bytes} [Mon Jul 25 12:02:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:34.957980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3be72-ccdf-4c9f-aa36-d2eae2a41664 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:35.002198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975b7e8-af7d-4b2a-bfc3-694c7570ef4b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:35.043846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccaf0f-e0a2-4090-b942-d9315fd2fdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:35.044779 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccaf0f-e0a2-4090-b942-d9315fd2fdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:35.045231 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccaf0f-e0a2-4090-b942-d9315fd2fdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:35.045656 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccaf0f-e0a2-4090-b942-d9315fd2fdf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:35.046741 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccaf0f-e0a2-4090-b942-d9315fd2fdf7 None admin] RBAC: Adding query filter params (role.id=85d086a755ed46078be507e4a3b3c9a8, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=30c0516b85e74bdb829a3019e71e6ea6) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:35.047264 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccaf0f-e0a2-4090-b942-d9315fd2fdf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:35.048898 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccaf0f-e0a2-4090-b942-d9315fd2fdf7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:35.053723 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:35.062305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 461/906] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:02:34 2022] GET /identity/v3/role_assignments?user.id=30c0516b85e74bdb829a3019e71e6ea6&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=85d086a755ed46078be507e4a3b3c9a8 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:35.095417 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3be72-ccdf-4c9f-aa36-d2eae2a41664 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:35.133877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9374a4-d148-4bbd-a0cd-f3a33344c512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:35.134586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9374a4-d148-4bbd-a0cd-f3a33344c512 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:35.134869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9374a4-d148-4bbd-a0cd-f3a33344c512 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:35.135694 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9374a4-d148-4bbd-a0cd-f3a33344c512 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:35.136419 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9374a4-d148-4bbd-a0cd-f3a33344c512 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:35.136726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9374a4-d148-4bbd-a0cd-f3a33344c512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:35.138138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9374a4-d148-4bbd-a0cd-f3a33344c512 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:35.144328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 446/907] 10.222.0.48 () {56 vars in 1126 bytes} [Mon Jul 25 12:02:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:35.150152 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccaf0f-e0a2-4090-b942-d9315fd2fdf7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:35.186373 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:35.267384 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccaf0f-e0a2-4090-b942-d9315fd2fdf7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:35.301369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e115b8-5f04-45d1-8dea-34c14e5934fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:35.302124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e115b8-5f04-45d1-8dea-34c14e5934fe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:35.302406 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e115b8-5f04-45d1-8dea-34c14e5934fe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:35.302682 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e115b8-5f04-45d1-8dea-34c14e5934fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:35.303472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e115b8-5f04-45d1-8dea-34c14e5934fe None admin] RBAC: Adding query filter params (interface=public, service_id=6f5898c0f2814205b5ad074f7460d5b6, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:35.303783 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e115b8-5f04-45d1-8dea-34c14e5934fe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:35.305164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e115b8-5f04-45d1-8dea-34c14e5934fe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:35.311474 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 462/908] 10.222.0.48 () {56 vars in 1251 bytes} [Mon Jul 25 12:02:35 2022] GET /identity/v3/endpoints?service_id=6f5898c0f2814205b5ad074f7460d5b6&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:35.316915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9374a4-d148-4bbd-a0cd-f3a33344c512 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:35.424953 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9374a4-d148-4bbd-a0cd-f3a33344c512 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:35.455585 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:35.462160 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78909471-375c-4799-b5dc-6eb8e0689afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:35.462825 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78909471-375c-4799-b5dc-6eb8e0689afe None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:35.463108 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78909471-375c-4799-b5dc-6eb8e0689afe None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:35.463419 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78909471-375c-4799-b5dc-6eb8e0689afe None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:35.464925 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78909471-375c-4799-b5dc-6eb8e0689afe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:35.466331 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78909471-375c-4799-b5dc-6eb8e0689afe None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:35.472767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 447/909] 10.222.0.48 () {56 vars in 1087 bytes} [Mon Jul 25 12:02:35 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:02:35.813193 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4177c-b72f-4920-ad58-9421358d7008 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:35.813573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4177c-b72f-4920-ad58-9421358d7008 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:35.813771 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4177c-b72f-4920-ad58-9421358d7008 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:35.815395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 463/910] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:35.820593 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4aa6b-e513-4ed2-908e-46f0512be6d9 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:35.820882 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4aa6b-e513-4ed2-908e-46f0512be6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:35.821158 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4aa6b-e513-4ed2-908e-46f0512be6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:35.840232 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-d8c4aa6b-e513-4ed2-908e-46f0512be6d9 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:35.841403 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d8c4aa6b-e513-4ed2-908e-46f0512be6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:35.911104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 448/911] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:35.934094 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4177c-b72f-4920-ad58-9421358d7008 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:35.948665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181213-4b3d-4ecb-bdd4-3ba8f862b00f None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:35.948947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181213-4b3d-4ecb-bdd4-3ba8f862b00f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:35.949205 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181213-4b3d-4ecb-bdd4-3ba8f862b00f None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:35.950837 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 449/912] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:02:35.956900 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be1b83-6612-4711-a010-49137b4f05e6 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:35.957187 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be1b83-6612-4711-a010-49137b4f05e6 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:35.957468 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be1b83-6612-4711-a010-49137b4f05e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:35.980216 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-34be1b83-6612-4711-a010-49137b4f05e6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:35.981770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-34be1b83-6612-4711-a010-49137b4f05e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:36.055659 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4177c-b72f-4920-ad58-9421358d7008 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:36.058397 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 450/913] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:02:36.070274 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:36.078815 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be1b83-6612-4711-a010-49137b4f05e6 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:36.103046 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15feaf4c-c97f-469e-b63f-04cb395a6d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:36.103764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feaf4c-c97f-469e-b63f-04cb395a6d7a None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:36.104856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feaf4c-c97f-469e-b63f-04cb395a6d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:36.105320 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feaf4c-c97f-469e-b63f-04cb395a6d7a None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:36.106455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15feaf4c-c97f-469e-b63f-04cb395a6d7a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:36.107929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15feaf4c-c97f-469e-b63f-04cb395a6d7a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:36.126601 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 464/914] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 12:02:35 2022] POST /identity/v3/services => generated 241 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:02:36.154646 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:36.216764 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be1b83-6612-4711-a010-49137b4f05e6 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:36.271842 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e58a57-76ff-4729-b07b-5e3e7b18b84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:36.272687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e58a57-76ff-4729-b07b-5e3e7b18b84c None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:36.272966 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e58a57-76ff-4729-b07b-5e3e7b18b84c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:36.273238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e58a57-76ff-4729-b07b-5e3e7b18b84c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:36.273896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e58a57-76ff-4729-b07b-5e3e7b18b84c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:36.275333 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e58a57-76ff-4729-b07b-5e3e7b18b84c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:36.288823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-a1e58a57-76ff-4729-b07b-5e3e7b18b84c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 12:02:36.288823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:36.288823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:36.288823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:36.288823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:36.288823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:36.288823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:36.288823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:36.288823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 12:02:36.288823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:36.288823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:36.288823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:36.288823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:36.288823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:36.288823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:36.288823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:36.288823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:36.289864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:36.289864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:36.289864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:36.289864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:36.289864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:36.289864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:36.289864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:36.289864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:36.289864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:36.289864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:36.289864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:36.289864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:36.289864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:36.289864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:36.289864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:36.289864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:36.290709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:36.290709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:36.290709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:36.290709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:36.290709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:36.290709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:36.290709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:36.290709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:36.290709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:36.290709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:36.290709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:36.290709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:36.290709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 12:02:36.290709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:36.290709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 451/915] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:02:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:36.299161 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15feaf4c-c97f-469e-b63f-04cb395a6d7a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:36.410205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15feaf4c-c97f-469e-b63f-04cb395a6d7a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:36.448260 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2198760-b8df-497f-8e39-98ae9ac7572f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:36.448941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2198760-b8df-497f-8e39-98ae9ac7572f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:36.449216 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2198760-b8df-497f-8e39-98ae9ac7572f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:36.449484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2198760-b8df-497f-8e39-98ae9ac7572f None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:36.453029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2198760-b8df-497f-8e39-98ae9ac7572f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:36.453029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2198760-b8df-497f-8e39-98ae9ac7572f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:36.453029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2198760-b8df-497f-8e39-98ae9ac7572f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:36.457554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 465/916] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:02:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:36.463931 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e58a57-76ff-4729-b07b-5e3e7b18b84c None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:36.577979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e58a57-76ff-4729-b07b-5e3e7b18b84c None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:36.592862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:36.615616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597f06a-19d4-41be-9d8b-b3d5e338af2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:36.616283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597f06a-19d4-41be-9d8b-b3d5e338af2d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:36.616563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597f06a-19d4-41be-9d8b-b3d5e338af2d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:36.616838 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597f06a-19d4-41be-9d8b-b3d5e338af2d None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:36.617551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597f06a-19d4-41be-9d8b-b3d5e338af2d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:36.617854 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597f06a-19d4-41be-9d8b-b3d5e338af2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:36.619259 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597f06a-19d4-41be-9d8b-b3d5e338af2d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:36.625323 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 452/917] 10.222.0.48 () {56 vars in 1114 bytes} [Mon Jul 25 12:02:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:36.630935 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2198760-b8df-497f-8e39-98ae9ac7572f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:36.645199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:36.740155 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2198760-b8df-497f-8e39-98ae9ac7572f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:36.774436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78c0dd-a706-496b-99d8-768da19a07ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:36.775094 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78c0dd-a706-496b-99d8-768da19a07ca None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:36.775372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78c0dd-a706-496b-99d8-768da19a07ca None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:36.775642 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78c0dd-a706-496b-99d8-768da19a07ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:36.776918 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78c0dd-a706-496b-99d8-768da19a07ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:36.778301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78c0dd-a706-496b-99d8-768da19a07ca None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:36.799820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 466/918] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:02:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:02:37.098493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faeab8-d646-4c8c-8ea5-06c1b1bc54f7 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:37.098843 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faeab8-d646-4c8c-8ea5-06c1b1bc54f7 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:37.098965 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faeab8-d646-4c8c-8ea5-06c1b1bc54f7 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:37.100606 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 453/919] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:37.105717 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa2c31-6515-4e8e-9e4c-d522dd846600 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:37.106192 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa2c31-6515-4e8e-9e4c-d522dd846600 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:37.106281 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa2c31-6515-4e8e-9e4c-d522dd846600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:37.128114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-26aa2c31-6515-4e8e-9e4c-d522dd846600 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:37.129302 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-26aa2c31-6515-4e8e-9e4c-d522dd846600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:37.189320 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:37.207837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 467/920] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:37.229603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52faeab8-d646-4c8c-8ea5-06c1b1bc54f7 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:37.340470 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52faeab8-d646-4c8c-8ea5-06c1b1bc54f7 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:37.375595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f620750-f7ff-4140-818d-8aa45ce9f586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:37.376329 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f620750-f7ff-4140-818d-8aa45ce9f586 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:37.376608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f620750-f7ff-4140-818d-8aa45ce9f586 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:37.376878 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f620750-f7ff-4140-818d-8aa45ce9f586 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:37.388202 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f620750-f7ff-4140-818d-8aa45ce9f586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:37.396325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-4f620750-f7ff-4140-818d-8aa45ce9f586 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:02:37.396325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:37.396325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:37.396325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:37.396325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:37.396325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:37.396325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:37.396325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:37.396325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:37.396325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:37.396325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:37.396325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:37.396325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:37.396325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:37.396325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:37.396325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:37.397228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:37.397228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:37.397228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:37.397228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:37.397228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:37.397228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:37.397228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:37.397228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:37.397228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:37.397228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:37.397228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:37.397228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:37.397228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:37.397228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:37.397228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:37.397228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:37.398064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:37.398064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:37.398064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:37.398064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:37.398064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:37.398064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:37.398064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:37.398064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:37.398064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:37.398064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:37.398064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:02:37.398064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:37.398064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 454/921] 10.222.0.48 () {56 vars in 1120 bytes} [Mon Jul 25 12:02:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:37.404448 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa2c31-6515-4e8e-9e4c-d522dd846600 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:37.507766 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa2c31-6515-4e8e-9e4c-d522dd846600 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:37.521828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b1874-5d90-4ff5-a8b3-758a2795f139 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:37.522394 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b1874-5d90-4ff5-a8b3-758a2795f139 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:37.522889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b1874-5d90-4ff5-a8b3-758a2795f139 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:37.524647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 455/922] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:37.529887 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00ad8f-fa16-4fb3-b665-0a817fd887bd None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:37.530428 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00ad8f-fa16-4fb3-b665-0a817fd887bd None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:37.530878 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00ad8f-fa16-4fb3-b665-0a817fd887bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:37.543711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8ee54-c26f-4f13-974d-91784a7ff127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:37.544379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8ee54-c26f-4f13-974d-91784a7ff127 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:37.544659 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8ee54-c26f-4f13-974d-91784a7ff127 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:37.544928 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8ee54-c26f-4f13-974d-91784a7ff127 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:37.545670 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8ee54-c26f-4f13-974d-91784a7ff127 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:37.546313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8ee54-c26f-4f13-974d-91784a7ff127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:37.547357 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8ee54-c26f-4f13-974d-91784a7ff127 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:37.551655 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-6c00ad8f-fa16-4fb3-b665-0a817fd887bd None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:37.553047 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6c00ad8f-fa16-4fb3-b665-0a817fd887bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:37.560471 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 468/923] 10.222.0.48 () {56 vars in 1115 bytes} [Mon Jul 25 12:02:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:37.561685 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8ee54-c26f-4f13-974d-91784a7ff127 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:37.595480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:37.629434 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:37.658021 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 456/924] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:02:37.672575 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00ad8f-fa16-4fb3-b665-0a817fd887bd None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:37.691329 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8ee54-c26f-4f13-974d-91784a7ff127 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:37.726530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a03c1-2ffc-4aab-ac16-6f4096063509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:37.727527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a03c1-2ffc-4aab-ac16-6f4096063509 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:37.727638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a03c1-2ffc-4aab-ac16-6f4096063509 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:37.727853 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a03c1-2ffc-4aab-ac16-6f4096063509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:37.739211 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a03c1-2ffc-4aab-ac16-6f4096063509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:37.740662 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a03c1-2ffc-4aab-ac16-6f4096063509 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:37.758855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4d4a03c1-2ffc-4aab-ac16-6f4096063509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:37.758855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:37.758855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:37.758855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:37.758855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:37.758855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:37.758855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:37.758855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:37.758855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:37.758855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:37.758855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:37.758855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:37.758855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:37.758855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:37.758855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:37.759730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:37.759730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:37.759730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:37.759730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:37.759730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:37.759730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:37.759730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:37.759730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:37.759730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:37.759730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:37.759730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:37.759730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:37.759730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:37.759730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:37.759730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:37.759730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:37.759730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:37.761205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:37.761205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:37.761205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:37.761205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:37.765342 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 469/925] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:37.766634 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a03c1-2ffc-4aab-ac16-6f4096063509 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:37.780251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00ad8f-fa16-4fb3-b665-0a817fd887bd None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:37.816389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c00991-b145-44dc-8abd-0f78d29e2644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:37.817547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c00991-b145-44dc-8abd-0f78d29e2644 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:37.818067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c00991-b145-44dc-8abd-0f78d29e2644 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:37.818560 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c00991-b145-44dc-8abd-0f78d29e2644 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:37.819401 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c00991-b145-44dc-8abd-0f78d29e2644 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:37.820951 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c00991-b145-44dc-8abd-0f78d29e2644 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:37.834254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-97c00991-b145-44dc-8abd-0f78d29e2644 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 12:02:37.834254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:37.834254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:37.834254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:37.834254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:37.834254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:37.834254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:37.834254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:37.834254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 12:02:37.834254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:37.834254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:37.834254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:37.834254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:37.834254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:37.834254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:37.834254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:37.835186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:37.835186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:37.835186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:37.835186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:37.835186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:37.835186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:37.835186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:37.835186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:37.835186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:37.835186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:37.835186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:37.835186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:37.835186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:37.835186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:37.835186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:37.835186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:37.835995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:37.835995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:37.835995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:37.835995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:37.835995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:37.835995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:37.835995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:37.835995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:37.835995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:37.835995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:37.835995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:37.835995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:37.835995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:37.835995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 12:02:37.835995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:37.843772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 457/926] 10.222.0.48 () {56 vars in 1132 bytes} [Mon Jul 25 12:02:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:37.844882 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c00991-b145-44dc-8abd-0f78d29e2644 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:37.870191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:37.873718 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a03c1-2ffc-4aab-ac16-6f4096063509 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:37.878653 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:37.912053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6645198-39f7-4d8d-9e99-21679497faba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:37.912741 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6645198-39f7-4d8d-9e99-21679497faba None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:37.913079 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6645198-39f7-4d8d-9e99-21679497faba None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:37.913421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6645198-39f7-4d8d-9e99-21679497faba None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:37.914265 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6645198-39f7-4d8d-9e99-21679497faba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:37.914638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6645198-39f7-4d8d-9e99-21679497faba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:37.916078 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6645198-39f7-4d8d-9e99-21679497faba None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:37.934235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 470/927] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:37.935563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6645198-39f7-4d8d-9e99-21679497faba None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:37.954834 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c00991-b145-44dc-8abd-0f78d29e2644 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:37.991364 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaad2c4-1342-4b5c-a773-f27d1341a436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:37.992332 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaad2c4-1342-4b5c-a773-f27d1341a436 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:37.992790 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaad2c4-1342-4b5c-a773-f27d1341a436 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:37.993269 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaad2c4-1342-4b5c-a773-f27d1341a436 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:37.994232 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaad2c4-1342-4b5c-a773-f27d1341a436 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:37.995368 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaad2c4-1342-4b5c-a773-f27d1341a436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:37.996924 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaad2c4-1342-4b5c-a773-f27d1341a436 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:38.006893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 458/928] 10.222.0.48 () {56 vars in 1126 bytes} [Mon Jul 25 12:02:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:38.007993 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaad2c4-1342-4b5c-a773-f27d1341a436 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:38.048756 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6645198-39f7-4d8d-9e99-21679497faba None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:38.083933 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ba22c-6e66-4d25-8c28-8562acbfdd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:38.084744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ba22c-6e66-4d25-8c28-8562acbfdd43 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:38.085022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ba22c-6e66-4d25-8c28-8562acbfdd43 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:38.085292 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ba22c-6e66-4d25-8c28-8562acbfdd43 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:38.093365 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ba22c-6e66-4d25-8c28-8562acbfdd43 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:38.094841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ba22c-6e66-4d25-8c28-8562acbfdd43 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:38.108578 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:38.112711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9c1ba22c-6e66-4d25-8c28-8562acbfdd43 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:02:38.112711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:38.112711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:38.112711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:38.112711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:38.112711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:38.112711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:38.112711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:38.112711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:38.112711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:38.112711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:38.112711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:38.112711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:38.112711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:38.112711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:38.112711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:38.113954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:38.113954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:38.113954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:38.113954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:38.113954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:38.113954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:38.113954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:38.113954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:38.113954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:38.113954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:38.113954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:38.113954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:38.113954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:38.113954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:38.113954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:38.113954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:38.113954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:38.113954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:38.114898 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:38.114898 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:38.114898 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:38.114898 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:38.114898 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:38.114898 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:38.114898 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:38.114898 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:38.114898 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:02:38.114898 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:38.118162 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaad2c4-1342-4b5c-a773-f27d1341a436 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:38.118497 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 471/929] 10.222.0.48 () {56 vars in 1117 bytes} [Mon Jul 25 12:02:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:38.121702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ba22c-6e66-4d25-8c28-8562acbfdd43 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:38.146122 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:38.154171 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89845f96-b81f-4b7f-9ba0-e006ad22b4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:38.154970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89845f96-b81f-4b7f-9ba0-e006ad22b4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:38.155361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89845f96-b81f-4b7f-9ba0-e006ad22b4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:38.155724 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89845f96-b81f-4b7f-9ba0-e006ad22b4d2 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:38.156643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89845f96-b81f-4b7f-9ba0-e006ad22b4d2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:38.157146 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89845f96-b81f-4b7f-9ba0-e006ad22b4d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:38.158741 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89845f96-b81f-4b7f-9ba0-e006ad22b4d2 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:38.169674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 459/930] 10.222.0.48 () {56 vars in 1126 bytes} [Mon Jul 25 12:02:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:38.170813 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89845f96-b81f-4b7f-9ba0-e006ad22b4d2 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:38.245341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ba22c-6e66-4d25-8c28-8562acbfdd43 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:38.280271 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89845f96-b81f-4b7f-9ba0-e006ad22b4d2 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:38.288313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95488fcd-d053-4462-80f1-7e71a9c86086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:38.289202 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95488fcd-d053-4462-80f1-7e71a9c86086 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:38.289985 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95488fcd-d053-4462-80f1-7e71a9c86086 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:38.290453 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95488fcd-d053-4462-80f1-7e71a9c86086 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:38.292684 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95488fcd-d053-4462-80f1-7e71a9c86086 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:38.293477 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95488fcd-d053-4462-80f1-7e71a9c86086 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:38.295660 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95488fcd-d053-4462-80f1-7e71a9c86086 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:38.313919 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 472/931] 10.222.0.48 () {56 vars in 1149 bytes} [Mon Jul 25 12:02:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:38.315326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62362a8-9ef3-48a2-8c57-c9de8a1ece01 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:38.315681 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62362a8-9ef3-48a2-8c57-c9de8a1ece01 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:38.316024 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62362a8-9ef3-48a2-8c57-c9de8a1ece01 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:38.317495 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 473/932] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:38.321917 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62362a8-9ef3-48a2-8c57-c9de8a1ece01 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:38.322757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8ef58-8c88-4c4a-bafd-0004c3894be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:38.323417 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8ef58-8c88-4c4a-bafd-0004c3894be2 None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:38.323699 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8ef58-8c88-4c4a-bafd-0004c3894be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:38.323974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8ef58-8c88-4c4a-bafd-0004c3894be2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:38.324912 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8ef58-8c88-4c4a-bafd-0004c3894be2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:38.327131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8ef58-8c88-4c4a-bafd-0004c3894be2 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:38.350140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 460/933] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:02:38 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:02:38.351296 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6e2dc-3216-44ee-8f8c-0612cd5981f2 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:38.351620 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6e2dc-3216-44ee-8f8c-0612cd5981f2 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:38.351919 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6e2dc-3216-44ee-8f8c-0612cd5981f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:38.372175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-bab6e2dc-3216-44ee-8f8c-0612cd5981f2 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:38.373273 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-bab6e2dc-3216-44ee-8f8c-0612cd5981f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:38.386999 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:38.441711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:38.475147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 461/934] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:38.478167 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62362a8-9ef3-48a2-8c57-c9de8a1ece01 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:38.497454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6e2dc-3216-44ee-8f8c-0612cd5981f2 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:38.519995 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0c110-c2fc-4f49-a34b-7895cd8971c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:38.520764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0c110-c2fc-4f49-a34b-7895cd8971c1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:38.521046 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0c110-c2fc-4f49-a34b-7895cd8971c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:38.521346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0c110-c2fc-4f49-a34b-7895cd8971c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:38.532230 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0c110-c2fc-4f49-a34b-7895cd8971c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:38.533665 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0c110-c2fc-4f49-a34b-7895cd8971c1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:38.553191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-27c0c110-c2fc-4f49-a34b-7895cd8971c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:38.553191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:38.553191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:38.553191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:38.553191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:38.553191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:38.553191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:38.553191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:38.553191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:38.553191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:38.553191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:38.553191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:38.553191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:38.553191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:38.553191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:38.554295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:38.554295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:38.554295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:38.554295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:38.554295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:38.554295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:38.554295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:38.554295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:38.554295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:38.554295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:38.554295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:38.554295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:38.554295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:38.554295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:38.554295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:38.554295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:38.554295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:38.555253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:38.555253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:38.555253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:38.555253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:38.555253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 474/935] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:38.561527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0c110-c2fc-4f49-a34b-7895cd8971c1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:38.631931 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6e2dc-3216-44ee-8f8c-0612cd5981f2 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:38.671002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a777d1-f073-4bdc-b80b-0f2b77ea87dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:38.671808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a777d1-f073-4bdc-b80b-0f2b77ea87dd None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:38.672085 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a777d1-f073-4bdc-b80b-0f2b77ea87dd None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:38.672364 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a777d1-f073-4bdc-b80b-0f2b77ea87dd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:38.673008 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a777d1-f073-4bdc-b80b-0f2b77ea87dd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:38.674389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a777d1-f073-4bdc-b80b-0f2b77ea87dd None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:38.684843 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0c110-c2fc-4f49-a34b-7895cd8971c1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:38.686622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-c1a777d1-f073-4bdc-b80b-0f2b77ea87dd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:02:38.686622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:38.686622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:38.686622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:38.686622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:38.686622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:38.686622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:38.686622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:38.686622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:02:38.686622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:38.686622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:38.686622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:38.686622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:38.686622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:38.686622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:38.686622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:38.686622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:38.687609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:38.687609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:38.687609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:38.687609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:38.687609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:38.687609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:38.687609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:38.687609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:38.687609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:38.687609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:38.687609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:38.687609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:38.687609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:38.687609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:38.687609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:38.687609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:38.688430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:38.688430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:38.688430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:38.688430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:38.688430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:38.688430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:38.688430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:38.688430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:38.688430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:38.688430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:38.688430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:38.688430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:38.688430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:02:38.688430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:38.688430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 462/936] 10.222.0.48 () {56 vars in 1126 bytes} [Mon Jul 25 12:02:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:38.695325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a777d1-f073-4bdc-b80b-0f2b77ea87dd None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:38.706821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:38.727008 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:38.734968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f31fc-ecde-4586-9d40-e6bac697ab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:38.735692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f31fc-ecde-4586-9d40-e6bac697ab10 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:38.735971 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f31fc-ecde-4586-9d40-e6bac697ab10 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:38.736244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f31fc-ecde-4586-9d40-e6bac697ab10 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:38.737135 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f31fc-ecde-4586-9d40-e6bac697ab10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:38.737423 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f31fc-ecde-4586-9d40-e6bac697ab10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:38.738920 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f31fc-ecde-4586-9d40-e6bac697ab10 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:38.751677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 475/937] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:38.756807 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f31fc-ecde-4586-9d40-e6bac697ab10 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:38.814686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a777d1-f073-4bdc-b80b-0f2b77ea87dd None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:38.850994 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c0b02-9a6a-4523-994e-0a1e0bc8acee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:38.851669 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c0b02-9a6a-4523-994e-0a1e0bc8acee None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:38.851958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c0b02-9a6a-4523-994e-0a1e0bc8acee None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:38.852238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c0b02-9a6a-4523-994e-0a1e0bc8acee None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:38.852996 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c0b02-9a6a-4523-994e-0a1e0bc8acee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:38.853261 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c0b02-9a6a-4523-994e-0a1e0bc8acee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:38.854706 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c0b02-9a6a-4523-994e-0a1e0bc8acee None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:38.860881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 463/938] 10.222.0.48 () {56 vars in 1122 bytes} [Mon Jul 25 12:02:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:38.861263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f31fc-ecde-4586-9d40-e6bac697ab10 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:38.866063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f49bde-1784-47f6-97f6-c64ecbf0f836 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:38.866360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f49bde-1784-47f6-97f6-c64ecbf0f836 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:38.866641 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f49bde-1784-47f6-97f6-c64ecbf0f836 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:38.868039 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 464/939] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:02:38.868652 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f49bde-1784-47f6-97f6-c64ecbf0f836 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:38.900298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16a517-180e-4098-aba2-60c3fba8ad1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:38.901647 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16a517-180e-4098-aba2-60c3fba8ad1f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:38.901925 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16a517-180e-4098-aba2-60c3fba8ad1f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:38.902240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16a517-180e-4098-aba2-60c3fba8ad1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:38.909092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16a517-180e-4098-aba2-60c3fba8ad1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:38.910573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16a517-180e-4098-aba2-60c3fba8ad1f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:38.925072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2d16a517-180e-4098-aba2-60c3fba8ad1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:38.925072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:38.925072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:38.925072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:38.925072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:38.925072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:38.925072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:38.925072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:38.925072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:38.925072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:38.925072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:38.925072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:38.925072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:38.925072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:38.925072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:38.925981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:38.925981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:38.925981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:38.925981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:38.925981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:38.925981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:38.925981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:38.925981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:38.925981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:38.925981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:38.925981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:38.925981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:38.925981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:38.925981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:38.925981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:38.925981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:38.925981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:38.926876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:38.926876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:38.926876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:38.926876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:38.926876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:38.926876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:38.926876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:38.926876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:38.926876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 476/940] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:38.927842 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5b9e-22d0-4fc6-be12-d78aec29dad2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:38.927842 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5b9e-22d0-4fc6-be12-d78aec29dad2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:38.928092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5b9e-22d0-4fc6-be12-d78aec29dad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:38.946042 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9bdc5b9e-22d0-4fc6-be12-d78aec29dad2 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:38.947143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9bdc5b9e-22d0-4fc6-be12-d78aec29dad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:38.954442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:38.987176 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f49bde-1784-47f6-97f6-c64ecbf0f836 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:38.999836 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:39.022485 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d5fdb-8537-4af6-b801-5f90e3199815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:39.023150 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d5fdb-8537-4af6-b801-5f90e3199815 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:39.023434 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d5fdb-8537-4af6-b801-5f90e3199815 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:39.023710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d5fdb-8537-4af6-b801-5f90e3199815 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:39.024378 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 477/941] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:39.024500 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d5fdb-8537-4af6-b801-5f90e3199815 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:39.024776 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d5fdb-8537-4af6-b801-5f90e3199815 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:39.024998 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5b9e-22d0-4fc6-be12-d78aec29dad2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:39.030096 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d5fdb-8537-4af6-b801-5f90e3199815 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:39.032008 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 465/942] 10.222.0.48 () {56 vars in 1122 bytes} [Mon Jul 25 12:02:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:39.037131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d5fdb-8537-4af6-b801-5f90e3199815 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:39.139295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5b9e-22d0-4fc6-be12-d78aec29dad2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:39.142601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d5fdb-8537-4af6-b801-5f90e3199815 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:39.176390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b371f5c-7901-49ea-b6cf-44919017f48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:39.177058 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b371f5c-7901-49ea-b6cf-44919017f48e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:39.177341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b371f5c-7901-49ea-b6cf-44919017f48e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:39.177613 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b371f5c-7901-49ea-b6cf-44919017f48e None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:39.178438 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b371f5c-7901-49ea-b6cf-44919017f48e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:39.178549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d614cb-6045-4eaf-b2c9-5796474d247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:39.178747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b371f5c-7901-49ea-b6cf-44919017f48e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:39.179175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d614cb-6045-4eaf-b2c9-5796474d247f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:39.179462 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d614cb-6045-4eaf-b2c9-5796474d247f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:39.179742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d614cb-6045-4eaf-b2c9-5796474d247f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:39.180188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b371f5c-7901-49ea-b6cf-44919017f48e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:39.180535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d614cb-6045-4eaf-b2c9-5796474d247f None admin] RBAC: Adding query filter params (interface=public, service_id=d8e24c2cee254da38d2b520094b51045, region_id=RegionOne) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:39.180848 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d614cb-6045-4eaf-b2c9-5796474d247f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:39.182732 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d614cb-6045-4eaf-b2c9-5796474d247f None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:39.184367 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:39.193017 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 466/943] 10.222.0.48 () {56 vars in 1251 bytes} [Mon Jul 25 12:02:39 2022] GET /identity/v3/endpoints?service_id=d8e24c2cee254da38d2b520094b51045&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:39.193017 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d614cb-6045-4eaf-b2c9-5796474d247f None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:39.193264 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 478/944] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:39.194806 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b371f5c-7901-49ea-b6cf-44919017f48e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:39.241208 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:39.300262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d614cb-6045-4eaf-b2c9-5796474d247f None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:39.305749 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b371f5c-7901-49ea-b6cf-44919017f48e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:39.335562 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d4c01-c809-4000-82e9-359f034fa1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:39.336224 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d4c01-c809-4000-82e9-359f034fa1e5 None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:39.336509 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d4c01-c809-4000-82e9-359f034fa1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:39.336784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d4c01-c809-4000-82e9-359f034fa1e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:39.337488 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d4c01-c809-4000-82e9-359f034fa1e5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:39.338981 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d4c01-c809-4000-82e9-359f034fa1e5 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:39.341569 dv-cinder-797608-61-smb devstack@keystone.service[80317]: WARNING keystone.server.flask.common [None req-af1d4c01-c809-4000-82e9-359f034fa1e5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 12:02:39.343174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3520e4-6e92-4b41-96d5-472960e2af6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:39.344033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3520e4-6e92-4b41-96d5-472960e2af6e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:39.344511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3520e4-6e92-4b41-96d5-472960e2af6e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:39.344849 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3520e4-6e92-4b41-96d5-472960e2af6e None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:39.345643 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3520e4-6e92-4b41-96d5-472960e2af6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:39.346885 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3520e4-6e92-4b41-96d5-472960e2af6e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:39.358423 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 479/945] 10.222.0.48 () {56 vars in 1087 bytes} [Mon Jul 25 12:02:39 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:02:39.359351 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3520e4-6e92-4b41-96d5-472960e2af6e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:39.360824 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.sql.core [None req-af1d4c01-c809-4000-82e9-359f034fa1e5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 12:02:39.360824 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 12:02:39.360824 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [parameters: {'id': '77ad62f85a9e489eb0a62ce3e34fe779', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 12:02:39.360824 dv-cinder-797608-61-smb devstack@keystone.service[80317]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80317) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 12:02:39.368721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-af1d4c01-c809-4000-82e9-359f034fa1e5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 77ad62f85a9e489eb0a62ce3e34fe779.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 77ad62f85a9e489eb0a62ce3e34fe779. Jul 25 12:02:39.368721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:39.368721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 12:02:39.368721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 12:02:39.368721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 12:02:39.368721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 12:02:39.368721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 12:02:39.368721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 12:02:39.368721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 12:02:39.368721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application conn.query(q) Jul 25 12:02:39.368721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 12:02:39.368721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 12:02:39.368721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 12:02:39.370311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application result.read() Jul 25 12:02:39.370311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 12:02:39.370311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 12:02:39.370311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 12:02:39.370311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 12:02:39.370311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 12:02:39.370311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 12:02:39.370311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 12:02:39.370311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 12:02:39.370311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 12:02:39.370311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:39.370311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 12:02:39.370311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:39.370311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:39.370311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 12:02:39.370311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 12:02:39.370311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 12:02:39.370311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 12:02:39.371266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 12:02:39.371266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application next(self.gen) Jul 25 12:02:39.371266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 12:02:39.371266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application yield resource Jul 25 12:02:39.371266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 12:02:39.371266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application next(self.gen) Jul 25 12:02:39.371266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 12:02:39.371266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 12:02:39.371266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:02:39.371266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 12:02:39.371266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:02:39.371266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise self.value Jul 25 12:02:39.371266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 12:02:39.371266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 12:02:39.371266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 12:02:39.371266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application session.commit() Jul 25 12:02:39.371266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 12:02:39.372138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 12:02:39.372138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 12:02:39.372138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 12:02:39.372138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 12:02:39.372138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self.session.flush() Jul 25 12:02:39.372138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 12:02:39.372138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 12:02:39.372138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 12:02:39.372138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 12:02:39.372138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 12:02:39.372138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application compat.raise_( Jul 25 12:02:39.372138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 12:02:39.372138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception Jul 25 12:02:39.372138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 12:02:39.372138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 12:02:39.372138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 12:02:39.372138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 12:02:39.373042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 12:02:39.373042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 12:02:39.373042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 12:02:39.373042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 12:02:39.373042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 12:02:39.373042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 12:02:39.373042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 12:02:39.373042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 12:02:39.373042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 12:02:39.373042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 12:02:39.373042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 12:02:39.373042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 12:02:39.373042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 12:02:39.373042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 12:02:39.373042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 12:02:39.374093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 12:02:39.374093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 12:02:39.374093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception Jul 25 12:02:39.374093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 12:02:39.374093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 12:02:39.374093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 12:02:39.374093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 12:02:39.374093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 12:02:39.374093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 12:02:39.374093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 12:02:39.374093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application conn.query(q) Jul 25 12:02:39.374093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 12:02:39.374093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 12:02:39.374093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 12:02:39.374093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application result.read() Jul 25 12:02:39.374093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 12:02:39.374093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 12:02:39.377016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 12:02:39.377016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 12:02:39.377016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 12:02:39.377016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 12:02:39.377016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 12:02:39.377016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 12:02:39.377016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 12:02:39.377016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 12:02:39.377016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [parameters: {'id': '77ad62f85a9e489eb0a62ce3e34fe779', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 12:02:39.377016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 12:02:39.377016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:39.377016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:39.377016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:39.377016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:39.377016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 12:02:39.378990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 12:02:39.378990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 12:02:39.378990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 12:02:39.378990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 12:02:39.378990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:39.378990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:39.378990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:39.378990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:39.378990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:39.378990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:39.378990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:39.378990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:39.378990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:39.378990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:39.378990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:39.378990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:39.378990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:39.382059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:39.382059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 12:02:39.382059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 12:02:39.382059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:39.382059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:39.382059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 12:02:39.382059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 12:02:39.382059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 77ad62f85a9e489eb0a62ce3e34fe779. Jul 25 12:02:39.382059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:39.382059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 467/946] 10.222.0.48 () {60 vars in 1140 bytes} [Mon Jul 25 12:02:39 2022] POST /identity/v3/projects => generated 262 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:39.382059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d4c01-c809-4000-82e9-359f034fa1e5 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:39.451638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:39.500211 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3520e4-6e92-4b41-96d5-472960e2af6e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:39.503711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:39.512101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d4c01-c809-4000-82e9-359f034fa1e5 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:39.544643 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d975aa7-a796-4dba-a16a-ce9b555b3311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:39.545663 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d975aa7-a796-4dba-a16a-ce9b555b3311 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:39.546096 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d975aa7-a796-4dba-a16a-ce9b555b3311 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:39.546421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d975aa7-a796-4dba-a16a-ce9b555b3311 None admin] PATH_INFO: `/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/30c0516b85e74bdb829a3019e71e6ea6/roles/85d086a755ed46078be507e4a3b3c9a8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:39.548916 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d975aa7-a796-4dba-a16a-ce9b555b3311 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c80b9db7ace42c0a0cd1f31901599fd, user_id=30c0516b85e74bdb829a3019e71e6ea6, role_id=85d086a755ed46078be507e4a3b3c9a8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:39.550435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d975aa7-a796-4dba-a16a-ce9b555b3311 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:39.554508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d8e12-7872-45b6-99f5-7c6e0bf37d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:39.555547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d8e12-7872-45b6-99f5-7c6e0bf37d8a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:39.555958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d8e12-7872-45b6-99f5-7c6e0bf37d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:39.556130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d8e12-7872-45b6-99f5-7c6e0bf37d8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:39.564986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d8e12-7872-45b6-99f5-7c6e0bf37d8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:39.566921 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d8e12-7872-45b6-99f5-7c6e0bf37d8a None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:39.567934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 480/947] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:02:39 2022] PUT /identity/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/30c0516b85e74bdb829a3019e71e6ea6/roles/85d086a755ed46078be507e4a3b3c9a8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:02:39.582708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-1d9d8e12-7872-45b6-99f5-7c6e0bf37d8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:39.582708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:39.582708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:39.582708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:39.582708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:39.582708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:39.582708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:39.582708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:39.582708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:39.582708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:39.582708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:39.582708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:39.582708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:39.582708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:39.582708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:39.583704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:39.583704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:39.583704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:39.583704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:39.583704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:39.583704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:39.583704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:39.583704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:39.583704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:39.583704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:39.583704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:39.583704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:39.583704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:39.583704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:39.583704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:39.583704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:39.583704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:39.584661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:39.584661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:39.584661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:39.584661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:39.584661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:39.584661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:39.584661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:39.584661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:39.587461 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 468/948] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:39.596102 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d975aa7-a796-4dba-a16a-ce9b555b3311 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:39.719617 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d975aa7-a796-4dba-a16a-ce9b555b3311 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:39.759614 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60074e27-ede2-4fe0-abe7-5115a34091ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:39.760202 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60074e27-ede2-4fe0-abe7-5115a34091ce None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:39.760488 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60074e27-ede2-4fe0-abe7-5115a34091ce None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:39.760762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60074e27-ede2-4fe0-abe7-5115a34091ce None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:39.761520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60074e27-ede2-4fe0-abe7-5115a34091ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:39.761832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60074e27-ede2-4fe0-abe7-5115a34091ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:39.763395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60074e27-ede2-4fe0-abe7-5115a34091ce None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:39.781683 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 481/949] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 12:02:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:40.449498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196daa3-7705-4708-b167-ed2afbca3ca7 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:40.450063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196daa3-7705-4708-b167-ed2afbca3ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:40.450063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196daa3-7705-4708-b167-ed2afbca3ca7 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:40.454441 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 469/950] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:40.459682 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba760d-be7d-4879-aa12-a1cb7290ed18 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:40.460097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba760d-be7d-4879-aa12-a1cb7290ed18 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:40.460263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba760d-be7d-4879-aa12-a1cb7290ed18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:40.481581 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-88ba760d-be7d-4879-aa12-a1cb7290ed18 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:40.482789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-88ba760d-be7d-4879-aa12-a1cb7290ed18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:40.502891 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:40.556516 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 482/951] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:40.577510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196daa3-7705-4708-b167-ed2afbca3ca7 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:40.683874 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196daa3-7705-4708-b167-ed2afbca3ca7 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:40.698686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:40.721064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37041eae-8039-4040-a6b7-a6b20c84c7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:40.722326 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37041eae-8039-4040-a6b7-a6b20c84c7ce None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:40.722811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37041eae-8039-4040-a6b7-a6b20c84c7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:40.723340 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37041eae-8039-4040-a6b7-a6b20c84c7ce None admin] PATH_INFO: `/v3/services/compute` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:40.724209 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37041eae-8039-4040-a6b7-a6b20c84c7ce None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:40.725817 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37041eae-8039-4040-a6b7-a6b20c84c7ce None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:40.739310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-37041eae-8039-4040-a6b7-a6b20c84c7ce None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 12:02:40.739310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:40.739310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:40.739310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:40.739310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:40.739310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:40.739310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:40.739310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:40.739310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 12:02:40.739310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:40.739310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:40.739310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:40.739310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:40.739310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:40.739310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:40.739310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:40.739310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:40.740361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:40.740361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:40.740361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:40.740361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:40.740361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:40.740361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:40.740361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:40.740361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:40.740361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:40.740361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:40.740361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:40.740361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:40.740361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:40.740361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:40.740361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:40.740361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:40.741197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:40.741197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:40.741197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:40.741197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:40.741197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:40.741197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:40.741197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:40.741197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:40.741197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:40.741197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:40.741197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:40.741197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:40.741197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 12:02:40.741197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:40.743604 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 470/952] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:40.749500 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba760d-be7d-4879-aa12-a1cb7290ed18 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:40.851708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba760d-be7d-4879-aa12-a1cb7290ed18 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:40.886014 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8968fd-a337-4847-bae6-115cc6bffe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:40.886931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8968fd-a337-4847-bae6-115cc6bffe52 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:40.887360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8968fd-a337-4847-bae6-115cc6bffe52 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:40.887773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8968fd-a337-4847-bae6-115cc6bffe52 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:40.888635 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8968fd-a337-4847-bae6-115cc6bffe52 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:40.889088 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8968fd-a337-4847-bae6-115cc6bffe52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:40.890628 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8968fd-a337-4847-bae6-115cc6bffe52 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:40.895893 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 483/953] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 12:02:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:40.903281 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37041eae-8039-4040-a6b7-a6b20c84c7ce None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:41.012471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37041eae-8039-4040-a6b7-a6b20c84c7ce None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:41.046798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b4910-b602-421a-bcb4-5f332aded20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:41.047466 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b4910-b602-421a-bcb4-5f332aded20f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:41.047748 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b4910-b602-421a-bcb4-5f332aded20f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:41.048025 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b4910-b602-421a-bcb4-5f332aded20f None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:41.048732 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b4910-b602-421a-bcb4-5f332aded20f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:41.049036 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b4910-b602-421a-bcb4-5f332aded20f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:41.050413 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b4910-b602-421a-bcb4-5f332aded20f None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:41.055323 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 471/954] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 12:02:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:41.395565 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c35144-5c5a-4eb4-8c80-c81ffbe1c32a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:41.395759 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c35144-5c5a-4eb4-8c80-c81ffbe1c32a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:41.396043 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c35144-5c5a-4eb4-8c80-c81ffbe1c32a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:41.397678 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 484/955] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:41.402895 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbf31d-12e9-4c81-84d3-e5a0ec9c21f6 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:41.403185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbf31d-12e9-4c81-84d3-e5a0ec9c21f6 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:41.403466 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbf31d-12e9-4c81-84d3-e5a0ec9c21f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:41.422280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-adbbf31d-12e9-4c81-84d3-e5a0ec9c21f6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:41.423784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-adbbf31d-12e9-4c81-84d3-e5a0ec9c21f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:41.460692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:41.493728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 472/956] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:41.516842 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c35144-5c5a-4eb4-8c80-c81ffbe1c32a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:41.536297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:41.624487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c35144-5c5a-4eb4-8c80-c81ffbe1c32a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:41.658651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d354f13-988a-4787-8d4c-cff470c92c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:41.659379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d354f13-988a-4787-8d4c-cff470c92c69 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:41.659656 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d354f13-988a-4787-8d4c-cff470c92c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:41.659928 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d354f13-988a-4787-8d4c-cff470c92c69 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:41.660572 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d354f13-988a-4787-8d4c-cff470c92c69 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:41.662022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d354f13-988a-4787-8d4c-cff470c92c69 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:41.674827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6d354f13-988a-4787-8d4c-cff470c92c69 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:02:41.674827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:41.674827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:41.674827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:41.674827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:41.674827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:41.674827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:41.674827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:41.674827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:02:41.674827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:41.674827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:41.674827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:41.674827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:41.674827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:41.674827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:41.674827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:41.674827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:41.675785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:41.675785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:41.675785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:41.675785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:41.675785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:41.675785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:41.675785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:41.675785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:41.675785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:41.675785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:41.675785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:41.675785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:41.675785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:41.675785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:41.675785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:41.675785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:41.676744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:41.676744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:41.676744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:41.676744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:41.676744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:41.676744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:41.676744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:41.676744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:41.676744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:41.676744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:41.676744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:41.676744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:41.676744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:02:41.676744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:41.676744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 485/957] 10.222.0.48 () {56 vars in 1126 bytes} [Mon Jul 25 12:02:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:41.682077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbf31d-12e9-4c81-84d3-e5a0ec9c21f6 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:41.702359 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaebb0-88b9-49a9-94cb-c14c9e9c7e37 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:41.702698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaebb0-88b9-49a9-94cb-c14c9e9c7e37 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:41.702904 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaebb0-88b9-49a9-94cb-c14c9e9c7e37 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:41.704526 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 486/958] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:02:41.711191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47cf1f-6d88-4761-a6c5-28f909d513cc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:41.711493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47cf1f-6d88-4761-a6c5-28f909d513cc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:41.711765 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47cf1f-6d88-4761-a6c5-28f909d513cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:41.734915 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ee47cf1f-6d88-4761-a6c5-28f909d513cc None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:41.736441 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ee47cf1f-6d88-4761-a6c5-28f909d513cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:41.792284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbf31d-12e9-4c81-84d3-e5a0ec9c21f6 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:41.811002 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 487/959] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:02:41.837001 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228127ca-d520-4242-85ae-9efc1842dbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:41.837251 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47cf1f-6d88-4761-a6c5-28f909d513cc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:41.837900 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228127ca-d520-4242-85ae-9efc1842dbef None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:41.838352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228127ca-d520-4242-85ae-9efc1842dbef None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:41.838725 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228127ca-d520-4242-85ae-9efc1842dbef None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:41.839782 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228127ca-d520-4242-85ae-9efc1842dbef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:41.841077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228127ca-d520-4242-85ae-9efc1842dbef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:41.842672 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228127ca-d520-4242-85ae-9efc1842dbef None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:41.849128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 473/960] 10.222.0.48 () {56 vars in 1122 bytes} [Mon Jul 25 12:02:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:41.851063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ab870-4fdb-4e03-8862-ffa546708057 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:41.851352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ab870-4fdb-4e03-8862-ffa546708057 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:41.851625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ab870-4fdb-4e03-8862-ffa546708057 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:41.853004 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 474/961] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:41.855663 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ab870-4fdb-4e03-8862-ffa546708057 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:41.859058 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:41.893777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:41.953054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47cf1f-6d88-4761-a6c5-28f909d513cc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:41.964286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ab870-4fdb-4e03-8862-ffa546708057 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:41.989121 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba5823-74c6-4689-a2a5-80cf415f72af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:41.989931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba5823-74c6-4689-a2a5-80cf415f72af None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:41.990248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba5823-74c6-4689-a2a5-80cf415f72af None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:41.990524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba5823-74c6-4689-a2a5-80cf415f72af None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:41.999806 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a57ff-903a-45c1-afb2-4cb0f69ce77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:42.000466 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a57ff-903a-45c1-afb2-4cb0f69ce77b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:42.000744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a57ff-903a-45c1-afb2-4cb0f69ce77b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:42.001018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a57ff-903a-45c1-afb2-4cb0f69ce77b None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:42.001437 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba5823-74c6-4689-a2a5-80cf415f72af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:42.001715 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a57ff-903a-45c1-afb2-4cb0f69ce77b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:42.002039 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a57ff-903a-45c1-afb2-4cb0f69ce77b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:42.003389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a57ff-903a-45c1-afb2-4cb0f69ce77b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:42.008505 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 475/962] 10.222.0.48 () {56 vars in 1122 bytes} [Mon Jul 25 12:02:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:42.009651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c4ba5823-74c6-4689-a2a5-80cf415f72af None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:02:42.009651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:42.009651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:42.009651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:42.009651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:42.009651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:42.009651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:42.009651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:42.009651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:42.009651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:42.009651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:42.009651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:42.009651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:42.009651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:42.009651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:42.009651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:42.010706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:42.010706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:42.010706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:42.010706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:42.010706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:42.010706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:42.010706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:42.010706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:42.010706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:42.010706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:42.010706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:42.010706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:42.010706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:42.010706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:42.010706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:42.010706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:42.016543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:42.016543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:42.016543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:42.016543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:42.016543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:42.016543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:42.016543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:42.016543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:42.016543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:42.016543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:42.016543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:02:42.016543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:42.016543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 488/963] 10.222.0.48 () {56 vars in 1120 bytes} [Mon Jul 25 12:02:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:42.016543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba5823-74c6-4689-a2a5-80cf415f72af None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:42.017327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd3677-9e1f-44fd-a74d-622bef66003e None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:42.017327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd3677-9e1f-44fd-a74d-622bef66003e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:42.017327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd3677-9e1f-44fd-a74d-622bef66003e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:42.032873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-e5fd3677-9e1f-44fd-a74d-622bef66003e None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:42.034075 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-e5fd3677-9e1f-44fd-a74d-622bef66003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:42.090722 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:42.105461 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 476/964] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:42.106615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd3677-9e1f-44fd-a74d-622bef66003e None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:42.123809 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba5823-74c6-4689-a2a5-80cf415f72af None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:42.148013 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:42.159799 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f1445-320b-444e-9fb1-9259ef73fd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:42.160754 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f1445-320b-444e-9fb1-9259ef73fd00 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:42.161598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f1445-320b-444e-9fb1-9259ef73fd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:42.162126 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f1445-320b-444e-9fb1-9259ef73fd00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:42.163393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f1445-320b-444e-9fb1-9259ef73fd00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:42.164982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f1445-320b-444e-9fb1-9259ef73fd00 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:42.186954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 489/965] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:02:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:02:42.187947 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f1445-320b-444e-9fb1-9259ef73fd00 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:42.241363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd3677-9e1f-44fd-a74d-622bef66003e None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:42.289831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e1304-ee06-4fb0-afbe-3fb555ec738a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:42.290649 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e1304-ee06-4fb0-afbe-3fb555ec738a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:42.291005 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e1304-ee06-4fb0-afbe-3fb555ec738a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:42.291389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e1304-ee06-4fb0-afbe-3fb555ec738a None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:42.292192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e1304-ee06-4fb0-afbe-3fb555ec738a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:42.292563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e1304-ee06-4fb0-afbe-3fb555ec738a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:42.294429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e1304-ee06-4fb0-afbe-3fb555ec738a None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:42.305057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 477/966] 10.222.0.48 () {56 vars in 1115 bytes} [Mon Jul 25 12:02:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:42.314140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e1304-ee06-4fb0-afbe-3fb555ec738a None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:42.328946 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f1445-320b-444e-9fb1-9259ef73fd00 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:42.364475 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:42.374927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52191ce7-174d-4c4f-aea9-b9cdaa2b3273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:42.375877 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52191ce7-174d-4c4f-aea9-b9cdaa2b3273 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:42.376523 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52191ce7-174d-4c4f-aea9-b9cdaa2b3273 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:42.377215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52191ce7-174d-4c4f-aea9-b9cdaa2b3273 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:42.377719 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52191ce7-174d-4c4f-aea9-b9cdaa2b3273 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:42.379597 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52191ce7-174d-4c4f-aea9-b9cdaa2b3273 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:42.383041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: WARNING keystone.server.flask.common [None req-52191ce7-174d-4c4f-aea9-b9cdaa2b3273 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 12:02:42.399465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.sql.core [None req-52191ce7-174d-4c4f-aea9-b9cdaa2b3273 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 12:02:42.399465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 12:02:42.399465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [parameters: {'user_id': '08486d4ab88145a88b1e246b012af27f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 12:02:42.399465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80316) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 12:02:42.417699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-52191ce7-174d-4c4f-aea9-b9cdaa2b3273 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 12:02:42.417699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:42.417699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 12:02:42.417699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 12:02:42.417699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 12:02:42.417699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 12:02:42.417699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 12:02:42.417699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 12:02:42.417699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 12:02:42.417699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application conn.query(q) Jul 25 12:02:42.417699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 12:02:42.417699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 12:02:42.417699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 12:02:42.417699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application result.read() Jul 25 12:02:42.417699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 12:02:42.419134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 12:02:42.419134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 12:02:42.419134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 12:02:42.419134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 12:02:42.419134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 12:02:42.419134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 12:02:42.419134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 12:02:42.419134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 12:02:42.419134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:42.419134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 12:02:42.419134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:42.419134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:42.419134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 12:02:42.419134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 12:02:42.419134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 12:02:42.419134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 12:02:42.419134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 12:02:42.419134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application next(self.gen) Jul 25 12:02:42.420062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 12:02:42.420062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application yield resource Jul 25 12:02:42.420062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 12:02:42.420062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application next(self.gen) Jul 25 12:02:42.420062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 12:02:42.420062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 12:02:42.420062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:02:42.420062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 12:02:42.420062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:02:42.420062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise self.value Jul 25 12:02:42.420062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 12:02:42.420062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 12:02:42.420062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 12:02:42.420062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application session.commit() Jul 25 12:02:42.420062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 12:02:42.420062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 12:02:42.420062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 12:02:42.420961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 12:02:42.420961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 12:02:42.420961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.session.flush() Jul 25 12:02:42.420961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 12:02:42.420961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 12:02:42.420961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 12:02:42.420961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 12:02:42.420961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 12:02:42.420961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application compat.raise_( Jul 25 12:02:42.420961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 12:02:42.420961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception Jul 25 12:02:42.420961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 12:02:42.420961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 12:02:42.420961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 12:02:42.420961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 12:02:42.420961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 12:02:42.420961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 12:02:42.421846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 12:02:42.421846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 12:02:42.421846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 12:02:42.421846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 12:02:42.421846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 12:02:42.421846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 12:02:42.421846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 12:02:42.421846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 12:02:42.421846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 12:02:42.421846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 12:02:42.421846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 12:02:42.421846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 12:02:42.421846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 12:02:42.421846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 12:02:42.421846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 12:02:42.421846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception Jul 25 12:02:42.422737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 12:02:42.422737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 12:02:42.422737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 12:02:42.422737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 12:02:42.422737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 12:02:42.422737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 12:02:42.422737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 12:02:42.422737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application conn.query(q) Jul 25 12:02:42.422737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 12:02:42.422737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 12:02:42.422737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 12:02:42.422737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application result.read() Jul 25 12:02:42.422737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 12:02:42.422737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 12:02:42.422737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 12:02:42.422737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 12:02:42.423549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 12:02:42.423549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 12:02:42.423549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 12:02:42.423549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 12:02:42.423549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 12:02:42.423549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 12:02:42.423549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [parameters: {'user_id': '08486d4ab88145a88b1e246b012af27f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 12:02:42.423549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 12:02:42.423549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:42.423549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:42.423549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:42.423549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:42.423549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:42.423549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:42.423549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:42.424308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:42.424308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:42.424308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:42.424308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:42.424308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:42.424308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:42.424308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:42.424308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 12:02:42.424308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 12:02:42.424308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:42.424308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:42.424308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:42.424308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:42.424308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:42.424308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:42.424308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 12:02:42.424308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 12:02:42.427479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 12:02:42.427479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 12:02:42.427479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 12:02:42.427479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 12:02:42.427479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 12:02:42.427479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:42.427479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 490/967] 10.222.0.48 () {60 vars in 1131 bytes} [Mon Jul 25 12:02:42 2022] POST /identity/v3/users => generated 160 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:42.427479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52191ce7-174d-4c4f-aea9-b9cdaa2b3273 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:42.449357 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:42.467722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e1304-ee06-4fb0-afbe-3fb555ec738a None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:42.509211 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e98f3-e4ab-49e1-ae69-3e25abfcd553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:42.509923 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e98f3-e4ab-49e1-ae69-3e25abfcd553 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:42.510261 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e98f3-e4ab-49e1-ae69-3e25abfcd553 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:42.510531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e98f3-e4ab-49e1-ae69-3e25abfcd553 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:42.521144 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e98f3-e4ab-49e1-ae69-3e25abfcd553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:42.522821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e98f3-e4ab-49e1-ae69-3e25abfcd553 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:42.541168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-dc1e98f3-e4ab-49e1-ae69-3e25abfcd553 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:42.541168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:42.541168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:42.541168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:42.541168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:42.541168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:42.541168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:42.541168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:42.541168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:42.541168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:42.541168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:42.541168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:42.541168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:42.541168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:42.541168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:42.542695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:42.542695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:42.542695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:42.542695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:42.542695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:42.542695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:42.542695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:42.542695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:42.542695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:42.542695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:42.542695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:42.542695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:42.542695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:42.542695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:42.542695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:42.542695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:42.542695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:42.543884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:42.543884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:42.543884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:42.543884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:42.543884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 478/968] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:42.550928 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e98f3-e4ab-49e1-ae69-3e25abfcd553 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:42.562203 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52191ce7-174d-4c4f-aea9-b9cdaa2b3273 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:42.606961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44090493-316f-4a1a-bba2-61f07c28d2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:42.607773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44090493-316f-4a1a-bba2-61f07c28d2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:42.608056 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44090493-316f-4a1a-bba2-61f07c28d2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:42.608332 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44090493-316f-4a1a-bba2-61f07c28d2b4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:42.618727 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44090493-316f-4a1a-bba2-61f07c28d2b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:42.621345 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44090493-316f-4a1a-bba2-61f07c28d2b4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:42.641286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-44090493-316f-4a1a-bba2-61f07c28d2b4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 12:02:42.641286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:42.641286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:42.641286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:42.641286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:42.641286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:42.641286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:42.641286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:42.641286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:42.641286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:42.641286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:42.641286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:42.641286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:42.641286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:42.641286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:42.641286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:42.642331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:42.642331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:42.642331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:42.642331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:42.642331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:42.642331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:42.642331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:42.642331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:42.642331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:42.642331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:42.642331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:42.642331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:42.642331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:42.642331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:42.642331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:42.642331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:42.642331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:42.642331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:42.643259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:42.643259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:42.643259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:42.643259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:42.643259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:42.643259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:42.643259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:42.643259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:42.643259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 12:02:42.643259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:42.646074 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 491/969] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:02:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:42.648177 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44090493-316f-4a1a-bba2-61f07c28d2b4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:42.689544 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e98f3-e4ab-49e1-ae69-3e25abfcd553 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:42.716447 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:42.735261 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26666fd8-8d1f-4a41-86ed-ad918288e32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:42.735261 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26666fd8-8d1f-4a41-86ed-ad918288e32e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:42.735559 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26666fd8-8d1f-4a41-86ed-ad918288e32e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:42.736083 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26666fd8-8d1f-4a41-86ed-ad918288e32e None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:42.736899 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26666fd8-8d1f-4a41-86ed-ad918288e32e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:42.737323 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26666fd8-8d1f-4a41-86ed-ad918288e32e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:42.739306 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26666fd8-8d1f-4a41-86ed-ad918288e32e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:42.751618 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:42.758163 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 479/970] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:42.760899 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26666fd8-8d1f-4a41-86ed-ad918288e32e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:42.793662 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44090493-316f-4a1a-bba2-61f07c28d2b4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:42.834068 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8f97-9f23-48a3-b062-6448391d8221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:42.835127 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8f97-9f23-48a3-b062-6448391d8221 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:42.835617 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8f97-9f23-48a3-b062-6448391d8221 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:42.836154 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8f97-9f23-48a3-b062-6448391d8221 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:42.837186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a8f97-9f23-48a3-b062-6448391d8221 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:42.837712 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a8f97-9f23-48a3-b062-6448391d8221 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:42.839989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a8f97-9f23-48a3-b062-6448391d8221 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:42.878905 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 492/971] 10.222.0.48 () {56 vars in 1101 bytes} [Mon Jul 25 12:02:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:42.880050 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26666fd8-8d1f-4a41-86ed-ad918288e32e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:42.932959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb414b6-9328-494c-a0a6-50b2fe26dd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:42.933801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb414b6-9328-494c-a0a6-50b2fe26dd3f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:42.934120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb414b6-9328-494c-a0a6-50b2fe26dd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:42.934462 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb414b6-9328-494c-a0a6-50b2fe26dd3f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:42.943286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb414b6-9328-494c-a0a6-50b2fe26dd3f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:42.944801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb414b6-9328-494c-a0a6-50b2fe26dd3f None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:42.961608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-fdb414b6-9328-494c-a0a6-50b2fe26dd3f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:02:42.961608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:42.961608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:42.961608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:42.961608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:42.961608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:42.961608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:42.961608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:42.961608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:42.961608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:42.961608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:42.961608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:42.961608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:42.961608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:42.961608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:42.961608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:42.962647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:42.962647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:42.962647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:42.962647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:42.962647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:42.962647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:42.962647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:42.962647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:42.962647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:42.962647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:42.962647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:42.962647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:42.962647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:42.962647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:42.962647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:42.962647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:42.962647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:42.962647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:42.964133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:42.964133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:42.964133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:42.964133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:42.964133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:42.964133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:42.964133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:42.964133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:42.964133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:02:42.964133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:42.964133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 480/972] 10.222.0.48 () {56 vars in 1117 bytes} [Mon Jul 25 12:02:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:42.971314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8f97-9f23-48a3-b062-6448391d8221 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:43.082862 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8f97-9f23-48a3-b062-6448391d8221 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:43.094123 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:43.109777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c71b13-9e44-48ab-94df-546ed69c0a09 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:43.110089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c71b13-9e44-48ab-94df-546ed69c0a09 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:43.110365 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c71b13-9e44-48ab-94df-546ed69c0a09 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:43.111891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 481/973] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:02:43.119018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c1dda-8ac3-41d4-a3ae-340291f02422 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:43.119306 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c1dda-8ac3-41d4-a3ae-340291f02422 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:43.119691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c1dda-8ac3-41d4-a3ae-340291f02422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:43.122593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0b68f-49aa-4748-bb84-e3e37093804f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:43.123328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0b68f-49aa-4748-bb84-e3e37093804f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:43.123623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0b68f-49aa-4748-bb84-e3e37093804f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:43.123945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0b68f-49aa-4748-bb84-e3e37093804f None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:43.124795 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0b68f-49aa-4748-bb84-e3e37093804f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:43.125104 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0b68f-49aa-4748-bb84-e3e37093804f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:43.126575 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0b68f-49aa-4748-bb84-e3e37093804f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:43.140151 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-8a1c1dda-8ac3-41d4-a3ae-340291f02422 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:43.141337 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-8a1c1dda-8ac3-41d4-a3ae-340291f02422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:43.147521 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 493/974] 10.222.0.48 () {56 vars in 1149 bytes} [Mon Jul 25 12:02:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:43.155134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0b68f-49aa-4748-bb84-e3e37093804f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:43.209980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:43.229434 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 482/975] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:02:43.246186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c1dda-8ac3-41d4-a3ae-340291f02422 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:43.267894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0b68f-49aa-4748-bb84-e3e37093804f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:43.303980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be238a-1dd1-4352-a276-67abc642ab33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:43.304618 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be238a-1dd1-4352-a276-67abc642ab33 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:43.304904 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be238a-1dd1-4352-a276-67abc642ab33 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:43.305175 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be238a-1dd1-4352-a276-67abc642ab33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:43.346353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:43.346997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c1dda-8ac3-41d4-a3ae-340291f02422 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:43.382210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fa411-0e1f-4bc5-a4a4-f03aa78ef65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:43.382908 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fa411-0e1f-4bc5-a4a4-f03aa78ef65b None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:43.383197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fa411-0e1f-4bc5-a4a4-f03aa78ef65b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:43.383477 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fa411-0e1f-4bc5-a4a4-f03aa78ef65b None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:43.384241 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fa411-0e1f-4bc5-a4a4-f03aa78ef65b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:43.386260 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be238a-1dd1-4352-a276-67abc642ab33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:43.386394 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fa411-0e1f-4bc5-a4a4-f03aa78ef65b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:43.388138 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be238a-1dd1-4352-a276-67abc642ab33 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:43.414031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 483/976] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 12:02:43 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:02:43.506361 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 494/977] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:02:43 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:02:43.512687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fa411-0e1f-4bc5-a4a4-f03aa78ef65b None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:43.568670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:43.628928 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fa411-0e1f-4bc5-a4a4-f03aa78ef65b None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:43.663467 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b335f-4c99-456f-b665-0e9e304168b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:43.664261 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b335f-4c99-456f-b665-0e9e304168b6 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:43.664546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b335f-4c99-456f-b665-0e9e304168b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:43.664818 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b335f-4c99-456f-b665-0e9e304168b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:43.675409 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b335f-4c99-456f-b665-0e9e304168b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:43.676879 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b335f-4c99-456f-b665-0e9e304168b6 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:43.694863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-5b0b335f-4c99-456f-b665-0e9e304168b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:43.694863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:43.694863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:43.694863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:43.694863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:43.694863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:43.694863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:43.694863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:43.694863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:43.694863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:43.694863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:43.694863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:43.694863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:43.694863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:43.694863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:43.695750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:43.695750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:43.695750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:43.695750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:43.695750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:43.695750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:43.695750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:43.695750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:43.695750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:43.695750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:43.695750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:43.695750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:43.695750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:43.695750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:43.695750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:43.695750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:43.695750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:43.696656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:43.696656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:43.696656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:43.696656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:43.696656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 484/978] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:43.703178 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be238a-1dd1-4352-a276-67abc642ab33 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:43.768029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:43.803460 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be238a-1dd1-4352-a276-67abc642ab33 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:43.837723 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ddf5c-022c-4cb5-9aff-0e2d59bb13c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:43.838531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ddf5c-022c-4cb5-9aff-0e2d59bb13c5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:43.838891 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ddf5c-022c-4cb5-9aff-0e2d59bb13c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:43.839167 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ddf5c-022c-4cb5-9aff-0e2d59bb13c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:43.839899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ddf5c-022c-4cb5-9aff-0e2d59bb13c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:43.840205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ddf5c-022c-4cb5-9aff-0e2d59bb13c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:43.841570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ddf5c-022c-4cb5-9aff-0e2d59bb13c5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:43.858058 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 495/979] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:43.859295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b335f-4c99-456f-b665-0e9e304168b6 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:43.957669 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:43.962175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b335f-4c99-456f-b665-0e9e304168b6 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:43.996492 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58146ea9-073e-4ee0-9963-3423b7b703b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:43.997284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58146ea9-073e-4ee0-9963-3423b7b703b1 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:43.997561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58146ea9-073e-4ee0-9963-3423b7b703b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:43.997831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58146ea9-073e-4ee0-9963-3423b7b703b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:44.004596 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58146ea9-073e-4ee0-9963-3423b7b703b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:44.006033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58146ea9-073e-4ee0-9963-3423b7b703b1 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:44.019909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-58146ea9-073e-4ee0-9963-3423b7b703b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:44.019909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:44.019909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:44.019909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:44.019909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:44.019909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:44.019909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:44.019909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:44.019909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:44.019909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:44.019909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:44.019909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:44.019909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:44.019909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:44.019909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:44.020761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:44.020761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:44.020761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:44.020761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:44.020761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:44.020761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:44.020761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:44.020761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:44.020761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:44.020761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:44.020761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:44.020761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:44.020761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:44.020761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:44.020761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:44.020761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:44.020761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:44.026605 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:44.026605 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:44.026605 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:44.026605 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:44.026605 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:44.026605 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:44.026605 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:44.026605 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:44.026605 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 485/980] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:44.027089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ddf5c-022c-4cb5-9aff-0e2d59bb13c5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:44.125958 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ddf5c-022c-4cb5-9aff-0e2d59bb13c5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:44.150401 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:44.159930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb9ed9-b21d-40dc-a422-81f5d95a52ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:44.160588 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb9ed9-b21d-40dc-a422-81f5d95a52ba None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:44.160892 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb9ed9-b21d-40dc-a422-81f5d95a52ba None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:44.161148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb9ed9-b21d-40dc-a422-81f5d95a52ba None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:44.161938 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb9ed9-b21d-40dc-a422-81f5d95a52ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:44.162281 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb9ed9-b21d-40dc-a422-81f5d95a52ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:44.163709 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb9ed9-b21d-40dc-a422-81f5d95a52ba None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:44.181703 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 496/981] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:44.183943 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58146ea9-073e-4ee0-9963-3423b7b703b1 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:44.281968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58146ea9-073e-4ee0-9963-3423b7b703b1 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:44.316256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042c5a5-e9cd-4d91-b76f-e65fb288cb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:44.316903 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042c5a5-e9cd-4d91-b76f-e65fb288cb98 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:44.317183 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042c5a5-e9cd-4d91-b76f-e65fb288cb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:44.317455 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042c5a5-e9cd-4d91-b76f-e65fb288cb98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:44.318315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042c5a5-e9cd-4d91-b76f-e65fb288cb98 None admin] RBAC: Adding query filter params (role.id=85d086a755ed46078be507e4a3b3c9a8, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=30c0516b85e74bdb829a3019e71e6ea6) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:44.318620 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042c5a5-e9cd-4d91-b76f-e65fb288cb98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:44.319840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d0874-2f1e-4069-9bae-4d7b1c5b3cd8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:44.320025 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042c5a5-e9cd-4d91-b76f-e65fb288cb98 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:44.320120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d0874-2f1e-4069-9bae-4d7b1c5b3cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:44.320402 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d0874-2f1e-4069-9bae-4d7b1c5b3cd8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:44.322032 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 497/982] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:02:44.330034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 486/983] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:02:44 2022] GET /identity/v3/role_assignments?user.id=30c0516b85e74bdb829a3019e71e6ea6&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=85d086a755ed46078be507e4a3b3c9a8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:44.330203 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccad9e-5bb3-4142-b38c-6d3536cb2388 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:44.330203 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccad9e-5bb3-4142-b38c-6d3536cb2388 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:44.330203 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccad9e-5bb3-4142-b38c-6d3536cb2388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:44.349284 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-96ccad9e-5bb3-4142-b38c-6d3536cb2388 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:44.351231 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-96ccad9e-5bb3-4142-b38c-6d3536cb2388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:44.436943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 498/984] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:02:44.459223 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042c5a5-e9cd-4d91-b76f-e65fb288cb98 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:44.487726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:44.570313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042c5a5-e9cd-4d91-b76f-e65fb288cb98 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:44.604277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c614722-2b24-4c37-879c-6731340934cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:44.605077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c614722-2b24-4c37-879c-6731340934cc None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:44.605361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c614722-2b24-4c37-879c-6731340934cc None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:44.605630 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c614722-2b24-4c37-879c-6731340934cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:44.606365 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c614722-2b24-4c37-879c-6731340934cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:44.607711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c614722-2b24-4c37-879c-6731340934cc None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:44.619588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-5c614722-2b24-4c37-879c-6731340934cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:02:44.619588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:44.619588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:44.619588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:44.619588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:44.619588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:44.619588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:44.619588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:44.619588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:02:44.619588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:44.619588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:44.619588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:44.619588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:44.619588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:44.619588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:44.619588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:44.619588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:44.620541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:44.620541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:44.620541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:44.620541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:44.620541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:44.620541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:44.620541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:44.620541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:44.620541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:44.620541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:44.620541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:44.620541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:44.620541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:44.620541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:44.620541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:44.620541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:44.621356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:44.621356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:44.621356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:44.621356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:44.621356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:44.621356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:44.621356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:44.621356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:44.621356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:44.621356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:44.621356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:44.621356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:44.621356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:02:44.621356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:44.621356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 487/985] 10.222.0.48 () {56 vars in 1126 bytes} [Mon Jul 25 12:02:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:44.626935 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccad9e-5bb3-4142-b38c-6d3536cb2388 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:44.724138 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccad9e-5bb3-4142-b38c-6d3536cb2388 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:44.740793 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:44.758675 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c856a-bb3b-4798-a101-67befc75741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:44.759335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c856a-bb3b-4798-a101-67befc75741f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:44.759612 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c856a-bb3b-4798-a101-67befc75741f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:44.759881 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c856a-bb3b-4798-a101-67befc75741f None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:44.761111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c856a-bb3b-4798-a101-67befc75741f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:44.761411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c856a-bb3b-4798-a101-67befc75741f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:44.762818 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c856a-bb3b-4798-a101-67befc75741f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:44.773771 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 499/986] 10.222.0.48 () {56 vars in 1122 bytes} [Mon Jul 25 12:02:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:44.773909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c614722-2b24-4c37-879c-6731340934cc None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:44.863449 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:44.878766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c614722-2b24-4c37-879c-6731340934cc None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:44.913493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c9d17-5731-405c-972a-7a8c8ffd03f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:44.914191 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c9d17-5731-405c-972a-7a8c8ffd03f8 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:44.914470 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c9d17-5731-405c-972a-7a8c8ffd03f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:44.914736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c9d17-5731-405c-972a-7a8c8ffd03f8 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:44.915440 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c9d17-5731-405c-972a-7a8c8ffd03f8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:44.915742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c9d17-5731-405c-972a-7a8c8ffd03f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:44.917118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c9d17-5731-405c-972a-7a8c8ffd03f8 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:44.922338 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 488/987] 10.222.0.48 () {56 vars in 1122 bytes} [Mon Jul 25 12:02:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:44.928013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c856a-bb3b-4798-a101-67befc75741f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:45.030037 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c856a-bb3b-4798-a101-67befc75741f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:45.064789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523195d1-ca4f-4266-96d5-3efca9760b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:45.065457 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523195d1-ca4f-4266-96d5-3efca9760b97 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:45.065740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523195d1-ca4f-4266-96d5-3efca9760b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:45.066035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523195d1-ca4f-4266-96d5-3efca9760b97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:45.066843 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523195d1-ca4f-4266-96d5-3efca9760b97 None admin] RBAC: Adding query filter params (interface=admin, service_id=d8e24c2cee254da38d2b520094b51045, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:45.067161 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523195d1-ca4f-4266-96d5-3efca9760b97 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:45.068538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523195d1-ca4f-4266-96d5-3efca9760b97 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:45.078709 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 500/988] 10.222.0.48 () {56 vars in 1249 bytes} [Mon Jul 25 12:02:44 2022] GET /identity/v3/endpoints?service_id=d8e24c2cee254da38d2b520094b51045&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:45.079961 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c9d17-5731-405c-972a-7a8c8ffd03f8 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:45.181143 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c9d17-5731-405c-972a-7a8c8ffd03f8 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:45.214655 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db03e3b-bd6f-475d-b684-6f56802c67d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:45.215305 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db03e3b-bd6f-475d-b684-6f56802c67d8 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:45.215583 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db03e3b-bd6f-475d-b684-6f56802c67d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:45.215854 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db03e3b-bd6f-475d-b684-6f56802c67d8 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:45.216590 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db03e3b-bd6f-475d-b684-6f56802c67d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:45.217936 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db03e3b-bd6f-475d-b684-6f56802c67d8 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:45.224238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 489/989] 10.222.0.48 () {56 vars in 1087 bytes} [Mon Jul 25 12:02:45 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:02:45.433889 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcf65e-1bba-4032-8b12-96745eab1bbb None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:45.434277 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcf65e-1bba-4032-8b12-96745eab1bbb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:45.434560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcf65e-1bba-4032-8b12-96745eab1bbb None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:45.436100 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 501/990] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:45.441426 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d32a3-d6a4-41dc-bde3-21518a1dfacb None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:45.441426 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d32a3-d6a4-41dc-bde3-21518a1dfacb None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:45.441735 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d32a3-d6a4-41dc-bde3-21518a1dfacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:45.460490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-c42d32a3-d6a4-41dc-bde3-21518a1dfacb None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:45.461731 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c42d32a3-d6a4-41dc-bde3-21518a1dfacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:45.475491 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:45.536917 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 490/991] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:45.560283 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcf65e-1bba-4032-8b12-96745eab1bbb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:45.607742 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:45.663293 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcf65e-1bba-4032-8b12-96745eab1bbb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:45.698115 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5492d-a56b-4f03-9f9e-873152fbf293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:45.698830 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5492d-a56b-4f03-9f9e-873152fbf293 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:45.699110 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5492d-a56b-4f03-9f9e-873152fbf293 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:45.699381 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5492d-a56b-4f03-9f9e-873152fbf293 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:45.700021 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5492d-a56b-4f03-9f9e-873152fbf293 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:45.701377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5492d-a56b-4f03-9f9e-873152fbf293 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:45.713165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-42b5492d-a56b-4f03-9f9e-873152fbf293 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 12:02:45.713165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:45.713165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:45.713165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:45.713165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:45.713165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:45.713165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:45.713165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:45.713165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 12:02:45.713165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:45.713165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:45.713165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:45.713165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:45.713165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:45.713165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:45.713165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:45.713165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:45.714697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:45.714697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:45.714697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:45.714697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:45.714697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:45.714697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:45.714697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:45.714697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:45.714697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:45.714697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:45.714697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:45.714697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:45.714697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:45.714697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:45.714697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:45.714697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:45.715550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:45.715550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:45.715550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:45.715550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:45.715550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:45.715550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:45.715550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:45.715550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:45.715550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:45.715550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:45.715550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:45.715550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:45.715550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 12:02:45.715550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:45.716927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 502/992] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:45.721054 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d32a3-d6a4-41dc-bde3-21518a1dfacb None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:45.820841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d32a3-d6a4-41dc-bde3-21518a1dfacb None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:45.855202 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e184bc-1929-4dc6-b880-89c0ef7e7acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:45.855905 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e184bc-1929-4dc6-b880-89c0ef7e7acd None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:45.856186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e184bc-1929-4dc6-b880-89c0ef7e7acd None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:45.856460 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e184bc-1929-4dc6-b880-89c0ef7e7acd None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:45.857164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e184bc-1929-4dc6-b880-89c0ef7e7acd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:45.857467 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e184bc-1929-4dc6-b880-89c0ef7e7acd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:45.858852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e184bc-1929-4dc6-b880-89c0ef7e7acd None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:45.868601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 491/993] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 12:02:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:45.869495 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5492d-a56b-4f03-9f9e-873152fbf293 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:45.969503 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5492d-a56b-4f03-9f9e-873152fbf293 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:45.978440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:46.004425 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07a621-dbc3-4073-817d-a3cacf957fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:46.005214 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07a621-dbc3-4073-817d-a3cacf957fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:46.005498 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07a621-dbc3-4073-817d-a3cacf957fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:46.005769 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07a621-dbc3-4073-817d-a3cacf957fe5 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:46.006498 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07a621-dbc3-4073-817d-a3cacf957fe5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:46.006802 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07a621-dbc3-4073-817d-a3cacf957fe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:46.008158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07a621-dbc3-4073-817d-a3cacf957fe5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:46.017624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 503/994] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 12:02:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:46.018903 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e184bc-1929-4dc6-b880-89c0ef7e7acd None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:46.030260 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:46.119067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e184bc-1929-4dc6-b880-89c0ef7e7acd None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:46.153368 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae03932-d5b3-4263-a878-704e763603d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:46.154330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae03932-d5b3-4263-a878-704e763603d8 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:46.154817 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae03932-d5b3-4263-a878-704e763603d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:46.155276 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae03932-d5b3-4263-a878-704e763603d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:46.156244 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae03932-d5b3-4263-a878-704e763603d8 None admin] RBAC: Adding query filter params (interface=public, service_id=ccc275695f884bdc8e46090e845dcd60, region_id=RegionOne) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:46.156729 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae03932-d5b3-4263-a878-704e763603d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:46.158408 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae03932-d5b3-4263-a878-704e763603d8 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:46.165162 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 492/995] 10.222.0.48 () {56 vars in 1251 bytes} [Mon Jul 25 12:02:46 2022] GET /identity/v3/endpoints?service_id=ccc275695f884bdc8e46090e845dcd60&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:46.170770 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07a621-dbc3-4073-817d-a3cacf957fe5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:46.271730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07a621-dbc3-4073-817d-a3cacf957fe5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:46.307582 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e0b82-605f-44d1-ac88-8039c3f86efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:46.308271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e0b82-605f-44d1-ac88-8039c3f86efe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:46.308551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e0b82-605f-44d1-ac88-8039c3f86efe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:46.308824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e0b82-605f-44d1-ac88-8039c3f86efe None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:46.309520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e0b82-605f-44d1-ac88-8039c3f86efe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:46.310981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e0b82-605f-44d1-ac88-8039c3f86efe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:46.318448 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 504/996] 10.222.0.48 () {56 vars in 1087 bytes} [Mon Jul 25 12:02:46 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:02:46.371801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58823c7a-cd96-4c6c-b376-cf6cb28a5459 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:46.372192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58823c7a-cd96-4c6c-b376-cf6cb28a5459 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:46.372589 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58823c7a-cd96-4c6c-b376-cf6cb28a5459 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:46.374345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 493/997] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:46.379940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5eb4a-7e5c-4e3c-b844-1a795e261eab None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:46.380242 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5eb4a-7e5c-4e3c-b844-1a795e261eab None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:46.380510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5eb4a-7e5c-4e3c-b844-1a795e261eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:46.400261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1fe5eb4a-7e5c-4e3c-b844-1a795e261eab None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:46.402083 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1fe5eb4a-7e5c-4e3c-b844-1a795e261eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:46.445444 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:46.491021 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 505/998] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:46.513707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58823c7a-cd96-4c6c-b376-cf6cb28a5459 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:46.584739 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:46.616025 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58823c7a-cd96-4c6c-b376-cf6cb28a5459 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:46.650731 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae95b60-31fd-40d4-a05b-ac4267b344d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:46.651541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae95b60-31fd-40d4-a05b-ac4267b344d5 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:46.651826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae95b60-31fd-40d4-a05b-ac4267b344d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:46.652098 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae95b60-31fd-40d4-a05b-ac4267b344d5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:46.652742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae95b60-31fd-40d4-a05b-ac4267b344d5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:46.654118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae95b60-31fd-40d4-a05b-ac4267b344d5 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:46.665611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-dae95b60-31fd-40d4-a05b-ac4267b344d5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 12:02:46.665611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:46.665611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:46.665611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:46.665611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:46.665611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:46.665611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:46.665611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:46.665611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 12:02:46.665611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:46.665611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:46.665611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:46.665611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:46.665611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:46.665611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:46.665611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:46.665611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:46.666789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:46.666789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:46.666789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:46.666789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:46.666789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:46.666789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:46.666789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:46.666789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:46.666789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:46.666789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:46.666789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:46.666789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:46.666789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:46.666789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:46.666789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:46.666789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:46.667665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:46.667665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:46.667665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:46.667665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:46.667665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:46.667665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:46.667665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:46.667665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:46.667665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:46.667665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:46.667665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:46.667665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:46.667665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 12:02:46.667665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:46.669215 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 494/999] 10.222.0.48 () {56 vars in 1105 bytes} [Mon Jul 25 12:02:46 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:46.673215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5eb4a-7e5c-4e3c-b844-1a795e261eab None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:46.772344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5eb4a-7e5c-4e3c-b844-1a795e261eab None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:46.809015 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eefc50-05dd-4298-96ff-3ac25d8f66b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:46.809688 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eefc50-05dd-4298-96ff-3ac25d8f66b6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:46.809972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eefc50-05dd-4298-96ff-3ac25d8f66b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:46.810279 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eefc50-05dd-4298-96ff-3ac25d8f66b6 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:46.810991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eefc50-05dd-4298-96ff-3ac25d8f66b6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:46.811300 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eefc50-05dd-4298-96ff-3ac25d8f66b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:46.812696 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eefc50-05dd-4298-96ff-3ac25d8f66b6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:46.822084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 506/1000] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:46.824306 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae95b60-31fd-40d4-a05b-ac4267b344d5 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:46.927047 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae95b60-31fd-40d4-a05b-ac4267b344d5 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:46.960473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a620666-524f-4592-8e44-309084944c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:46.961140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a620666-524f-4592-8e44-309084944c1d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:46.961424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a620666-524f-4592-8e44-309084944c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:46.961699 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a620666-524f-4592-8e44-309084944c1d None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:46.962422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a620666-524f-4592-8e44-309084944c1d None admin] RBAC: Adding query filter params (type=image) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:46.962731 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a620666-524f-4592-8e44-309084944c1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:46.964119 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a620666-524f-4592-8e44-309084944c1d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:46.966220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:46.970084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 495/1001] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:46 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:47.212181 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d274154-63fa-4046-a3a9-e085ddaeeddc None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:47.212669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d274154-63fa-4046-a3a9-e085ddaeeddc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:47.212669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d274154-63fa-4046-a3a9-e085ddaeeddc None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:47.214737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 507/1002] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:47.219672 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f0c6e-48c3-4ff0-8350-5978725526f6 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:47.220031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f0c6e-48c3-4ff0-8350-5978725526f6 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:47.220385 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f0c6e-48c3-4ff0-8350-5978725526f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:47.238957 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-bf1f0c6e-48c3-4ff0-8350-5978725526f6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:47.240133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-bf1f0c6e-48c3-4ff0-8350-5978725526f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:47.309493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 496/1003] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:47.331443 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d274154-63fa-4046-a3a9-e085ddaeeddc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:47.362890 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:47.435731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d274154-63fa-4046-a3a9-e085ddaeeddc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:47.476208 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe67fc-c08a-474c-8b9f-5b3b179f951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:47.477018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe67fc-c08a-474c-8b9f-5b3b179f951e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:47.477299 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe67fc-c08a-474c-8b9f-5b3b179f951e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:47.477571 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe67fc-c08a-474c-8b9f-5b3b179f951e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:47.478255 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe67fc-c08a-474c-8b9f-5b3b179f951e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:47.480201 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe67fc-c08a-474c-8b9f-5b3b179f951e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:47.492314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2bfe67fc-c08a-474c-8b9f-5b3b179f951e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:02:47.492314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:47.492314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:47.492314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:47.492314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:47.492314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:47.492314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:47.492314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:47.492314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:02:47.492314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:47.492314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:47.492314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:47.492314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:47.492314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:47.492314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:47.492314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:47.492314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:47.493253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:47.493253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:47.493253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:47.493253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:47.493253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:47.493253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:47.493253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:47.493253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:47.493253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:47.493253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:47.493253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:47.493253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:47.493253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:47.493253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:47.493253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:47.493253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:47.499249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:47.499249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:47.499249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:47.499249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:47.499249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:47.499249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:47.499249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:47.499249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:47.499249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:47.499249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:47.499249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:47.499249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:47.499249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:02:47.499249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:47.499249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 508/1004] 10.222.0.48 () {56 vars in 1126 bytes} [Mon Jul 25 12:02:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:47.501689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f0c6e-48c3-4ff0-8350-5978725526f6 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:47.602291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f0c6e-48c3-4ff0-8350-5978725526f6 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:47.631055 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:47.638062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8db63-18f1-4697-b5f8-43e1002a9017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:47.638732 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8db63-18f1-4697-b5f8-43e1002a9017 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:47.639020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8db63-18f1-4697-b5f8-43e1002a9017 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:47.639289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8db63-18f1-4697-b5f8-43e1002a9017 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:47.640003 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8db63-18f1-4697-b5f8-43e1002a9017 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:47.640308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8db63-18f1-4697-b5f8-43e1002a9017 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:47.641657 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8db63-18f1-4697-b5f8-43e1002a9017 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:47.646986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 497/1005] 10.222.0.48 () {56 vars in 1122 bytes} [Mon Jul 25 12:02:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:47.653098 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe67fc-c08a-474c-8b9f-5b3b179f951e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:47.746282 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:47.754062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe67fc-c08a-474c-8b9f-5b3b179f951e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:47.787698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caff06b-2dca-4164-9076-0daa59a8b976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:47.788360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caff06b-2dca-4164-9076-0daa59a8b976 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:47.788641 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caff06b-2dca-4164-9076-0daa59a8b976 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:47.788915 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caff06b-2dca-4164-9076-0daa59a8b976 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:47.789616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caff06b-2dca-4164-9076-0daa59a8b976 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:47.789921 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caff06b-2dca-4164-9076-0daa59a8b976 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:47.791317 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caff06b-2dca-4164-9076-0daa59a8b976 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:47.801060 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 509/1006] 10.222.0.48 () {56 vars in 1122 bytes} [Mon Jul 25 12:02:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:47.802301 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8db63-18f1-4697-b5f8-43e1002a9017 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:47.903195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8db63-18f1-4697-b5f8-43e1002a9017 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:47.937446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea8b48-ad69-4bf0-bff2-a35fad0a9fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:47.938143 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8b48-ad69-4bf0-bff2-a35fad0a9fbf None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:47.938454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8b48-ad69-4bf0-bff2-a35fad0a9fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:47.938737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8b48-ad69-4bf0-bff2-a35fad0a9fbf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:47.939487 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea8b48-ad69-4bf0-bff2-a35fad0a9fbf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:47.940831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea8b48-ad69-4bf0-bff2-a35fad0a9fbf None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:47.966046 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 498/1007] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:02:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:02:48.326263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab84b23-74c8-4f49-98e5-0e3e40c06ca2 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:48.326803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab84b23-74c8-4f49-98e5-0e3e40c06ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:48.326803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab84b23-74c8-4f49-98e5-0e3e40c06ca2 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:48.328211 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 510/1008] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:48.333265 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e3135-07ff-4b17-bf30-21f544f27376 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:48.333559 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e3135-07ff-4b17-bf30-21f544f27376 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:48.333835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e3135-07ff-4b17-bf30-21f544f27376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:48.351539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-631e3135-07ff-4b17-bf30-21f544f27376 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:48.352711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-631e3135-07ff-4b17-bf30-21f544f27376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:48.401910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:48.428726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 499/1009] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:48.450480 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab84b23-74c8-4f49-98e5-0e3e40c06ca2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:48.560317 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab84b23-74c8-4f49-98e5-0e3e40c06ca2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:48.597235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9690c4b-f8a1-4db3-88b5-d3f4c2a86e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:48.598009 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9690c4b-f8a1-4db3-88b5-d3f4c2a86e18 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:48.598298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9690c4b-f8a1-4db3-88b5-d3f4c2a86e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:48.598568 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9690c4b-f8a1-4db3-88b5-d3f4c2a86e18 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:48.599214 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9690c4b-f8a1-4db3-88b5-d3f4c2a86e18 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:48.600623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9690c4b-f8a1-4db3-88b5-d3f4c2a86e18 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:48.613029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e9690c4b-f8a1-4db3-88b5-d3f4c2a86e18 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 12:02:48.613029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:48.613029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:48.613029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:48.613029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:48.613029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:48.613029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:48.613029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:48.613029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 12:02:48.613029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:48.613029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:48.613029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:48.613029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:48.613029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:48.613029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:48.613029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:48.613029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:48.613975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:48.613975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:48.613975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:48.613975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:48.613975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:48.613975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:48.613975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:48.613975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:48.613975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:48.613975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:48.613975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:48.613975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:48.613975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:48.613975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:48.613975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:48.613975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:48.615111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:48.615111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:48.615111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:48.615111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:48.615111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:48.615111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:48.615111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:48.615111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:48.615111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:48.615111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:48.615111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:48.615111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:48.615111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 12:02:48.615111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:48.622094 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 511/1010] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:48.622236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e3135-07ff-4b17-bf30-21f544f27376 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:48.722892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e3135-07ff-4b17-bf30-21f544f27376 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:48.756359 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0996efa-6998-410c-82be-640a21ab9191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:48.757020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0996efa-6998-410c-82be-640a21ab9191 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:48.757301 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0996efa-6998-410c-82be-640a21ab9191 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:48.757575 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0996efa-6998-410c-82be-640a21ab9191 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:48.758305 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0996efa-6998-410c-82be-640a21ab9191 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:48.758611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0996efa-6998-410c-82be-640a21ab9191 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:48.759967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0996efa-6998-410c-82be-640a21ab9191 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:48.769273 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 500/1011] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 12:02:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:48.770332 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9690c4b-f8a1-4db3-88b5-d3f4c2a86e18 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:48.795916 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:48.870315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9690c4b-f8a1-4db3-88b5-d3f4c2a86e18 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:48.902624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20887849-723a-4b0b-b442-154a6cdaa9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:48.903284 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20887849-723a-4b0b-b442-154a6cdaa9cb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:48.903563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20887849-723a-4b0b-b442-154a6cdaa9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:48.903834 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20887849-723a-4b0b-b442-154a6cdaa9cb None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:48.904556 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20887849-723a-4b0b-b442-154a6cdaa9cb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:48.904824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20887849-723a-4b0b-b442-154a6cdaa9cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:48.906229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20887849-723a-4b0b-b442-154a6cdaa9cb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:48.915581 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 512/1012] 10.222.0.48 () {56 vars in 1112 bytes} [Mon Jul 25 12:02:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:48.917379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0996efa-6998-410c-82be-640a21ab9191 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:48.962766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:48.981358 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d581859-aaa4-481a-be0d-4368c47e7302 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:48.981653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d581859-aaa4-481a-be0d-4368c47e7302 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:48.981935 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d581859-aaa4-481a-be0d-4368c47e7302 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:48.983491 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 513/1013] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:02:48.988048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed0fb6-42be-4f5f-a665-b693670ae698 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:48.988337 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed0fb6-42be-4f5f-a665-b693670ae698 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:48.988617 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed0fb6-42be-4f5f-a665-b693670ae698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:49.006603 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f8ed0fb6-42be-4f5f-a665-b693670ae698 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:49.007908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f8ed0fb6-42be-4f5f-a665-b693670ae698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:49.019789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0996efa-6998-410c-82be-640a21ab9191 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:49.054178 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bc881-9bc5-4869-b9c9-3481df0873bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:49.055030 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bc881-9bc5-4869-b9c9-3481df0873bd None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:49.055149 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bc881-9bc5-4869-b9c9-3481df0873bd None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:49.055375 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bc881-9bc5-4869-b9c9-3481df0873bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:49.056127 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bc881-9bc5-4869-b9c9-3481df0873bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:49.057674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bc881-9bc5-4869-b9c9-3481df0873bd None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:49.081742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 501/1014] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:02:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:02:49.097856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 514/1015] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:48 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:02:49.120069 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bc881-9bc5-4869-b9c9-3481df0873bd None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:49.225463 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:49.230088 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bc881-9bc5-4869-b9c9-3481df0873bd None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:49.269071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60322a-99fd-43db-95d2-b27cd387a214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:49.269744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60322a-99fd-43db-95d2-b27cd387a214 None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:49.270057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60322a-99fd-43db-95d2-b27cd387a214 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:49.270342 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60322a-99fd-43db-95d2-b27cd387a214 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:49.271079 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60322a-99fd-43db-95d2-b27cd387a214 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:49.272454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60322a-99fd-43db-95d2-b27cd387a214 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:49.290555 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 502/1016] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 12:02:49 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:02:49.966165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196564df-dade-4979-a6aa-2f49f96a2bd2 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:49.966683 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196564df-dade-4979-a6aa-2f49f96a2bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:49.966791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196564df-dade-4979-a6aa-2f49f96a2bd2 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:49.968250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 515/1017] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:49.973098 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585594b3-92fd-46af-94da-27cdc027d6e4 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:49.973465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585594b3-92fd-46af-94da-27cdc027d6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:49.973655 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585594b3-92fd-46af-94da-27cdc027d6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:49.992612 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-585594b3-92fd-46af-94da-27cdc027d6e4 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:49.993796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-585594b3-92fd-46af-94da-27cdc027d6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:50.065048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 503/1018] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:50.086905 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196564df-dade-4979-a6aa-2f49f96a2bd2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:50.101408 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:50.189135 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196564df-dade-4979-a6aa-2f49f96a2bd2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:50.221976 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722c947-27d0-43df-9fb4-6539c80f35fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:50.222784 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722c947-27d0-43df-9fb4-6539c80f35fe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:50.223063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722c947-27d0-43df-9fb4-6539c80f35fe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:50.223331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722c947-27d0-43df-9fb4-6539c80f35fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:50.224498 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722c947-27d0-43df-9fb4-6539c80f35fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:50.225945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722c947-27d0-43df-9fb4-6539c80f35fe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:50.227781 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 516/1019] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:50.233290 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585594b3-92fd-46af-94da-27cdc027d6e4 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:50.315842 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:50.334913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585594b3-92fd-46af-94da-27cdc027d6e4 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:50.368705 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786ee41-14a9-4030-a950-faf34d84b480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:50.369365 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786ee41-14a9-4030-a950-faf34d84b480 None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:50.370193 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786ee41-14a9-4030-a950-faf34d84b480 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:50.370474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786ee41-14a9-4030-a950-faf34d84b480 None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:50.371204 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786ee41-14a9-4030-a950-faf34d84b480 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:50.372625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786ee41-14a9-4030-a950-faf34d84b480 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:50.404473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 504/1020] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 12:02:50 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:02:51.274840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5e99a-9726-48cc-8222-1ce74bfbe9e9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:51.275357 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5e99a-9726-48cc-8222-1ce74bfbe9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:51.275468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5e99a-9726-48cc-8222-1ce74bfbe9e9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:51.276840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 517/1021] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:51.281878 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005ada3-d303-4034-b1d2-616843b12b2d None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:51.282279 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005ada3-d303-4034-b1d2-616843b12b2d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:51.282474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005ada3-d303-4034-b1d2-616843b12b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:51.300744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-8005ada3-d303-4034-b1d2-616843b12b2d None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:51.301933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-8005ada3-d303-4034-b1d2-616843b12b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:51.330341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836e374-9684-4bf6-ab65-892cfc3d4f7b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:51.330633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836e374-9684-4bf6-ab65-892cfc3d4f7b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:51.330913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836e374-9684-4bf6-ab65-892cfc3d4f7b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:51.332421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 518/1022] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:02:51.336949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f717c-97aa-44ff-8235-befa259c1f20 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:51.337233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f717c-97aa-44ff-8235-befa259c1f20 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:51.337518 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f717c-97aa-44ff-8235-befa259c1f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:51.356198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-806f717c-97aa-44ff-8235-befa259c1f20 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:51.357397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-806f717c-97aa-44ff-8235-befa259c1f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:51.376518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 505/1023] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:51.399637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005ada3-d303-4034-b1d2-616843b12b2d None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:51.430527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 519/1024] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:02:51.453936 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f717c-97aa-44ff-8235-befa259c1f20 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:51.467377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:51.476421 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:51.512090 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005ada3-d303-4034-b1d2-616843b12b2d None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:51.546203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4e167-e52d-4e94-b24b-002d689819c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:51.546958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4e167-e52d-4e94-b24b-002d689819c7 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:51.547212 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4e167-e52d-4e94-b24b-002d689819c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:51.547480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4e167-e52d-4e94-b24b-002d689819c7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:51.559529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4e167-e52d-4e94-b24b-002d689819c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:51.567851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-dff4e167-e52d-4e94-b24b-002d689819c7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:02:51.567851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:51.567851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:51.567851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:51.567851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:51.567851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:51.567851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:51.567851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:51.567851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:51.567851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:51.567851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:51.567851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:51.567851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:51.567851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:51.567851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:51.567851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:51.569065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:51.569065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:51.569065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:51.569065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:51.569065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:51.569065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:51.569065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:51.569065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:51.569065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:51.569065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:51.569065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:51.569065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:51.569065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:51.569065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:51.569065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:51.569065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:51.569885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:51.569885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:51.569885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:51.569885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:51.569885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:51.569885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:51.569885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:51.569885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:51.569885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:51.569885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:51.569885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:02:51.569885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:51.569885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 506/1025] 10.222.0.48 () {56 vars in 1120 bytes} [Mon Jul 25 12:02:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:51.571976 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f717c-97aa-44ff-8235-befa259c1f20 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:51.574913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4e167-e52d-4e94-b24b-002d689819c7 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:51.611492 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458da7b-970c-40c4-b7d4-b3bb11902d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:51.612379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458da7b-970c-40c4-b7d4-b3bb11902d52 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:51.612656 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458da7b-970c-40c4-b7d4-b3bb11902d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:51.613042 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458da7b-970c-40c4-b7d4-b3bb11902d52 None admin] PATH_INFO: `/v3/services/image` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:51.613687 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458da7b-970c-40c4-b7d4-b3bb11902d52 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:51.615080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458da7b-970c-40c4-b7d4-b3bb11902d52 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:51.628215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7458da7b-970c-40c4-b7d4-b3bb11902d52 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 12:02:51.628215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:51.628215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:51.628215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:51.628215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:51.628215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:51.628215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:51.628215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:51.628215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 12:02:51.628215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:51.628215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:51.628215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:51.628215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:51.628215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:51.628215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:51.628215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:51.628215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:51.629241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:51.629241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:51.629241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:51.629241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:51.629241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:51.629241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:51.629241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:51.629241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:51.629241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:51.629241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:51.629241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:51.629241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:51.629241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:51.629241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:51.629241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:51.629241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:51.630760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:51.630760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:51.630760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:51.630760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:51.630760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:51.630760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:51.630760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:51.630760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:51.630760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:51.630760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:51.630760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:51.630760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:51.630760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 12:02:51.630760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:51.630760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 520/1026] 10.222.0.48 () {56 vars in 1105 bytes} [Mon Jul 25 12:02:51 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:51.635355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458da7b-970c-40c4-b7d4-b3bb11902d52 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:51.686967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4e167-e52d-4e94-b24b-002d689819c7 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:51.710640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:51.718724 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:51.727624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f732bed-a023-430d-87b8-040e228350fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:51.728374 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f732bed-a023-430d-87b8-040e228350fc None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:51.728573 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f732bed-a023-430d-87b8-040e228350fc None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:51.728849 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f732bed-a023-430d-87b8-040e228350fc None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:51.730192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f732bed-a023-430d-87b8-040e228350fc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:51.730503 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f732bed-a023-430d-87b8-040e228350fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:51.731867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f732bed-a023-430d-87b8-040e228350fc None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:51.740991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 507/1027] 10.222.0.48 () {56 vars in 1115 bytes} [Mon Jul 25 12:02:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:51.741366 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458da7b-970c-40c4-b7d4-b3bb11902d52 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:51.746608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f732bed-a023-430d-87b8-040e228350fc None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:51.779869 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9492fc2-0709-4848-a6e0-c5f7b468d715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:51.780797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9492fc2-0709-4848-a6e0-c5f7b468d715 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:51.781083 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9492fc2-0709-4848-a6e0-c5f7b468d715 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:51.781361 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9492fc2-0709-4848-a6e0-c5f7b468d715 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:51.782101 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9492fc2-0709-4848-a6e0-c5f7b468d715 None admin] RBAC: Adding query filter params (name=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:51.782412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9492fc2-0709-4848-a6e0-c5f7b468d715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:51.783785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9492fc2-0709-4848-a6e0-c5f7b468d715 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:51.788739 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 521/1028] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:51.796011 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9492fc2-0709-4848-a6e0-c5f7b468d715 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:51.859231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f732bed-a023-430d-87b8-040e228350fc None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:51.891627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad07b6e-7da9-4684-b7ca-fc68f4b91ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:51.892410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad07b6e-7da9-4684-b7ca-fc68f4b91ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:51.892691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad07b6e-7da9-4684-b7ca-fc68f4b91ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:51.892960 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad07b6e-7da9-4684-b7ca-fc68f4b91ed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:51.902188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9492fc2-0709-4848-a6e0-c5f7b468d715 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:51.904365 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad07b6e-7da9-4684-b7ca-fc68f4b91ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:51.905823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad07b6e-7da9-4684-b7ca-fc68f4b91ed7 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:51.923256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-0ad07b6e-7da9-4684-b7ca-fc68f4b91ed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:51.923256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:51.923256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:51.923256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:51.923256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:51.923256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:51.923256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:51.923256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:51.923256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:51.923256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:51.923256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:51.923256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:51.923256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:51.923256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:51.923256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:51.924227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:51.924227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:51.924227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:51.924227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:51.924227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:51.924227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:51.924227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:51.924227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:51.924227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:51.924227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:51.924227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:51.924227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:51.924227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:51.924227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:51.924227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:51.924227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:51.924227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:51.929872 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:51.929872 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:51.929872 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:51.929872 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:51.929872 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 508/1029] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:51.930413 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad07b6e-7da9-4684-b7ca-fc68f4b91ed7 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:51.939190 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0583ad-d8ac-48e3-8c51-667fe19777d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:51.940239 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0583ad-d8ac-48e3-8c51-667fe19777d4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:51.940520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0583ad-d8ac-48e3-8c51-667fe19777d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:51.940792 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0583ad-d8ac-48e3-8c51-667fe19777d4 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:51.941855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0583ad-d8ac-48e3-8c51-667fe19777d4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:51.942192 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0583ad-d8ac-48e3-8c51-667fe19777d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:51.943893 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0583ad-d8ac-48e3-8c51-667fe19777d4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:51.950333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 522/1030] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:51.956235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0583ad-d8ac-48e3-8c51-667fe19777d4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:51.958865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:51.980546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:52.038424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad07b6e-7da9-4684-b7ca-fc68f4b91ed7 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:52.064322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0583ad-d8ac-48e3-8c51-667fe19777d4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:52.076253 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a4bb4-af59-457f-8a4d-e86233e86edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:52.076925 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a4bb4-af59-457f-8a4d-e86233e86edf None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:52.077202 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a4bb4-af59-457f-8a4d-e86233e86edf None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:52.077472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a4bb4-af59-457f-8a4d-e86233e86edf None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:52.078226 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a4bb4-af59-457f-8a4d-e86233e86edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:52.078530 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a4bb4-af59-457f-8a4d-e86233e86edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:52.079888 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a4bb4-af59-457f-8a4d-e86233e86edf None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:52.097094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 509/1031] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:52.098352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a4bb4-af59-457f-8a4d-e86233e86edf None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:52.103515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8588c-540e-44db-b091-79490bd78358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:52.104175 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8588c-540e-44db-b091-79490bd78358 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:52.104452 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8588c-540e-44db-b091-79490bd78358 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:52.104756 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8588c-540e-44db-b091-79490bd78358 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:52.105548 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8588c-540e-44db-b091-79490bd78358 None admin] RBAC: Adding query filter params (interface=public, service_id=cd22a275f0e94a1b912cf5fffeeec6a0, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:52.105855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8588c-540e-44db-b091-79490bd78358 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:52.107258 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8588c-540e-44db-b091-79490bd78358 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:52.112809 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 523/1032] 10.222.0.48 () {56 vars in 1251 bytes} [Mon Jul 25 12:02:51 2022] GET /identity/v3/endpoints?service_id=cd22a275f0e94a1b912cf5fffeeec6a0&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:52.118464 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8588c-540e-44db-b091-79490bd78358 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:52.187397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:52.214810 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a4bb4-af59-457f-8a4d-e86233e86edf None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:52.216577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:52.226416 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8588c-540e-44db-b091-79490bd78358 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:52.257310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fd5d6-77be-4e42-8d2d-7c3f8897b1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:52.258126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fd5d6-77be-4e42-8d2d-7c3f8897b1dc None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:52.258410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fd5d6-77be-4e42-8d2d-7c3f8897b1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:52.258881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fd5d6-77be-4e42-8d2d-7c3f8897b1dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:52.264133 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d636fc-3eed-4608-9795-47be79b86ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:52.264791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d636fc-3eed-4608-9795-47be79b86ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:52.265070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d636fc-3eed-4608-9795-47be79b86ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:52.265344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d636fc-3eed-4608-9795-47be79b86ac0 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:52.266027 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d636fc-3eed-4608-9795-47be79b86ac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:52.266556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fd5d6-77be-4e42-8d2d-7c3f8897b1dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:52.267432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d636fc-3eed-4608-9795-47be79b86ac0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:52.267966 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fd5d6-77be-4e42-8d2d-7c3f8897b1dc None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:52.274216 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 524/1033] 10.222.0.48 () {56 vars in 1087 bytes} [Mon Jul 25 12:02:52 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:02:52.283819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-220fd5d6-77be-4e42-8d2d-7c3f8897b1dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:02:52.283819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:52.283819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:52.283819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:52.283819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:52.283819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:52.283819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:52.283819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:52.283819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:52.283819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:52.283819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:52.283819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:52.283819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:52.283819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:52.283819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:52.283819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:52.290221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:52.290221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:52.290221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:52.290221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:52.290221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:52.290221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:52.290221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:52.290221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:52.290221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:52.290221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:52.290221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:52.290221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:52.290221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:52.290221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:52.290221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:52.290221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:52.290221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:52.290221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:52.291527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:52.291527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:52.291527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:52.291527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:52.291527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:52.291527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:52.291527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:52.291527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:52.291527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:02:52.291527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:52.291527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 510/1034] 10.222.0.48 () {56 vars in 1093 bytes} [Mon Jul 25 12:02:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:52.292263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d636fc-3eed-4608-9795-47be79b86ac0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:52.406874 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d636fc-3eed-4608-9795-47be79b86ac0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:52.440012 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:52.447120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3bdf5-da40-4263-b6ab-03da20d7db3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:52.448339 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3bdf5-da40-4263-b6ab-03da20d7db3b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:52.448633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3bdf5-da40-4263-b6ab-03da20d7db3b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:52.448906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3bdf5-da40-4263-b6ab-03da20d7db3b None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:52.449752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3bdf5-da40-4263-b6ab-03da20d7db3b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:52.450091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3bdf5-da40-4263-b6ab-03da20d7db3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:52.451522 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3bdf5-da40-4263-b6ab-03da20d7db3b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:52.468881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c637cdb-f6fe-4c66-bf05-a8cf33c0c67a None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:52.469194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c637cdb-f6fe-4c66-bf05-a8cf33c0c67a None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:52.469886 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c637cdb-f6fe-4c66-bf05-a8cf33c0c67a None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:52.469968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 525/1035] 10.222.0.48 () {56 vars in 1133 bytes} [Mon Jul 25 12:02:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:52.470864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 511/1036] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:02:52.475324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3bdf5-da40-4263-b6ab-03da20d7db3b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:52.476271 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db03ee-e0ca-4997-ac74-195d223b8aee None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:52.476555 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db03ee-e0ca-4997-ac74-195d223b8aee None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:52.476824 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db03ee-e0ca-4997-ac74-195d223b8aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:52.494285 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-77db03ee-e0ca-4997-ac74-195d223b8aee None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:52.495992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-77db03ee-e0ca-4997-ac74-195d223b8aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:52.563765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 512/1037] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:52.587953 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db03ee-e0ca-4997-ac74-195d223b8aee None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:52.589260 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3bdf5-da40-4263-b6ab-03da20d7db3b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:52.626087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056a9be-61c4-4e3b-8701-9d1334bf0911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:52.626734 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056a9be-61c4-4e3b-8701-9d1334bf0911 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:52.627014 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056a9be-61c4-4e3b-8701-9d1334bf0911 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:52.627284 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056a9be-61c4-4e3b-8701-9d1334bf0911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:52.683782 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:52.684319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:52.694356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db03ee-e0ca-4997-ac74-195d223b8aee None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:52.698745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056a9be-61c4-4e3b-8701-9d1334bf0911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:52.700205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056a9be-61c4-4e3b-8701-9d1334bf0911 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:52.728732 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27724691-3055-49ca-b1df-8a16721ee5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:52.729572 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27724691-3055-49ca-b1df-8a16721ee5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:52.729853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27724691-3055-49ca-b1df-8a16721ee5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:52.730188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27724691-3055-49ca-b1df-8a16721ee5c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:52.731380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27724691-3055-49ca-b1df-8a16721ee5c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:52.732807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27724691-3055-49ca-b1df-8a16721ee5c6 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:52.734633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 513/1038] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:52.739972 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27724691-3055-49ca-b1df-8a16721ee5c6 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:52.806142 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 526/1039] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:02:52 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:02:52.812387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056a9be-61c4-4e3b-8701-9d1334bf0911 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:52.843656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27724691-3055-49ca-b1df-8a16721ee5c6 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:52.881790 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd9fc3-1843-491d-9490-9f7cf4b5dd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:52.882478 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd9fc3-1843-491d-9490-9f7cf4b5dd74 None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:52.882761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd9fc3-1843-491d-9490-9f7cf4b5dd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:52.883033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd9fc3-1843-491d-9490-9f7cf4b5dd74 None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:52.883736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd9fc3-1843-491d-9490-9f7cf4b5dd74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:52.885138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd9fc3-1843-491d-9490-9f7cf4b5dd74 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:52.902529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:52.918035 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 514/1040] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 12:02:52 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:02:52.926660 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056a9be-61c4-4e3b-8701-9d1334bf0911 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:52.966619 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfde2d-2647-4bfb-afe7-ef930e3c821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:52.967464 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfde2d-2647-4bfb-afe7-ef930e3c821f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:52.967799 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfde2d-2647-4bfb-afe7-ef930e3c821f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:52.968076 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfde2d-2647-4bfb-afe7-ef930e3c821f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:52.980503 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfde2d-2647-4bfb-afe7-ef930e3c821f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:52.982100 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfde2d-2647-4bfb-afe7-ef930e3c821f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:53.003099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-50dfde2d-2647-4bfb-afe7-ef930e3c821f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:53.003099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:53.003099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:53.003099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:53.003099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:53.003099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:53.003099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:53.003099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:53.003099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:53.003099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:53.003099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:53.003099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:53.003099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:53.003099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:53.003099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:53.004486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:53.004486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:53.004486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:53.004486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:53.004486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:53.004486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:53.004486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:53.004486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:53.004486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:53.004486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:53.004486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:53.004486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:53.004486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:53.004486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:53.004486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:53.004486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:53.004486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:53.005383 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:53.005383 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:53.005383 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:53.005383 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:53.009285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 527/1041] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:53.010695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd9fc3-1843-491d-9490-9f7cf4b5dd74 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:53.030804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:53.123247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd9fc3-1843-491d-9490-9f7cf4b5dd74 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:53.158920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68727862-6386-4dcd-96af-ea03af04ee22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:53.159597 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68727862-6386-4dcd-96af-ea03af04ee22 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:53.159881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68727862-6386-4dcd-96af-ea03af04ee22 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:53.160356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68727862-6386-4dcd-96af-ea03af04ee22 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:53.160936 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68727862-6386-4dcd-96af-ea03af04ee22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:53.161233 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68727862-6386-4dcd-96af-ea03af04ee22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:53.162665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68727862-6386-4dcd-96af-ea03af04ee22 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:53.178093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 515/1042] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:53.181541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfde2d-2647-4bfb-afe7-ef930e3c821f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:53.282049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfde2d-2647-4bfb-afe7-ef930e3c821f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:53.315503 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76667f41-8a3c-4a3e-a1d0-d1a66bb1b4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:53.316296 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76667f41-8a3c-4a3e-a1d0-d1a66bb1b4fd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:53.316577 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76667f41-8a3c-4a3e-a1d0-d1a66bb1b4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:53.316847 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76667f41-8a3c-4a3e-a1d0-d1a66bb1b4fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:53.323708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76667f41-8a3c-4a3e-a1d0-d1a66bb1b4fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:53.325169 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76667f41-8a3c-4a3e-a1d0-d1a66bb1b4fd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:53.327696 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:53.341168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-76667f41-8a3c-4a3e-a1d0-d1a66bb1b4fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:53.341168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:53.341168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:53.341168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:53.341168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:53.341168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:53.341168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:53.341168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:53.341168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:53.341168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:53.341168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:53.341168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:53.341168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:53.341168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:53.341168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:53.342269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:53.342269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:53.342269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:53.342269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:53.342269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:53.342269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:53.342269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:53.342269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:53.342269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:53.342269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:53.342269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:53.342269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:53.342269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:53.342269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:53.342269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:53.342269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:53.342269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:53.343319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:53.343319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:53.343319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:53.343319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:53.343319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:53.343319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:53.343319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:53.343319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:53.345611 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 528/1043] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:53.351150 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68727862-6386-4dcd-96af-ea03af04ee22 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:53.432728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:53.461089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68727862-6386-4dcd-96af-ea03af04ee22 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:53.500767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf0e7a-0a97-4344-a34e-d115ea19a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:53.501418 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf0e7a-0a97-4344-a34e-d115ea19a1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:53.501696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf0e7a-0a97-4344-a34e-d115ea19a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:53.501963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf0e7a-0a97-4344-a34e-d115ea19a1a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:53.502826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf0e7a-0a97-4344-a34e-d115ea19a1a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:53.503132 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf0e7a-0a97-4344-a34e-d115ea19a1a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:53.504648 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf0e7a-0a97-4344-a34e-d115ea19a1a0 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:53.516280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 516/1044] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:53.522057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76667f41-8a3c-4a3e-a1d0-d1a66bb1b4fd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:53.621018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76667f41-8a3c-4a3e-a1d0-d1a66bb1b4fd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:53.655047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f1b5d-9338-43dd-bc13-9d3f493d28a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:53.656003 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f1b5d-9338-43dd-bc13-9d3f493d28a6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:53.656483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f1b5d-9338-43dd-bc13-9d3f493d28a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:53.656932 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f1b5d-9338-43dd-bc13-9d3f493d28a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:53.657934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f1b5d-9338-43dd-bc13-9d3f493d28a6 None admin] RBAC: Adding query filter params (role.id=85d086a755ed46078be507e4a3b3c9a8, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=6d9db26891a04b0bb7e655c21feeffdd) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:53.658419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f1b5d-9338-43dd-bc13-9d3f493d28a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:53.659983 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f1b5d-9338-43dd-bc13-9d3f493d28a6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:53.666145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 529/1045] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:02:53 2022] GET /identity/v3/role_assignments?user.id=6d9db26891a04b0bb7e655c21feeffdd&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=85d086a755ed46078be507e4a3b3c9a8 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:54.305814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782017c0-e752-4d0f-8790-7c48e8067449 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:54.306130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782017c0-e752-4d0f-8790-7c48e8067449 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:54.306408 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782017c0-e752-4d0f-8790-7c48e8067449 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:54.308313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 517/1046] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:54.313399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de6ea9-c7ca-4cc1-be1c-38b72682729d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:54.313693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de6ea9-c7ca-4cc1-be1c-38b72682729d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:54.313971 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de6ea9-c7ca-4cc1-be1c-38b72682729d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:54.332422 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-12de6ea9-c7ca-4cc1-be1c-38b72682729d None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:54.333601 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-12de6ea9-c7ca-4cc1-be1c-38b72682729d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:54.394146 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:54.403645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 530/1047] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:02:54.426689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782017c0-e752-4d0f-8790-7c48e8067449 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:54.530711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782017c0-e752-4d0f-8790-7c48e8067449 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:54.565256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5fcda-5f07-4c83-8421-80e6a1de5b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:54.565968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5fcda-5f07-4c83-8421-80e6a1de5b7c None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:54.566283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5fcda-5f07-4c83-8421-80e6a1de5b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:54.566558 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5fcda-5f07-4c83-8421-80e6a1de5b7c None admin] PATH_INFO: `/v3/services/image` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:54.567206 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5fcda-5f07-4c83-8421-80e6a1de5b7c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:54.568556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5fcda-5f07-4c83-8421-80e6a1de5b7c None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:54.571196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:54.581684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-7ac5fcda-5f07-4c83-8421-80e6a1de5b7c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 12:02:54.581684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:54.581684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:02:54.581684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:02:54.581684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:02:54.581684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:02:54.581684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:02:54.581684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:54.581684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 12:02:54.581684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:54.581684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:02:54.581684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:54.581684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:54.581684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:54.581684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:54.581684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:54.581684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:54.582822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:54.582822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:54.582822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:54.582822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:54.582822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:54.582822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:54.582822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:02:54.582822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:02:54.582822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:02:54.582822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:02:54.582822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:54.582822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:54.582822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:54.582822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:54.582822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:54.582822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:54.583647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:54.583647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:54.583647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:54.583647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:54.583647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:54.583647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:54.583647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:54.583647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:54.583647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:54.583647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:54.583647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:02:54.583647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:02:54.583647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 12:02:54.583647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:54.586164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 518/1048] 10.222.0.48 () {56 vars in 1105 bytes} [Mon Jul 25 12:02:54 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:54.588921 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de6ea9-c7ca-4cc1-be1c-38b72682729d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:54.690904 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de6ea9-c7ca-4cc1-be1c-38b72682729d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:54.724967 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04c1ff-25d4-4a6b-a999-1364e8baab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:54.725642 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04c1ff-25d4-4a6b-a999-1364e8baab10 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:54.725926 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04c1ff-25d4-4a6b-a999-1364e8baab10 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:54.726232 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04c1ff-25d4-4a6b-a999-1364e8baab10 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:54.726945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04c1ff-25d4-4a6b-a999-1364e8baab10 None admin] RBAC: Adding query filter params (name=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:54.727425 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04c1ff-25d4-4a6b-a999-1364e8baab10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:54.728800 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04c1ff-25d4-4a6b-a999-1364e8baab10 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:54.738988 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 531/1049] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:54.740266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5fcda-5f07-4c83-8421-80e6a1de5b7c None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:54.844736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5fcda-5f07-4c83-8421-80e6a1de5b7c None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:54.878130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73eb7c-af56-4a17-80f8-1e6b44c7278b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:54.878823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73eb7c-af56-4a17-80f8-1e6b44c7278b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:54.879108 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73eb7c-af56-4a17-80f8-1e6b44c7278b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:54.879384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73eb7c-af56-4a17-80f8-1e6b44c7278b None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:54.880090 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73eb7c-af56-4a17-80f8-1e6b44c7278b None admin] RBAC: Adding query filter params (type=image) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:54.880394 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73eb7c-af56-4a17-80f8-1e6b44c7278b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:54.881741 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73eb7c-af56-4a17-80f8-1e6b44c7278b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:54.886811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 519/1050] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:54.892247 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04c1ff-25d4-4a6b-a999-1364e8baab10 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:54.941564 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e65f19-92ac-4249-a1ab-4d9e75dcbbd8 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:54.941889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e65f19-92ac-4249-a1ab-4d9e75dcbbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:54.942148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e65f19-92ac-4249-a1ab-4d9e75dcbbd8 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:54.943743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 520/1051] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:02:54.948783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec30b7-3d10-408b-8172-d279def921e6 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:54.949102 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec30b7-3d10-408b-8172-d279def921e6 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:54.949398 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec30b7-3d10-408b-8172-d279def921e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:54.955697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:54.967731 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-ffec30b7-3d10-408b-8172-d279def921e6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:54.968904 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ffec30b7-3d10-408b-8172-d279def921e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:54.998709 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04c1ff-25d4-4a6b-a999-1364e8baab10 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:55.033171 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:55.033970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853e67b-2706-430b-af11-a6184d59c496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:55.034647 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853e67b-2706-430b-af11-a6184d59c496 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:55.034927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853e67b-2706-430b-af11-a6184d59c496 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:55.035198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853e67b-2706-430b-af11-a6184d59c496 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:55.036034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853e67b-2706-430b-af11-a6184d59c496 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:55.037304 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853e67b-2706-430b-af11-a6184d59c496 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:55.043983 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 521/1052] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:02:55.062408 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 532/1053] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:02:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:02:55.071608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec30b7-3d10-408b-8172-d279def921e6 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:55.183548 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec30b7-3d10-408b-8172-d279def921e6 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:55.228215 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74223530-0075-48b7-8870-e4bd01f33506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:55.229533 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74223530-0075-48b7-8870-e4bd01f33506 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:55.229820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74223530-0075-48b7-8870-e4bd01f33506 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:55.230127 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74223530-0075-48b7-8870-e4bd01f33506 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:55.241399 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74223530-0075-48b7-8870-e4bd01f33506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:55.249681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-74223530-0075-48b7-8870-e4bd01f33506 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:02:55.249681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:55.249681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:55.249681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:55.249681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:55.249681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:55.249681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:55.249681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:55.249681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:55.249681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:55.249681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:55.249681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:55.249681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:55.249681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:55.249681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:55.249681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:55.250685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:55.250685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:55.250685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:55.250685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:55.250685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:55.250685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:55.250685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:55.250685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:55.250685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:55.250685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:55.250685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:55.250685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:55.250685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:55.250685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:55.250685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:55.250685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:55.251515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:55.251515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:55.251515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:55.251515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:55.251515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:55.251515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:55.251515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:55.251515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:55.251515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:55.251515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:55.251515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:02:55.251515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:55.251515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 522/1054] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:02:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:55.256914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853e67b-2706-430b-af11-a6184d59c496 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:55.358996 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853e67b-2706-430b-af11-a6184d59c496 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:55.373159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:55.394492 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b5436-9a79-4ae7-b63d-3296e2c853d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:55.395162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b5436-9a79-4ae7-b63d-3296e2c853d5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:55.395438 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b5436-9a79-4ae7-b63d-3296e2c853d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:55.395706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b5436-9a79-4ae7-b63d-3296e2c853d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:55.396440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b5436-9a79-4ae7-b63d-3296e2c853d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:55.396745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b5436-9a79-4ae7-b63d-3296e2c853d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:55.398145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b5436-9a79-4ae7-b63d-3296e2c853d5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:55.407107 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 533/1055] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:02:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:55.412980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74223530-0075-48b7-8870-e4bd01f33506 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:55.467971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:55.520097 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74223530-0075-48b7-8870-e4bd01f33506 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:55.558130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67f242-7a51-403b-aad6-8df3471bd0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:55.559000 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67f242-7a51-403b-aad6-8df3471bd0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:55.559277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67f242-7a51-403b-aad6-8df3471bd0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:55.559557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67f242-7a51-403b-aad6-8df3471bd0f7 None admin] PATH_INFO: `/v3/users/92551af353124f8dad9e18da5aa10fd8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:55.573002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67f242-7a51-403b-aad6-8df3471bd0f7 None admin] RBAC: Authorizing `identity:get_user(user_id=92551af353124f8dad9e18da5aa10fd8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:55.574465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67f242-7a51-403b-aad6-8df3471bd0f7 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:55.580867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 523/1056] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:02:55 2022] GET /identity/v3/users/92551af353124f8dad9e18da5aa10fd8 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:55.581987 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b5436-9a79-4ae7-b63d-3296e2c853d5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:55.665099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3c743-c3dc-4e8c-a86b-14c074b2e4f4 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:55.665385 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3c743-c3dc-4e8c-a86b-14c074b2e4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:55.665655 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3c743-c3dc-4e8c-a86b-14c074b2e4f4 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:55.667836 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 524/1057] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:02:55.672757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619afc2-0518-4b18-9af8-356464933ff0 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:55.673135 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619afc2-0518-4b18-9af8-356464933ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:55.673323 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619afc2-0518-4b18-9af8-356464933ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:55.683779 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b5436-9a79-4ae7-b63d-3296e2c853d5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:55.691647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-7619afc2-0518-4b18-9af8-356464933ff0 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:55.692533 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-7619afc2-0518-4b18-9af8-356464933ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:55.720198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e1936-ba05-4a44-a76a-04934c2b3734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:55.720856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e1936-ba05-4a44-a76a-04934c2b3734 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:55.721138 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e1936-ba05-4a44-a76a-04934c2b3734 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:55.721418 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e1936-ba05-4a44-a76a-04934c2b3734 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:55.765809 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 525/1058] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:02:55.766949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:55.787749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619afc2-0518-4b18-9af8-356464933ff0 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:55.794587 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e1936-ba05-4a44-a76a-04934c2b3734 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:55.796044 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e1936-ba05-4a44-a76a-04934c2b3734 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:55.833556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:55.899504 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 534/1059] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:02:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:02:55.903188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619afc2-0518-4b18-9af8-356464933ff0 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:55.906343 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e1936-ba05-4a44-a76a-04934c2b3734 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:55.937906 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3ff87-3d4b-4e00-bbcd-8df738a58074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:55.938747 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3ff87-3d4b-4e00-bbcd-8df738a58074 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:55.939029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3ff87-3d4b-4e00-bbcd-8df738a58074 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:55.939361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3ff87-3d4b-4e00-bbcd-8df738a58074 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:55.950014 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3ff87-3d4b-4e00-bbcd-8df738a58074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:55.958192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-9cf3ff87-3d4b-4e00-bbcd-8df738a58074 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:02:55.958192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:55.958192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:55.958192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:55.958192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:55.958192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:55.958192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:55.958192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:55.958192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:55.958192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:55.958192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:55.958192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:55.958192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:55.958192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:55.958192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:55.958192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:55.959125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:55.959125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:55.959125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:55.959125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:55.959125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:55.959125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:55.959125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:55.959125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:55.959125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:55.959125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:55.959125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:55.959125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:55.959125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:55.959125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:55.959125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:55.959125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:55.959968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:55.959968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:55.959968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:55.959968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:55.959968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:55.959968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:55.959968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:55.959968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:55.959968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:55.959968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:55.959968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:02:55.959968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:55.959968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 526/1060] 10.222.0.48 () {56 vars in 1120 bytes} [Mon Jul 25 12:02:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:55.965848 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3ff87-3d4b-4e00-bbcd-8df738a58074 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:55.986941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:56.013313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e1936-ba05-4a44-a76a-04934c2b3734 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:56.049776 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecc0dc-be04-431e-b34d-ffad88b2379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:56.050766 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecc0dc-be04-431e-b34d-ffad88b2379b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:56.051049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecc0dc-be04-431e-b34d-ffad88b2379b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:56.051323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecc0dc-be04-431e-b34d-ffad88b2379b None admin] PATH_INFO: `/v3/projects/e1a24a628daf4a538a958e1ce0900c0d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:56.052497 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecc0dc-be04-431e-b34d-ffad88b2379b None admin] RBAC: Authorizing `identity:get_project(project_id=e1a24a628daf4a538a958e1ce0900c0d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:56.054080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecc0dc-be04-431e-b34d-ffad88b2379b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:56.060941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 535/1061] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:02:55 2022] GET /identity/v3/projects/e1a24a628daf4a538a958e1ce0900c0d => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:56.061964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecc0dc-be04-431e-b34d-ffad88b2379b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:56.066654 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:56.071124 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3ff87-3d4b-4e00-bbcd-8df738a58074 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:56.105351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc93ce6-3b78-4092-9d82-2ece5d6dccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:56.106042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc93ce6-3b78-4092-9d82-2ece5d6dccb5 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:56.106330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc93ce6-3b78-4092-9d82-2ece5d6dccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:56.106606 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc93ce6-3b78-4092-9d82-2ece5d6dccb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:56.107354 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc93ce6-3b78-4092-9d82-2ece5d6dccb5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:56.107659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc93ce6-3b78-4092-9d82-2ece5d6dccb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:56.109014 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc93ce6-3b78-4092-9d82-2ece5d6dccb5 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:56.117091 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 527/1062] 10.222.0.48 () {56 vars in 1115 bytes} [Mon Jul 25 12:02:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:56.123266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc93ce6-3b78-4092-9d82-2ece5d6dccb5 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:56.172365 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecc0dc-be04-431e-b34d-ffad88b2379b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:56.210472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a396bc8-151d-42cc-9783-e0f39d262ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:56.211136 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a396bc8-151d-42cc-9783-e0f39d262ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:56.211501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a396bc8-151d-42cc-9783-e0f39d262ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:56.211765 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a396bc8-151d-42cc-9783-e0f39d262ca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:56.212526 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a396bc8-151d-42cc-9783-e0f39d262ca0 None admin] RBAC: Adding query filter params (role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.project.id=e1a24a628daf4a538a958e1ce0900c0d, user.id=92551af353124f8dad9e18da5aa10fd8) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:56.212840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a396bc8-151d-42cc-9783-e0f39d262ca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:56.214863 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a396bc8-151d-42cc-9783-e0f39d262ca0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:56.230032 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 536/1063] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:02:56 2022] GET /identity/v3/role_assignments?user.id=92551af353124f8dad9e18da5aa10fd8&scope.project.id=e1a24a628daf4a538a958e1ce0900c0d&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:56.245280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc93ce6-3b78-4092-9d82-2ece5d6dccb5 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:56.283984 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aeb692-7a06-4190-b99a-f8799a630bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:56.284803 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aeb692-7a06-4190-b99a-f8799a630bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:56.285089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aeb692-7a06-4190-b99a-f8799a630bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:56.285363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aeb692-7a06-4190-b99a-f8799a630bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:56.298590 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aeb692-7a06-4190-b99a-f8799a630bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:56.300236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aeb692-7a06-4190-b99a-f8799a630bb5 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:56.319148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-b0aeb692-7a06-4190-b99a-f8799a630bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:56.319148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:56.319148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:56.319148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:56.319148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:56.319148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:56.319148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:56.319148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:56.319148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:56.319148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:56.319148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:56.319148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:56.319148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:56.319148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:56.319148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:56.320106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:56.320106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:56.320106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:56.320106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:56.320106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:56.320106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:56.320106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:56.320106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:56.320106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:56.320106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:56.320106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:56.320106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:56.320106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:56.320106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:56.320106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:56.320106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:56.320106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:56.326301 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:56.326301 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:56.326301 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:56.326301 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:56.326301 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 528/1064] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:56.326589 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a396bc8-151d-42cc-9783-e0f39d262ca0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:56.339913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:56.438479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a396bc8-151d-42cc-9783-e0f39d262ca0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:56.480021 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fcff7-e3ea-4af6-a8e0-ff72227395e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:56.480694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fcff7-e3ea-4af6-a8e0-ff72227395e8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:56.480977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fcff7-e3ea-4af6-a8e0-ff72227395e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:56.481252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fcff7-e3ea-4af6-a8e0-ff72227395e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:56.481979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fcff7-e3ea-4af6-a8e0-ff72227395e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:56.482314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fcff7-e3ea-4af6-a8e0-ff72227395e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:56.483709 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fcff7-e3ea-4af6-a8e0-ff72227395e8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:56.500582 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 537/1065] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:56.501702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aeb692-7a06-4190-b99a-f8799a630bb5 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:56.517903 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:56.606911 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aeb692-7a06-4190-b99a-f8799a630bb5 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:56.640040 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842333a1-bc0a-4298-89e6-1f0f12ef5c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:56.640828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842333a1-bc0a-4298-89e6-1f0f12ef5c4e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:56.641108 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842333a1-bc0a-4298-89e6-1f0f12ef5c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:56.641381 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842333a1-bc0a-4298-89e6-1f0f12ef5c4e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:56.648962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842333a1-bc0a-4298-89e6-1f0f12ef5c4e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:56.650424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842333a1-bc0a-4298-89e6-1f0f12ef5c4e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:56.664907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-842333a1-bc0a-4298-89e6-1f0f12ef5c4e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:02:56.664907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:56.664907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:56.664907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:56.664907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:56.664907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:56.664907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:56.664907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:56.664907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:56.664907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:56.664907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:56.664907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:56.664907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:02:56.664907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:02:56.664907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:02:56.664907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:02:56.665852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:56.665852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:56.665852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:02:56.665852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:56.665852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:02:56.665852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:02:56.665852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:56.665852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:56.665852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:56.665852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:56.665852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:56.665852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:56.665852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:56.665852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:56.665852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:56.665852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:56.665852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:56.665852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:56.666826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:56.666826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:56.666826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:02:56.666826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:02:56.666826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:02:56.666826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:02:56.666826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:02:56.666826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:02:56.666826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:02:56.666826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:56.667980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 529/1066] 10.222.0.48 () {56 vars in 1093 bytes} [Mon Jul 25 12:02:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:56.673055 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fcff7-e3ea-4af6-a8e0-ff72227395e8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:56.742443 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:56.778110 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fcff7-e3ea-4af6-a8e0-ff72227395e8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:56.811971 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4530c7-4586-49f3-9360-52932346d58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:56.812635 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4530c7-4586-49f3-9360-52932346d58e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:56.812917 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4530c7-4586-49f3-9360-52932346d58e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:56.813191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4530c7-4586-49f3-9360-52932346d58e None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:56.814048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4530c7-4586-49f3-9360-52932346d58e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:56.814363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4530c7-4586-49f3-9360-52932346d58e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:56.815809 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4530c7-4586-49f3-9360-52932346d58e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:56.837767 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 538/1067] 10.222.0.48 () {56 vars in 1133 bytes} [Mon Jul 25 12:02:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:56.839433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842333a1-bc0a-4298-89e6-1f0f12ef5c4e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:56.910756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:56.942254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842333a1-bc0a-4298-89e6-1f0f12ef5c4e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:56.976089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c403f2-f157-4224-b533-bc6a30034e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:56.976881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c403f2-f157-4224-b533-bc6a30034e38 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:56.977165 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c403f2-f157-4224-b533-bc6a30034e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:56.977439 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c403f2-f157-4224-b533-bc6a30034e38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:56.988013 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c403f2-f157-4224-b533-bc6a30034e38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:56.989440 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c403f2-f157-4224-b533-bc6a30034e38 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:57.006726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-25c403f2-f157-4224-b533-bc6a30034e38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:57.006726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:57.006726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:57.006726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:57.006726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:57.006726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:57.006726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:57.006726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:57.006726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:57.006726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:57.006726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:57.006726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:57.006726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:57.006726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:57.006726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:57.007591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:57.007591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:57.007591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:57.007591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:57.007591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:57.007591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:57.007591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:57.007591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:57.007591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:57.007591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:57.007591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:57.007591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:57.007591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:57.007591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:57.007591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:57.007591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:57.007591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:57.013650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:57.013650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:57.013650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:57.013650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:57.013650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 530/1068] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:57.014274 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4530c7-4586-49f3-9360-52932346d58e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:57.093725 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397b4fb-6dc6-40a9-a9e7-7e50402d0e99 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:57.093940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397b4fb-6dc6-40a9-a9e7-7e50402d0e99 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:57.094277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397b4fb-6dc6-40a9-a9e7-7e50402d0e99 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:57.095814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 531/1069] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:02:57.101236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874c5b3-306b-4dad-8586-a14e75b478d2 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:57.101525 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874c5b3-306b-4dad-8586-a14e75b478d2 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:57.101804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874c5b3-306b-4dad-8586-a14e75b478d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:57.115444 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4530c7-4586-49f3-9360-52932346d58e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:57.124338 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-b874c5b3-306b-4dad-8586-a14e75b478d2 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:57.125932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b874c5b3-306b-4dad-8586-a14e75b478d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:57.141843 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:57.151745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee50c9-b6fc-411e-9ac2-47f2b092691d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:57.152404 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee50c9-b6fc-411e-9ac2-47f2b092691d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:57.152682 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee50c9-b6fc-411e-9ac2-47f2b092691d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:57.152952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee50c9-b6fc-411e-9ac2-47f2b092691d None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:57.153672 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee50c9-b6fc-411e-9ac2-47f2b092691d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:57.153971 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee50c9-b6fc-411e-9ac2-47f2b092691d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:57.155414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee50c9-b6fc-411e-9ac2-47f2b092691d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:57.167488 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 539/1070] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:57.173199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee50c9-b6fc-411e-9ac2-47f2b092691d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:57.209904 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 532/1071] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:57.231392 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874c5b3-306b-4dad-8586-a14e75b478d2 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:57.288878 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee50c9-b6fc-411e-9ac2-47f2b092691d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:57.290883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:57.327929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a89e21-b401-4ddb-8b04-3f82dbf097f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:57.328742 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a89e21-b401-4ddb-8b04-3f82dbf097f6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:57.329022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a89e21-b401-4ddb-8b04-3f82dbf097f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:57.329298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a89e21-b401-4ddb-8b04-3f82dbf097f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:57.336436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a89e21-b401-4ddb-8b04-3f82dbf097f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:57.337964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a89e21-b401-4ddb-8b04-3f82dbf097f6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:57.341190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874c5b3-306b-4dad-8586-a14e75b478d2 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:57.352328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-68a89e21-b401-4ddb-8b04-3f82dbf097f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:57.352328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:57.352328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:57.352328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:57.352328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:57.352328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:57.352328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:57.352328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:57.352328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:57.352328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:57.352328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:57.352328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:57.352328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:02:57.352328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:02:57.352328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:02:57.353309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:02:57.353309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:57.353309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:57.353309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:57.353309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:57.353309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:57.353309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:57.353309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:57.353309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:57.353309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:57.353309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:57.353309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:57.353309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:57.353309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:57.353309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:57.353309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:57.353309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:57.354797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:02:57.354797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:02:57.354797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:02:57.354797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:02:57.354797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:02:57.354797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:02:57.354797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:02:57.354797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:57.354797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 540/1072] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:02:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:57.359678 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a89e21-b401-4ddb-8b04-3f82dbf097f6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:57.381688 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872010cd-43ce-4cd8-85d5-5b6dc1ca93ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:57.382505 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872010cd-43ce-4cd8-85d5-5b6dc1ca93ab None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:57.382945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872010cd-43ce-4cd8-85d5-5b6dc1ca93ab None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:57.383250 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872010cd-43ce-4cd8-85d5-5b6dc1ca93ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:57.409269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:57.458750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872010cd-43ce-4cd8-85d5-5b6dc1ca93ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:57.460314 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872010cd-43ce-4cd8-85d5-5b6dc1ca93ab None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:57.469621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a89e21-b401-4ddb-8b04-3f82dbf097f6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:57.506914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ca233-fb76-47d4-a360-c3a81a96050b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:57.507577 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ca233-fb76-47d4-a360-c3a81a96050b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:57.507858 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ca233-fb76-47d4-a360-c3a81a96050b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:57.508131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ca233-fb76-47d4-a360-c3a81a96050b None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:57.508912 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ca233-fb76-47d4-a360-c3a81a96050b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:57.509217 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ca233-fb76-47d4-a360-c3a81a96050b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:57.510710 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ca233-fb76-47d4-a360-c3a81a96050b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:57.520091 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:57.522521 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 541/1073] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:02:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:57.528270 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ca233-fb76-47d4-a360-c3a81a96050b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:57.578875 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 533/1074] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:02:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 12:02:57.584481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872010cd-43ce-4cd8-85d5-5b6dc1ca93ab None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:57.631067 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ca233-fb76-47d4-a360-c3a81a96050b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:57.638809 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:57.669160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c076d-1cfd-4562-998f-83aafbd2b21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:57.670073 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c076d-1cfd-4562-998f-83aafbd2b21a None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:57.670353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c076d-1cfd-4562-998f-83aafbd2b21a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:57.670621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c076d-1cfd-4562-998f-83aafbd2b21a None admin] PATH_INFO: `/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/6d9db26891a04b0bb7e655c21feeffdd/roles/85d086a755ed46078be507e4a3b3c9a8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:57.672816 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c076d-1cfd-4562-998f-83aafbd2b21a None admin] RBAC: Authorizing `identity:create_grant(project_id=8c80b9db7ace42c0a0cd1f31901599fd, user_id=6d9db26891a04b0bb7e655c21feeffdd, role_id=85d086a755ed46078be507e4a3b3c9a8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:57.674263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c076d-1cfd-4562-998f-83aafbd2b21a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:57.689872 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 542/1075] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:02:57 2022] PUT /identity/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/6d9db26891a04b0bb7e655c21feeffdd/roles/85d086a755ed46078be507e4a3b3c9a8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:02:57.692821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872010cd-43ce-4cd8-85d5-5b6dc1ca93ab None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:57.732478 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb694a-ef02-49b4-ba67-68fa0d7b4be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:57.733287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb694a-ef02-49b4-ba67-68fa0d7b4be8 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:57.733570 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb694a-ef02-49b4-ba67-68fa0d7b4be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:57.733846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb694a-ef02-49b4-ba67-68fa0d7b4be8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:57.746152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb694a-ef02-49b4-ba67-68fa0d7b4be8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:57.747621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb694a-ef02-49b4-ba67-68fa0d7b4be8 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:57.766962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-d7bb694a-ef02-49b4-ba67-68fa0d7b4be8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:57.766962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:57.766962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:57.766962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:57.766962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:57.766962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:57.766962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:57.766962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:57.766962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:57.766962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:57.766962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:57.766962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:57.766962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:02:57.766962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:02:57.766962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:02:57.767935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:02:57.767935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:57.767935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:57.767935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:57.767935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:57.767935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:57.767935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:57.767935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:57.767935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:57.767935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:57.767935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:57.767935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:57.767935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:57.767935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:57.767935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:57.767935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:57.767935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:57.768816 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:02:57.768816 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:02:57.768816 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:02:57.768816 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:57.768816 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 534/1076] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:02:57.775400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c076d-1cfd-4562-998f-83aafbd2b21a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:57.887622 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c076d-1cfd-4562-998f-83aafbd2b21a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:57.923569 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b818c1c-8f1e-4ff7-afbf-4e6d39c7c233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:57.924296 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b818c1c-8f1e-4ff7-afbf-4e6d39c7c233 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:57.924585 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b818c1c-8f1e-4ff7-afbf-4e6d39c7c233 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:57.924860 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b818c1c-8f1e-4ff7-afbf-4e6d39c7c233 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:57.925585 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b818c1c-8f1e-4ff7-afbf-4e6d39c7c233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:57.925890 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b818c1c-8f1e-4ff7-afbf-4e6d39c7c233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:57.927316 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b818c1c-8f1e-4ff7-afbf-4e6d39c7c233 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:57.939580 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 543/1077] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:02:58.222346 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0b459-5feb-44dd-84f8-664df8582479 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:58.222637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0b459-5feb-44dd-84f8-664df8582479 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:58.222910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0b459-5feb-44dd-84f8-664df8582479 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:58.224309 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 535/1078] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:58.230176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65746992-e1bb-415b-aada-0953bd67c21a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:58.230467 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65746992-e1bb-415b-aada-0953bd67c21a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:58.230743 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65746992-e1bb-415b-aada-0953bd67c21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:58.248756 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-65746992-e1bb-415b-aada-0953bd67c21a None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:58.249920 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-65746992-e1bb-415b-aada-0953bd67c21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:58.269275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:58.316413 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 544/1079] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:58.338146 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0b459-5feb-44dd-84f8-664df8582479 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:58.347319 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:58.439426 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0b459-5feb-44dd-84f8-664df8582479 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:58.480201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b91a5-cce0-4afa-96b7-15a24a26438d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:58.481269 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b91a5-cce0-4afa-96b7-15a24a26438d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:58.481613 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b91a5-cce0-4afa-96b7-15a24a26438d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:58.482125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b91a5-cce0-4afa-96b7-15a24a26438d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:58.492194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b91a5-cce0-4afa-96b7-15a24a26438d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:58.499812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-4f2b91a5-cce0-4afa-96b7-15a24a26438d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:02:58.499812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:58.499812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:58.499812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:58.499812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:58.499812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:58.499812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:58.499812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:58.499812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:58.499812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:58.499812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:58.499812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:58.499812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:58.499812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:58.499812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:58.499812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:58.500786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:58.500786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:58.500786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:58.500786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:58.500786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:58.500786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:58.500786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:58.500786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:58.500786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:58.500786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:58.500786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:58.500786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:58.500786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:58.500786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:58.500786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:58.500786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:58.501625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:58.501625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:58.501625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:58.501625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:58.501625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:58.501625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:58.501625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:58.501625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:58.501625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:58.501625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:58.501625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:02:58.501625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:02:58.501625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 536/1080] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:02:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:58.507040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65746992-e1bb-415b-aada-0953bd67c21a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:58.603077 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65746992-e1bb-415b-aada-0953bd67c21a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:58.635609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051fc47-d035-4506-b5a8-960a1ac22d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:58.636273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051fc47-d035-4506-b5a8-960a1ac22d60 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:58.636555 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051fc47-d035-4506-b5a8-960a1ac22d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:58.636828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051fc47-d035-4506-b5a8-960a1ac22d60 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:58.637571 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051fc47-d035-4506-b5a8-960a1ac22d60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:02:58.637874 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051fc47-d035-4506-b5a8-960a1ac22d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:58.639278 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051fc47-d035-4506-b5a8-960a1ac22d60 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:58.647195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 545/1081] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:02:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:58.653356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b91a5-cce0-4afa-96b7-15a24a26438d None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:58.718116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:58.753483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b91a5-cce0-4afa-96b7-15a24a26438d None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:58.786486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d7eef-ba30-4559-b673-e8197c86ee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:58.787356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d7eef-ba30-4559-b673-e8197c86ee60 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:58.787636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d7eef-ba30-4559-b673-e8197c86ee60 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:58.787907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d7eef-ba30-4559-b673-e8197c86ee60 None admin] PATH_INFO: `/v3/users/92551af353124f8dad9e18da5aa10fd8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:58.789092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d7eef-ba30-4559-b673-e8197c86ee60 None admin] RBAC: Authorizing `identity:get_user(user_id=92551af353124f8dad9e18da5aa10fd8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:58.790547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d7eef-ba30-4559-b673-e8197c86ee60 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:58.792822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 537/1082] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:02:58 2022] GET /identity/v3/users/92551af353124f8dad9e18da5aa10fd8 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:58.799025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051fc47-d035-4506-b5a8-960a1ac22d60 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:58.819142 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:58.898686 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051fc47-d035-4506-b5a8-960a1ac22d60 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:58.931849 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acaa21-3a38-40be-b7db-792964b72e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:58.932723 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acaa21-3a38-40be-b7db-792964b72e17 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:58.933000 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acaa21-3a38-40be-b7db-792964b72e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:58.933268 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acaa21-3a38-40be-b7db-792964b72e17 None admin] PATH_INFO: `/v3/projects/e1a24a628daf4a538a958e1ce0900c0d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:58.934474 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acaa21-3a38-40be-b7db-792964b72e17 None admin] RBAC: Authorizing `identity:get_project(project_id=e1a24a628daf4a538a958e1ce0900c0d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:58.935911 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acaa21-3a38-40be-b7db-792964b72e17 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:58.937746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 546/1083] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:02:58 2022] GET /identity/v3/projects/e1a24a628daf4a538a958e1ce0900c0d => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:02:58.943576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d7eef-ba30-4559-b673-e8197c86ee60 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:59.039633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d7eef-ba30-4559-b673-e8197c86ee60 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:59.071101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef282b-0100-4a10-9248-b68393203126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:59.071965 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef282b-0100-4a10-9248-b68393203126 None admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:59.072246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef282b-0100-4a10-9248-b68393203126 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:59.072519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef282b-0100-4a10-9248-b68393203126 None admin] PATH_INFO: `/v3/projects/e1a24a628daf4a538a958e1ce0900c0d/users/92551af353124f8dad9e18da5aa10fd8/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:59.075000 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef282b-0100-4a10-9248-b68393203126 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1a24a628daf4a538a958e1ce0900c0d, user_id=92551af353124f8dad9e18da5aa10fd8, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:02:59.076412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef282b-0100-4a10-9248-b68393203126 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:02:59.078592 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:59.090253 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 538/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:02:58 2022] PUT /identity/v3/projects/e1a24a628daf4a538a958e1ce0900c0d/users/92551af353124f8dad9e18da5aa10fd8/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:02:59.690450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1be119-4684-4290-9c05-d5c15d5057e7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:59.691014 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1be119-4684-4290-9c05-d5c15d5057e7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:59.691014 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1be119-4684-4290-9c05-d5c15d5057e7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:59.692358 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 547/1085] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:02:59.697491 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94922f4-8202-4926-b376-56a1480790ad None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:59.697879 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94922f4-8202-4926-b376-56a1480790ad None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:59.698092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94922f4-8202-4926-b376-56a1480790ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:59.715745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-e94922f4-8202-4926-b376-56a1480790ad None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:02:59.716926 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-e94922f4-8202-4926-b376-56a1480790ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:02:59.782324 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 539/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:02:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:02:59.805776 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1be119-4684-4290-9c05-d5c15d5057e7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:02:59.887328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:02:59.902427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1be119-4684-4290-9c05-d5c15d5057e7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:02:59.935336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2f9de-68f8-45c9-b8e5-0eed67c5e7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:02:59.936126 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2f9de-68f8-45c9-b8e5-0eed67c5e7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:02:59.936402 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2f9de-68f8-45c9-b8e5-0eed67c5e7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:02:59.936671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2f9de-68f8-45c9-b8e5-0eed67c5e7f9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:02:59.946443 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2f9de-68f8-45c9-b8e5-0eed67c5e7f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:02:59.954538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-adb2f9de-68f8-45c9-b8e5-0eed67c5e7f9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:02:59.954538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:02:59.954538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:02:59.954538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:02:59.954538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:02:59.954538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:02:59.954538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:02:59.954538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:02:59.954538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:02:59.954538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:02:59.954538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:02:59.954538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:02:59.954538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:02:59.954538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:02:59.954538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:02:59.954538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:02:59.955609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:02:59.955609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:02:59.955609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:02:59.955609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:02:59.955609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:02:59.955609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:02:59.955609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:02:59.955609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:02:59.955609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:02:59.955609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:02:59.955609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:02:59.955609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:02:59.955609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:02:59.955609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:02:59.955609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:02:59.955609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:02:59.956535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:02:59.956535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:02:59.956535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:02:59.956535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:02:59.956535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:02:59.956535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:02:59.956535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:02:59.956535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:02:59.956535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:02:59.956535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:02:59.956535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:02:59.956535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:02:59.956535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 548/1087] 10.222.0.48 () {56 vars in 1120 bytes} [Mon Jul 25 12:02:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:02:59.961726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94922f4-8202-4926-b376-56a1480790ad None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:00.066667 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94922f4-8202-4926-b376-56a1480790ad None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:00.089669 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:00.101287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70734506-96a4-44d3-ac24-e2e9a1af33b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:00.101944 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70734506-96a4-44d3-ac24-e2e9a1af33b2 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:00.102252 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70734506-96a4-44d3-ac24-e2e9a1af33b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:00.102527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70734506-96a4-44d3-ac24-e2e9a1af33b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:00.103274 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70734506-96a4-44d3-ac24-e2e9a1af33b2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:00.103576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70734506-96a4-44d3-ac24-e2e9a1af33b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:00.105472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70734506-96a4-44d3-ac24-e2e9a1af33b2 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:00.113325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 540/1088] 10.222.0.48 () {56 vars in 1115 bytes} [Mon Jul 25 12:02:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:03:00.119022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2f9de-68f8-45c9-b8e5-0eed67c5e7f9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:00.217588 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2f9de-68f8-45c9-b8e5-0eed67c5e7f9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:00.249521 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66933b77-b97b-461b-8ee1-80acac437437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:00.250336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66933b77-b97b-461b-8ee1-80acac437437 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:00.250617 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66933b77-b97b-461b-8ee1-80acac437437 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:00.250888 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66933b77-b97b-461b-8ee1-80acac437437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:00.261015 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66933b77-b97b-461b-8ee1-80acac437437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:00.262484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66933b77-b97b-461b-8ee1-80acac437437 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:00.268533 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:00.280275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-66933b77-b97b-461b-8ee1-80acac437437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:03:00.280275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:03:00.280275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:03:00.280275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:03:00.280275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:03:00.280275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:03:00.280275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:03:00.280275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:03:00.280275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:03:00.280275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:03:00.280275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:03:00.280275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:03:00.280275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:03:00.280275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:03:00.280275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:03:00.281257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:03:00.281257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:03:00.281257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:03:00.281257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:03:00.281257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:03:00.281257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:03:00.281257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:03:00.281257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:03:00.281257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:03:00.281257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:03:00.281257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:03:00.281257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:03:00.281257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:03:00.281257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:03:00.281257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:03:00.281257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:03:00.281257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:03:00.282162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:03:00.282162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:03:00.282162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:03:00.282162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:03:00.282162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 549/1089] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:03:00.287101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70734506-96a4-44d3-ac24-e2e9a1af33b2 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:00.382613 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70734506-96a4-44d3-ac24-e2e9a1af33b2 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:00.415704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef024e-152f-4037-9059-927ba154aaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:00.416345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef024e-152f-4037-9059-927ba154aaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:00.416656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef024e-152f-4037-9059-927ba154aaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:00.416928 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef024e-152f-4037-9059-927ba154aaf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:00.417638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef024e-152f-4037-9059-927ba154aaf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:00.417940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef024e-152f-4037-9059-927ba154aaf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:00.419565 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef024e-152f-4037-9059-927ba154aaf9 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:00.430860 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 541/1090] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:00.436314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66933b77-b97b-461b-8ee1-80acac437437 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:00.539739 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66933b77-b97b-461b-8ee1-80acac437437 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:00.571347 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f5b3f-842c-4056-82eb-ab30b355ac2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:00.572131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f5b3f-842c-4056-82eb-ab30b355ac2f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:00.572412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f5b3f-842c-4056-82eb-ab30b355ac2f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:00.572681 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f5b3f-842c-4056-82eb-ab30b355ac2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:00.580468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f5b3f-842c-4056-82eb-ab30b355ac2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:00.581935 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f5b3f-842c-4056-82eb-ab30b355ac2f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:00.596527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-340f5b3f-842c-4056-82eb-ab30b355ac2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:03:00.596527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:03:00.596527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:03:00.596527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:03:00.596527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:03:00.596527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:03:00.596527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:03:00.596527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:03:00.596527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:03:00.596527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:03:00.596527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:03:00.596527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:03:00.596527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:03:00.596527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:03:00.596527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:03:00.596527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:03:00.597605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:03:00.597605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:03:00.597605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:03:00.597605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:03:00.597605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:03:00.597605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:03:00.597605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:03:00.597605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:03:00.597605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:03:00.597605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:03:00.597605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:03:00.597605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:03:00.597605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:03:00.597605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:03:00.597605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:03:00.597605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:03:00.597605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:03:00.597605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:03:00.598563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:03:00.598563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:03:00.598563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:03:00.598563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:03:00.598563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:03:00.598563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:03:00.598563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:03:00.598563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:03:00.598563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:03:00.598563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:03:00.598563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 550/1091] 10.222.0.48 () {56 vars in 1093 bytes} [Mon Jul 25 12:03:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:03:00.603405 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef024e-152f-4037-9059-927ba154aaf9 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:00.648607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:00.701058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef024e-152f-4037-9059-927ba154aaf9 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:00.733306 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa4949-2bab-4d2e-b89b-ad95b50294f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:00.733974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa4949-2bab-4d2e-b89b-ad95b50294f9 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:00.734291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa4949-2bab-4d2e-b89b-ad95b50294f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:00.734568 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa4949-2bab-4d2e-b89b-ad95b50294f9 None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:00.735402 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa4949-2bab-4d2e-b89b-ad95b50294f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:00.735710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa4949-2bab-4d2e-b89b-ad95b50294f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:00.737126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa4949-2bab-4d2e-b89b-ad95b50294f9 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:00.754926 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 542/1092] 10.222.0.48 () {56 vars in 1133 bytes} [Mon Jul 25 12:03:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:00.761347 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f5b3f-842c-4056-82eb-ab30b355ac2f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:00.817546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:00.858300 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f5b3f-842c-4056-82eb-ab30b355ac2f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:00.890850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7763fa6-288a-4b0a-8f45-3962c975fa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:00.891495 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7763fa6-288a-4b0a-8f45-3962c975fa36 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:00.891778 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7763fa6-288a-4b0a-8f45-3962c975fa36 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:00.892052 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7763fa6-288a-4b0a-8f45-3962c975fa36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:00.957086 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7763fa6-288a-4b0a-8f45-3962c975fa36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:00.958519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7763fa6-288a-4b0a-8f45-3962c975fa36 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:01.012502 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:01.050199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936368f8-1a13-44e1-a988-7db8ba032f40 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:01.050573 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936368f8-1a13-44e1-a988-7db8ba032f40 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:01.050866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936368f8-1a13-44e1-a988-7db8ba032f40 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:01.052263 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 543/1093] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:03:01.053529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 551/1094] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:03:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 12:03:01.057626 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed08c9-c3f2-458d-bcdd-e13ae27b547c None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:01.057922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed08c9-c3f2-458d-bcdd-e13ae27b547c None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:01.058231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed08c9-c3f2-458d-bcdd-e13ae27b547c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:01.059569 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7763fa6-288a-4b0a-8f45-3962c975fa36 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:01.077444 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-c0ed08c9-c3f2-458d-bcdd-e13ae27b547c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:03:01.078666 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c0ed08c9-c3f2-458d-bcdd-e13ae27b547c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:03:01.143994 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 544/1095] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:03:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:03:01.159117 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7763fa6-288a-4b0a-8f45-3962c975fa36 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:01.166272 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed08c9-c3f2-458d-bcdd-e13ae27b547c None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:01.194467 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626990b-2547-4b2d-b297-c5177459523d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:01.195253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626990b-2547-4b2d-b297-c5177459523d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:01.195536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626990b-2547-4b2d-b297-c5177459523d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:01.195801 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626990b-2547-4b2d-b297-c5177459523d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:01.200092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:01.205853 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626990b-2547-4b2d-b297-c5177459523d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:01.207411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626990b-2547-4b2d-b297-c5177459523d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:01.224982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7626990b-2547-4b2d-b297-c5177459523d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:03:01.224982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:03:01.224982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:03:01.224982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:03:01.224982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:03:01.224982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:03:01.224982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:03:01.224982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:03:01.224982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:03:01.224982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:03:01.224982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:03:01.224982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:03:01.224982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:03:01.224982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:03:01.224982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:03:01.225832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:03:01.225832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:03:01.225832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:03:01.225832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:03:01.225832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:03:01.225832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:03:01.225832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:03:01.225832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:03:01.225832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:03:01.225832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:03:01.225832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:03:01.225832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:03:01.225832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:03:01.225832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:03:01.225832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:03:01.225832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:03:01.225832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:03:01.226750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:03:01.226750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:03:01.226750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:03:01.226750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:03:01.226750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 552/1096] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:03:01.232294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626990b-2547-4b2d-b297-c5177459523d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:01.243447 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:01.268831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed08c9-c3f2-458d-bcdd-e13ae27b547c None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:01.302070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d690b-375e-47e8-940e-02357e0c9640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:01.302861 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d690b-375e-47e8-940e-02357e0c9640 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:01.303149 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d690b-375e-47e8-940e-02357e0c9640 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:01.303430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d690b-375e-47e8-940e-02357e0c9640 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:01.314115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d690b-375e-47e8-940e-02357e0c9640 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:03:01.321773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-8c8d690b-375e-47e8-940e-02357e0c9640 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:03:01.321773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:03:01.321773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:03:01.321773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:03:01.321773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:03:01.321773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:03:01.321773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:03:01.321773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:03:01.321773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:03:01.321773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:03:01.321773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:03:01.321773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:03:01.321773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:03:01.321773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:03:01.321773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:03:01.321773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:03:01.322734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:03:01.322734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:03:01.322734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:03:01.322734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:03:01.322734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:03:01.322734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:03:01.322734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:03:01.322734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:03:01.322734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:03:01.322734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:03:01.322734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:03:01.322734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:03:01.322734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:03:01.322734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:03:01.322734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:03:01.322734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:03:01.323616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:03:01.323616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:03:01.323616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:03:01.323616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:03:01.323616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:03:01.323616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:03:01.323616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:03:01.323616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:03:01.323616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:03:01.323616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:03:01.323616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:03:01.323616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:03:01.323616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 545/1097] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:03:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:03:01.328900 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d690b-375e-47e8-940e-02357e0c9640 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:01.329726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626990b-2547-4b2d-b297-c5177459523d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:01.362569 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8eda7-7471-4051-a20e-c33664713a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:01.363212 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8eda7-7471-4051-a20e-c33664713a9d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:01.363490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8eda7-7471-4051-a20e-c33664713a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:01.363761 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8eda7-7471-4051-a20e-c33664713a9d None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:01.364469 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8eda7-7471-4051-a20e-c33664713a9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:01.364767 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8eda7-7471-4051-a20e-c33664713a9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:01.366149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8eda7-7471-4051-a20e-c33664713a9d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:01.377972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 553/1098] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:03:01.383303 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8eda7-7471-4051-a20e-c33664713a9d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:01.424723 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:01.431274 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d690b-375e-47e8-940e-02357e0c9640 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:01.451930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:01.468525 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e19f62-b5f1-48b3-a9cc-37f07f77aa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:01.469524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e19f62-b5f1-48b3-a9cc-37f07f77aa71 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:01.469524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e19f62-b5f1-48b3-a9cc-37f07f77aa71 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:01.469707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e19f62-b5f1-48b3-a9cc-37f07f77aa71 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:01.470430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e19f62-b5f1-48b3-a9cc-37f07f77aa71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:01.470736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e19f62-b5f1-48b3-a9cc-37f07f77aa71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:01.472095 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e19f62-b5f1-48b3-a9cc-37f07f77aa71 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:01.480709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 546/1099] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:03:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:03:01.486342 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e19f62-b5f1-48b3-a9cc-37f07f77aa71 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:01.488240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8eda7-7471-4051-a20e-c33664713a9d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:01.521433 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5ae21-ae6b-4c02-9d55-b3670f6cc107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:01.522248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5ae21-ae6b-4c02-9d55-b3670f6cc107 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:01.522528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5ae21-ae6b-4c02-9d55-b3670f6cc107 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:01.522798 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5ae21-ae6b-4c02-9d55-b3670f6cc107 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:01.529846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5ae21-ae6b-4c02-9d55-b3670f6cc107 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:01.531425 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5ae21-ae6b-4c02-9d55-b3670f6cc107 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:01.546335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-42c5ae21-ae6b-4c02-9d55-b3670f6cc107 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:03:01.546335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:03:01.546335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:03:01.546335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:03:01.546335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:03:01.546335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:03:01.546335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:03:01.546335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:03:01.546335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:03:01.546335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:03:01.546335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:03:01.546335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:03:01.546335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:03:01.546335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:03:01.546335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:03:01.547252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:03:01.547252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:03:01.547252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:03:01.547252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:03:01.547252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:03:01.547252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:03:01.547252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:03:01.547252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:03:01.547252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:03:01.547252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:03:01.547252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:03:01.547252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:03:01.547252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:03:01.547252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:03:01.547252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:03:01.547252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:03:01.547252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:03:01.548128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:03:01.548128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:03:01.548128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:03:01.548128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:03:01.548128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:03:01.548128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:03:01.548128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:03:01.548128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:03:01.548128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 554/1100] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:03:01.553163 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5ae21-ae6b-4c02-9d55-b3670f6cc107 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:01.585444 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e19f62-b5f1-48b3-a9cc-37f07f77aa71 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:01.618347 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e33a5-13ca-4429-8512-b0f7413e08fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:01.619206 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e33a5-13ca-4429-8512-b0f7413e08fe None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:01.619484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e33a5-13ca-4429-8512-b0f7413e08fe None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:01.619787 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e33a5-13ca-4429-8512-b0f7413e08fe None admin] PATH_INFO: `/v3/users/92551af353124f8dad9e18da5aa10fd8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:01.620973 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e33a5-13ca-4429-8512-b0f7413e08fe None admin] RBAC: Authorizing `identity:get_user(user_id=92551af353124f8dad9e18da5aa10fd8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:01.622414 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e33a5-13ca-4429-8512-b0f7413e08fe None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:01.624033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 547/1101] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:03:01 2022] GET /identity/v3/users/92551af353124f8dad9e18da5aa10fd8 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:03:01.629507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e33a5-13ca-4429-8512-b0f7413e08fe None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:01.648356 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5ae21-ae6b-4c02-9d55-b3670f6cc107 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:01.653656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:01.679461 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:01.685929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8549af-9d3a-452f-8671-02d6b2a5bb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:01.686639 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8549af-9d3a-452f-8671-02d6b2a5bb44 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:01.686916 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8549af-9d3a-452f-8671-02d6b2a5bb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:01.687181 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8549af-9d3a-452f-8671-02d6b2a5bb44 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:01.687951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8549af-9d3a-452f-8671-02d6b2a5bb44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:01.688250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8549af-9d3a-452f-8671-02d6b2a5bb44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:01.689683 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8549af-9d3a-452f-8671-02d6b2a5bb44 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:01.700964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 555/1102] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:03:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:03:01.707002 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8549af-9d3a-452f-8671-02d6b2a5bb44 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:01.726278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e33a5-13ca-4429-8512-b0f7413e08fe None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:01.759410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64812ad3-aee7-4c89-8398-538febba8271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:01.760046 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64812ad3-aee7-4c89-8398-538febba8271 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:01.760351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64812ad3-aee7-4c89-8398-538febba8271 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:01.760625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64812ad3-aee7-4c89-8398-538febba8271 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:01.804785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8549af-9d3a-452f-8671-02d6b2a5bb44 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:01.826683 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64812ad3-aee7-4c89-8398-538febba8271 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:01.828127 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64812ad3-aee7-4c89-8398-538febba8271 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:01.837951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1bea0-d549-4fc3-8c2d-e81f7b359c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:01.838668 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1bea0-d549-4fc3-8c2d-e81f7b359c63 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:01.839438 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1bea0-d549-4fc3-8c2d-e81f7b359c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:01.839707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1bea0-d549-4fc3-8c2d-e81f7b359c63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:01.840525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1bea0-d549-4fc3-8c2d-e81f7b359c63 None admin] RBAC: Adding query filter params (role.id=85d086a755ed46078be507e4a3b3c9a8, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=6d9db26891a04b0bb7e655c21feeffdd) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:01.840829 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1bea0-d549-4fc3-8c2d-e81f7b359c63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:01.842245 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1bea0-d549-4fc3-8c2d-e81f7b359c63 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:01.848052 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 556/1103] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:03:01 2022] GET /identity/v3/role_assignments?user.id=6d9db26891a04b0bb7e655c21feeffdd&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=85d086a755ed46078be507e4a3b3c9a8 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:01.853221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:01.933628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 548/1104] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:03:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:03:01.939583 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1bea0-d549-4fc3-8c2d-e81f7b359c63 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:01.996306 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:02.042641 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1bea0-d549-4fc3-8c2d-e81f7b359c63 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:02.076019 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dce6d3-5dd2-42a4-be2c-57af9b26e508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:02.076881 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dce6d3-5dd2-42a4-be2c-57af9b26e508 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:02.077151 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dce6d3-5dd2-42a4-be2c-57af9b26e508 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:02.077423 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dce6d3-5dd2-42a4-be2c-57af9b26e508 None admin] PATH_INFO: `/v3/projects/e1a24a628daf4a538a958e1ce0900c0d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:02.078622 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dce6d3-5dd2-42a4-be2c-57af9b26e508 None admin] RBAC: Authorizing `identity:get_project(project_id=e1a24a628daf4a538a958e1ce0900c0d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:02.080049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dce6d3-5dd2-42a4-be2c-57af9b26e508 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:02.081733 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 557/1105] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:03:01 2022] GET /identity/v3/projects/e1a24a628daf4a538a958e1ce0900c0d => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:03:02.088049 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64812ad3-aee7-4c89-8398-538febba8271 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:02.195754 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64812ad3-aee7-4c89-8398-538febba8271 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:02.219251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:02.229937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55706f82-4770-4734-968f-1ef878c7a671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:02.230717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55706f82-4770-4734-968f-1ef878c7a671 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:02.230995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55706f82-4770-4734-968f-1ef878c7a671 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:02.231269 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55706f82-4770-4734-968f-1ef878c7a671 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:02.232095 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55706f82-4770-4734-968f-1ef878c7a671 None admin] RBAC: Adding query filter params (role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.project.id=e1a24a628daf4a538a958e1ce0900c0d, user.id=92551af353124f8dad9e18da5aa10fd8) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:02.232403 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55706f82-4770-4734-968f-1ef878c7a671 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:02.233800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55706f82-4770-4734-968f-1ef878c7a671 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:02.239793 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 549/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:03:02 2022] GET /identity/v3/role_assignments?user.id=92551af353124f8dad9e18da5aa10fd8&scope.project.id=e1a24a628daf4a538a958e1ce0900c0d&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:04.251466 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9a7fc-eef3-4a59-8b28-ee1d7b42a276 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:04.251992 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9a7fc-eef3-4a59-8b28-ee1d7b42a276 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:04.251992 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9a7fc-eef3-4a59-8b28-ee1d7b42a276 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:04.253385 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 558/1107] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:03:04.258764 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4fdff-2e1f-4b1e-bee1-6bb0df571c35 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:04.259155 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4fdff-2e1f-4b1e-bee1-6bb0df571c35 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:04.259316 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4fdff-2e1f-4b1e-bee1-6bb0df571c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:04.277821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-9ef4fdff-2e1f-4b1e-bee1-6bb0df571c35 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:03:04.279024 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-9ef4fdff-2e1f-4b1e-bee1-6bb0df571c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:03:04.342580 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 550/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:03:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:03:04.365973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9a7fc-eef3-4a59-8b28-ee1d7b42a276 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:04.465300 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9a7fc-eef3-4a59-8b28-ee1d7b42a276 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:04.487072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:04.499106 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02db031-f569-4d0c-97a6-7795227c5f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:04.499888 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02db031-f569-4d0c-97a6-7795227c5f74 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:04.500171 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02db031-f569-4d0c-97a6-7795227c5f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:04.500446 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02db031-f569-4d0c-97a6-7795227c5f74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:04.501667 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02db031-f569-4d0c-97a6-7795227c5f74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:04.503093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02db031-f569-4d0c-97a6-7795227c5f74 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:04.504708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 559/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:03:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:04.511014 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4fdff-2e1f-4b1e-bee1-6bb0df571c35 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:04.614232 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4fdff-2e1f-4b1e-bee1-6bb0df571c35 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:04.631076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:04.647840 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d3cc5-51b9-48d6-9bca-dfacbd8f8351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:04.648507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d3cc5-51b9-48d6-9bca-dfacbd8f8351 None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:04.648795 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d3cc5-51b9-48d6-9bca-dfacbd8f8351 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:04.649073 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d3cc5-51b9-48d6-9bca-dfacbd8f8351 None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:04.649781 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d3cc5-51b9-48d6-9bca-dfacbd8f8351 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:04.651260 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d3cc5-51b9-48d6-9bca-dfacbd8f8351 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:04.671512 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 551/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 12:03:04 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:03:06.663526 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215824e-4c40-4def-b171-c82389cdf5c7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:06.664044 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215824e-4c40-4def-b171-c82389cdf5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:06.664157 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215824e-4c40-4def-b171-c82389cdf5c7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:06.665461 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 560/1111] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:03:06.671385 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbd590-630c-4b36-99d8-0ef10c6f2a1f None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:06.671783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbd590-630c-4b36-99d8-0ef10c6f2a1f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:06.671939 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbd590-630c-4b36-99d8-0ef10c6f2a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:06.690179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-f3cbd590-630c-4b36-99d8-0ef10c6f2a1f None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:03:06.691378 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-f3cbd590-630c-4b36-99d8-0ef10c6f2a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:03:06.755242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 552/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:03:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:03:06.778621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215824e-4c40-4def-b171-c82389cdf5c7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:06.877365 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215824e-4c40-4def-b171-c82389cdf5c7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:06.910358 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de165e-3b72-499e-bd80-90b49c715171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:06.911198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de165e-3b72-499e-bd80-90b49c715171 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:06.911483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de165e-3b72-499e-bd80-90b49c715171 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:06.911760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de165e-3b72-499e-bd80-90b49c715171 None admin] PATH_INFO: `/v3/roles/639e5e5307f34a64a854cfb59086518e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:06.913229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de165e-3b72-499e-bd80-90b49c715171 None admin] RBAC: Authorizing `identity:get_role(role_id=639e5e5307f34a64a854cfb59086518e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:06.914629 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de165e-3b72-499e-bd80-90b49c715171 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:06.915985 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 561/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:03:06 2022] GET /identity/v3/roles/639e5e5307f34a64a854cfb59086518e => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:06.922603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbd590-630c-4b36-99d8-0ef10c6f2a1f None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:07.017120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbd590-630c-4b36-99d8-0ef10c6f2a1f None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:07.019320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:07.049915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a4c6a-9b2b-4290-99be-cc0a6a16bc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:07.050798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a4c6a-9b2b-4290-99be-cc0a6a16bc51 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:07.051105 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a4c6a-9b2b-4290-99be-cc0a6a16bc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:07.051351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a4c6a-9b2b-4290-99be-cc0a6a16bc51 None admin] PATH_INFO: `/v3/users/743726f92c0443c899874b5be9304276` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:07.064372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a4c6a-9b2b-4290-99be-cc0a6a16bc51 None admin] RBAC: Authorizing `identity:get_user(user_id=743726f92c0443c899874b5be9304276)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:07.065799 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a4c6a-9b2b-4290-99be-cc0a6a16bc51 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:07.067453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 553/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:03:06 2022] GET /identity/v3/users/743726f92c0443c899874b5be9304276 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:07.073623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de165e-3b72-499e-bd80-90b49c715171 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:07.129957 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:07.170055 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de165e-3b72-499e-bd80-90b49c715171 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:07.202529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2395682-41cb-4d22-b18d-5c4e53653a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:07.203165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2395682-41cb-4d22-b18d-5c4e53653a10 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:07.203446 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2395682-41cb-4d22-b18d-5c4e53653a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:07.203719 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2395682-41cb-4d22-b18d-5c4e53653a10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:07.267468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2395682-41cb-4d22-b18d-5c4e53653a10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:07.268849 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2395682-41cb-4d22-b18d-5c4e53653a10 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:07.322237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:07.362605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 562/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:03:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:03:07.368389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a4c6a-9b2b-4290-99be-cc0a6a16bc51 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:07.466406 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a4c6a-9b2b-4290-99be-cc0a6a16bc51 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:07.499258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed398f-e213-4f0a-9a05-72980f07984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:07.500100 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed398f-e213-4f0a-9a05-72980f07984e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:07.500383 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed398f-e213-4f0a-9a05-72980f07984e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:07.500674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed398f-e213-4f0a-9a05-72980f07984e None admin] PATH_INFO: `/v3/projects/e1a24a628daf4a538a958e1ce0900c0d` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:07.501821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed398f-e213-4f0a-9a05-72980f07984e None admin] RBAC: Authorizing `identity:get_project(project_id=e1a24a628daf4a538a958e1ce0900c0d)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:07.503278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed398f-e213-4f0a-9a05-72980f07984e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:07.504986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 554/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:03:07 2022] GET /identity/v3/projects/e1a24a628daf4a538a958e1ce0900c0d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:07.511008 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2395682-41cb-4d22-b18d-5c4e53653a10 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:07.605486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2395682-41cb-4d22-b18d-5c4e53653a10 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:07.636939 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f46cff-2474-49c0-abd5-8fbcbf5ac4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:07.637573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f46cff-2474-49c0-abd5-8fbcbf5ac4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:07.637852 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f46cff-2474-49c0-abd5-8fbcbf5ac4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:07.638154 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f46cff-2474-49c0-abd5-8fbcbf5ac4a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:07.638974 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f46cff-2474-49c0-abd5-8fbcbf5ac4a4 None admin] RBAC: Adding query filter params (role.id=639e5e5307f34a64a854cfb59086518e, scope.project.id=e1a24a628daf4a538a958e1ce0900c0d, user.id=743726f92c0443c899874b5be9304276) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:07.639280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f46cff-2474-49c0-abd5-8fbcbf5ac4a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:07.640700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f46cff-2474-49c0-abd5-8fbcbf5ac4a4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:07.645919 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 563/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:03:07 2022] GET /identity/v3/role_assignments?user.id=743726f92c0443c899874b5be9304276&scope.project.id=e1a24a628daf4a538a958e1ce0900c0d&role.id=639e5e5307f34a64a854cfb59086518e => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:09.585890 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351df9a-0479-49da-b589-928c31e1edb7 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:09.586465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351df9a-0479-49da-b589-928c31e1edb7 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:09.586465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351df9a-0479-49da-b589-928c31e1edb7 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:09.587843 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 555/1118] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:03:09.592969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9a8f1-b980-42c2-98f0-a6fbe26a130d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:09.593397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9a8f1-b980-42c2-98f0-a6fbe26a130d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:09.593495 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9a8f1-b980-42c2-98f0-a6fbe26a130d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:09.611458 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d3b9a8f1-b980-42c2-98f0-a6fbe26a130d None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:03:09.612619 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d3b9a8f1-b980-42c2-98f0-a6fbe26a130d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:03:09.628706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:09.676887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 564/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:03:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:03:09.699003 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351df9a-0479-49da-b589-928c31e1edb7 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:09.728648 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:09.798321 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351df9a-0479-49da-b589-928c31e1edb7 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:09.830571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014c78f-0b43-420b-9473-343e4aa3e5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:09.831401 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014c78f-0b43-420b-9473-343e4aa3e5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:09.831682 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014c78f-0b43-420b-9473-343e4aa3e5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:09.831961 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014c78f-0b43-420b-9473-343e4aa3e5e6 None admin] PATH_INFO: `/v3/roles/639e5e5307f34a64a854cfb59086518e` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:09.833400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014c78f-0b43-420b-9473-343e4aa3e5e6 None admin] RBAC: Authorizing `identity:get_role(role_id=639e5e5307f34a64a854cfb59086518e)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:09.834778 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014c78f-0b43-420b-9473-343e4aa3e5e6 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:09.836121 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 556/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:03:09 2022] GET /identity/v3/roles/639e5e5307f34a64a854cfb59086518e => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:03:09.842190 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9a8f1-b980-42c2-98f0-a6fbe26a130d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:09.935621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9a8f1-b980-42c2-98f0-a6fbe26a130d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:09.967711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e7fe0-02e1-42e1-bd13-7b832014da00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:09.968554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e7fe0-02e1-42e1-bd13-7b832014da00 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:09.968829 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e7fe0-02e1-42e1-bd13-7b832014da00 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:09.969099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e7fe0-02e1-42e1-bd13-7b832014da00 None admin] PATH_INFO: `/v3/users/743726f92c0443c899874b5be9304276` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:09.970292 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e7fe0-02e1-42e1-bd13-7b832014da00 None admin] RBAC: Authorizing `identity:get_user(user_id=743726f92c0443c899874b5be9304276)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:09.971706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e7fe0-02e1-42e1-bd13-7b832014da00 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:09.973281 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 565/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:03:09 2022] GET /identity/v3/users/743726f92c0443c899874b5be9304276 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:09.978841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014c78f-0b43-420b-9473-343e4aa3e5e6 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:10.071480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:10.075884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014c78f-0b43-420b-9473-343e4aa3e5e6 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:10.108586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5c8da-fa68-4956-98ff-72d160dc2130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:10.109419 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5c8da-fa68-4956-98ff-72d160dc2130 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:10.109702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5c8da-fa68-4956-98ff-72d160dc2130 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:10.109977 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5c8da-fa68-4956-98ff-72d160dc2130 None admin] PATH_INFO: `/v3/projects/e1a24a628daf4a538a958e1ce0900c0d` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:10.111178 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5c8da-fa68-4956-98ff-72d160dc2130 None admin] RBAC: Authorizing `identity:get_project(project_id=e1a24a628daf4a538a958e1ce0900c0d)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:10.112573 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5c8da-fa68-4956-98ff-72d160dc2130 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:10.114260 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 557/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:03:09 2022] GET /identity/v3/projects/e1a24a628daf4a538a958e1ce0900c0d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:10.119886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e7fe0-02e1-42e1-bd13-7b832014da00 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:10.140962 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:10.216330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e7fe0-02e1-42e1-bd13-7b832014da00 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:10.248017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288826ae-ba74-4585-b171-c6ba50795071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:10.248825 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288826ae-ba74-4585-b171-c6ba50795071 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:10.249100 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288826ae-ba74-4585-b171-c6ba50795071 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:10.249365 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288826ae-ba74-4585-b171-c6ba50795071 None admin] PATH_INFO: `/v3/projects/e1a24a628daf4a538a958e1ce0900c0d/users/743726f92c0443c899874b5be9304276/roles/639e5e5307f34a64a854cfb59086518e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:10.251545 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288826ae-ba74-4585-b171-c6ba50795071 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1a24a628daf4a538a958e1ce0900c0d, user_id=743726f92c0443c899874b5be9304276, role_id=639e5e5307f34a64a854cfb59086518e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:10.252969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288826ae-ba74-4585-b171-c6ba50795071 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:10.265194 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 566/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:03:10 2022] PUT /identity/v3/projects/e1a24a628daf4a538a958e1ce0900c0d/users/743726f92c0443c899874b5be9304276/roles/639e5e5307f34a64a854cfb59086518e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:03:12.217694 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2727dd-49af-4e6a-aec0-35dc85ec590e None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:12.218418 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2727dd-49af-4e6a-aec0-35dc85ec590e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:12.218418 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2727dd-49af-4e6a-aec0-35dc85ec590e None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:12.219648 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 558/1124] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:03:12.224694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f344-84d0-4eea-8565-4a9585983408 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:12.225125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f344-84d0-4eea-8565-4a9585983408 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:12.225225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f344-84d0-4eea-8565-4a9585983408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:12.243488 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-54c9f344-84d0-4eea-8565-4a9585983408 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:03:12.244654 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-54c9f344-84d0-4eea-8565-4a9585983408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:03:12.309688 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 567/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:03:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:03:12.332705 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2727dd-49af-4e6a-aec0-35dc85ec590e None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:12.430320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2727dd-49af-4e6a-aec0-35dc85ec590e None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:12.462980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31400b1-0ca3-459e-a7a2-5c31b41cc10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:12.464406 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31400b1-0ca3-459e-a7a2-5c31b41cc10f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:12.464687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31400b1-0ca3-459e-a7a2-5c31b41cc10f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:12.464955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31400b1-0ca3-459e-a7a2-5c31b41cc10f None admin] PATH_INFO: `/v3/roles/639e5e5307f34a64a854cfb59086518e` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:12.466464 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31400b1-0ca3-459e-a7a2-5c31b41cc10f None admin] RBAC: Authorizing `identity:get_role(role_id=639e5e5307f34a64a854cfb59086518e)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:12.467872 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31400b1-0ca3-459e-a7a2-5c31b41cc10f None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:12.469373 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 559/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:03:12 2022] GET /identity/v3/roles/639e5e5307f34a64a854cfb59086518e => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:12.475078 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9f344-84d0-4eea-8565-4a9585983408 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:12.486382 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:12.570856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9f344-84d0-4eea-8565-4a9585983408 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:12.603731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457f40a-68ed-420c-a246-e12b4fd6b010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:12.604610 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457f40a-68ed-420c-a246-e12b4fd6b010 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:12.604890 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457f40a-68ed-420c-a246-e12b4fd6b010 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:12.605159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457f40a-68ed-420c-a246-e12b4fd6b010 None admin] PATH_INFO: `/v3/users/743726f92c0443c899874b5be9304276` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:12.606364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457f40a-68ed-420c-a246-e12b4fd6b010 None admin] RBAC: Authorizing `identity:get_user(user_id=743726f92c0443c899874b5be9304276)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:12.607799 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457f40a-68ed-420c-a246-e12b4fd6b010 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:12.609392 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 568/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:03:12 2022] GET /identity/v3/users/743726f92c0443c899874b5be9304276 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:12.615038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31400b1-0ca3-459e-a7a2-5c31b41cc10f None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:12.648242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:12.712359 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31400b1-0ca3-459e-a7a2-5c31b41cc10f None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:12.744132 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbab9df-ab58-4a40-9c4f-177460bec944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:12.745277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbab9df-ab58-4a40-9c4f-177460bec944 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:12.745558 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbab9df-ab58-4a40-9c4f-177460bec944 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:12.745830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbab9df-ab58-4a40-9c4f-177460bec944 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:12.809634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbab9df-ab58-4a40-9c4f-177460bec944 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:12.811074 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbab9df-ab58-4a40-9c4f-177460bec944 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:12.841980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:12.905131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 560/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:03:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:03:12.910961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457f40a-68ed-420c-a246-e12b4fd6b010 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:12.986145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:13.007810 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457f40a-68ed-420c-a246-e12b4fd6b010 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:13.040249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e8fdc-5ea9-412f-95cf-8b79ef4c105a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:13.041098 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e8fdc-5ea9-412f-95cf-8b79ef4c105a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:13.041380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e8fdc-5ea9-412f-95cf-8b79ef4c105a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:13.041656 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e8fdc-5ea9-412f-95cf-8b79ef4c105a None admin] PATH_INFO: `/v3/projects/e1a24a628daf4a538a958e1ce0900c0d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:13.042857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e8fdc-5ea9-412f-95cf-8b79ef4c105a None admin] RBAC: Authorizing `identity:get_project(project_id=e1a24a628daf4a538a958e1ce0900c0d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:13.044557 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e8fdc-5ea9-412f-95cf-8b79ef4c105a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:13.046266 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 569/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:03:12 2022] GET /identity/v3/projects/e1a24a628daf4a538a958e1ce0900c0d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:13.052264 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbab9df-ab58-4a40-9c4f-177460bec944 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:13.146348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbab9df-ab58-4a40-9c4f-177460bec944 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:13.178762 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77829737-c01c-4eda-bf70-62763673f7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:13.179393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77829737-c01c-4eda-bf70-62763673f7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:13.179674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77829737-c01c-4eda-bf70-62763673f7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:13.179948 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77829737-c01c-4eda-bf70-62763673f7e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:13.180767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77829737-c01c-4eda-bf70-62763673f7e8 None admin] RBAC: Adding query filter params (role.id=639e5e5307f34a64a854cfb59086518e, scope.project.id=e1a24a628daf4a538a958e1ce0900c0d, user.id=743726f92c0443c899874b5be9304276) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:13.181074 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77829737-c01c-4eda-bf70-62763673f7e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:13.183034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77829737-c01c-4eda-bf70-62763673f7e8 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:13.184785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:13.189088 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 561/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:03:13 2022] GET /identity/v3/role_assignments?user.id=743726f92c0443c899874b5be9304276&scope.project.id=e1a24a628daf4a538a958e1ce0900c0d&role.id=639e5e5307f34a64a854cfb59086518e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:15.140235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c86e7-4035-451b-b160-33a2300ab6d8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:15.140783 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c86e7-4035-451b-b160-33a2300ab6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:15.140783 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c86e7-4035-451b-b160-33a2300ab6d8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:15.142189 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 570/1131] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:03:15.147406 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fa56d-4f49-4c80-8a15-fb5330fdec78 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:15.147832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fa56d-4f49-4c80-8a15-fb5330fdec78 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:15.147968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fa56d-4f49-4c80-8a15-fb5330fdec78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:15.166232 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-ab0fa56d-4f49-4c80-8a15-fb5330fdec78 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:03:15.167428 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ab0fa56d-4f49-4c80-8a15-fb5330fdec78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:03:15.231875 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 562/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:03:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:03:15.254781 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c86e7-4035-451b-b160-33a2300ab6d8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:15.352215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c86e7-4035-451b-b160-33a2300ab6d8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:15.385094 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686003f2-001b-4f50-a13b-916c1341191a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:15.385900 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686003f2-001b-4f50-a13b-916c1341191a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:15.386249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686003f2-001b-4f50-a13b-916c1341191a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:15.386529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686003f2-001b-4f50-a13b-916c1341191a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:15.387687 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686003f2-001b-4f50-a13b-916c1341191a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:15.389114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686003f2-001b-4f50-a13b-916c1341191a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:15.390782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 571/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:03:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:15.396696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fa56d-4f49-4c80-8a15-fb5330fdec78 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:15.496644 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fa56d-4f49-4c80-8a15-fb5330fdec78 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:15.521903 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:15.529961 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee65e8c-e054-44f6-bc6c-e4f1e54343bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:15.530641 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee65e8c-e054-44f6-bc6c-e4f1e54343bf None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:15.530925 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee65e8c-e054-44f6-bc6c-e4f1e54343bf None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:15.531203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee65e8c-e054-44f6-bc6c-e4f1e54343bf None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:15.531918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee65e8c-e054-44f6-bc6c-e4f1e54343bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:15.533336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee65e8c-e054-44f6-bc6c-e4f1e54343bf None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:15.559887 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 563/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 12:03:15 2022] POST /identity/v3/projects => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:03:17.525031 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481ff9a-af41-4429-b539-c46eadaa02bc None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:17.525470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481ff9a-af41-4429-b539-c46eadaa02bc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:17.525570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481ff9a-af41-4429-b539-c46eadaa02bc None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:17.527486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 572/1135] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:03:17.532475 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53f21f-6cb0-414a-945f-004429bb3d35 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:17.532858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53f21f-6cb0-414a-945f-004429bb3d35 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:17.533029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53f21f-6cb0-414a-945f-004429bb3d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:17.551341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-2b53f21f-6cb0-414a-945f-004429bb3d35 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:03:17.552505 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-2b53f21f-6cb0-414a-945f-004429bb3d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:03:17.615738 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 564/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:03:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:03:17.639752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481ff9a-af41-4429-b539-c46eadaa02bc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:17.655568 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:17.736892 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481ff9a-af41-4429-b539-c46eadaa02bc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:17.768857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326d224-45d5-4323-98bd-429f851f7467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:17.769657 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326d224-45d5-4323-98bd-429f851f7467 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:17.769900 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326d224-45d5-4323-98bd-429f851f7467 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:17.770202 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326d224-45d5-4323-98bd-429f851f7467 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:17.771356 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326d224-45d5-4323-98bd-429f851f7467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:17.772773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326d224-45d5-4323-98bd-429f851f7467 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:17.774386 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 573/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:03:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:17.780554 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53f21f-6cb0-414a-945f-004429bb3d35 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:17.874628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53f21f-6cb0-414a-945f-004429bb3d35 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:17.884726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:17.909063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416521c1-a8df-4c4f-b38f-140057a1a9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:17.909712 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416521c1-a8df-4c4f-b38f-140057a1a9c2 None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:17.909994 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416521c1-a8df-4c4f-b38f-140057a1a9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:17.910296 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416521c1-a8df-4c4f-b38f-140057a1a9c2 None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:17.911005 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416521c1-a8df-4c4f-b38f-140057a1a9c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:17.912413 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416521c1-a8df-4c4f-b38f-140057a1a9c2 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:17.933275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 565/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 12:03:17 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:03:19.931637 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639525a-1290-4cb7-a113-a9f2f7b915fd None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:19.932214 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639525a-1290-4cb7-a113-a9f2f7b915fd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:19.932214 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639525a-1290-4cb7-a113-a9f2f7b915fd None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:19.934217 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 574/1139] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:03:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:03:19.939414 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79258773-fa28-4615-8ed6-b30ab946a3c4 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:19.939832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79258773-fa28-4615-8ed6-b30ab946a3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:19.939974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79258773-fa28-4615-8ed6-b30ab946a3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:19.957664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-79258773-fa28-4615-8ed6-b30ab946a3c4 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:03:19.958892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-79258773-fa28-4615-8ed6-b30ab946a3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:03:20.023498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 566/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:03:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:03:20.046608 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639525a-1290-4cb7-a113-a9f2f7b915fd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:20.125723 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:20.144541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639525a-1290-4cb7-a113-a9f2f7b915fd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:20.177430 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1236d-df04-4cd6-ba6b-1e6995636ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:20.178238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1236d-df04-4cd6-ba6b-1e6995636ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:20.178521 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1236d-df04-4cd6-ba6b-1e6995636ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:20.178796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1236d-df04-4cd6-ba6b-1e6995636ac0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:20.189189 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1236d-df04-4cd6-ba6b-1e6995636ac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:03:20.196764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-04c1236d-df04-4cd6-ba6b-1e6995636ac0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:03:20.196764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:03:20.196764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:03:20.196764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:03:20.196764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:03:20.196764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:03:20.196764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:03:20.196764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:03:20.196764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:03:20.196764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:03:20.196764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:03:20.196764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:03:20.196764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:03:20.196764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:03:20.196764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:03:20.196764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:03:20.197876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:03:20.197876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:03:20.197876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:03:20.197876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:03:20.197876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:03:20.197876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:03:20.197876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:03:20.197876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:03:20.197876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:03:20.197876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:03:20.197876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:03:20.197876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:03:20.197876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:03:20.197876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:03:20.197876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:03:20.197876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:03:20.199156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:03:20.199156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:03:20.199156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:03:20.199156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:03:20.199156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:03:20.199156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:03:20.199156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:03:20.199156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:03:20.199156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:03:20.199156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:03:20.199156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:03:20.199156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:03:20.199156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 575/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:03:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:03:20.203816 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79258773-fa28-4615-8ed6-b30ab946a3c4 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:20.294596 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:20.301053 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79258773-fa28-4615-8ed6-b30ab946a3c4 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:20.333520 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b1170-1543-44ed-a1b4-8bd2b3a1488a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:20.334203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b1170-1543-44ed-a1b4-8bd2b3a1488a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:20.334491 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b1170-1543-44ed-a1b4-8bd2b3a1488a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:20.334767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b1170-1543-44ed-a1b4-8bd2b3a1488a None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:20.335507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b1170-1543-44ed-a1b4-8bd2b3a1488a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:20.335814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b1170-1543-44ed-a1b4-8bd2b3a1488a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:20.337168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b1170-1543-44ed-a1b4-8bd2b3a1488a None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:20.345572 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 567/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:03:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:20.351136 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1236d-df04-4cd6-ba6b-1e6995636ac0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:20.448072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1236d-df04-4cd6-ba6b-1e6995636ac0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:20.481972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5fdc5-4e84-4dda-a22a-34895d282a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:20.482859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5fdc5-4e84-4dda-a22a-34895d282a56 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:20.483143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5fdc5-4e84-4dda-a22a-34895d282a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:20.483418 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5fdc5-4e84-4dda-a22a-34895d282a56 None admin] PATH_INFO: `/v3/users/8ff446187c4a4900899ecc0dbbd92c6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:20.494176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:20.496774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5fdc5-4e84-4dda-a22a-34895d282a56 None admin] RBAC: Authorizing `identity:get_user(user_id=8ff446187c4a4900899ecc0dbbd92c6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:20.498616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5fdc5-4e84-4dda-a22a-34895d282a56 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:20.500406 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 576/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:03:20 2022] GET /identity/v3/users/8ff446187c4a4900899ecc0dbbd92c6e => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:20.506159 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b1170-1543-44ed-a1b4-8bd2b3a1488a None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:20.604089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b1170-1543-44ed-a1b4-8bd2b3a1488a None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:20.636199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf5d52-9daf-4718-b296-0128f7981b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:20.636832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf5d52-9daf-4718-b296-0128f7981b5e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:20.637113 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf5d52-9daf-4718-b296-0128f7981b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:20.637383 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf5d52-9daf-4718-b296-0128f7981b5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:20.663877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:20.704123 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf5d52-9daf-4718-b296-0128f7981b5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:20.705496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf5d52-9daf-4718-b296-0128f7981b5e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:20.800031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 568/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:03:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:03:20.805832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5fdc5-4e84-4dda-a22a-34895d282a56 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:20.899548 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5fdc5-4e84-4dda-a22a-34895d282a56 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:20.931808 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ff37e-2c25-4daf-b910-1552ac650095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:20.933153 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ff37e-2c25-4daf-b910-1552ac650095 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:20.933427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ff37e-2c25-4daf-b910-1552ac650095 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:20.933690 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ff37e-2c25-4daf-b910-1552ac650095 None admin] PATH_INFO: `/v3/projects/a536b2354b0b4ad08f52669844b09caf` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:20.934875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ff37e-2c25-4daf-b910-1552ac650095 None admin] RBAC: Authorizing `identity:get_project(project_id=a536b2354b0b4ad08f52669844b09caf)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:20.936297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ff37e-2c25-4daf-b910-1552ac650095 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:20.937946 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 577/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:03:20 2022] GET /identity/v3/projects/a536b2354b0b4ad08f52669844b09caf => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:20.943930 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf5d52-9daf-4718-b296-0128f7981b5e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:20.999841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:21.040029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf5d52-9daf-4718-b296-0128f7981b5e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:21.073703 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce065b-19cf-4bff-a7c8-7561f083affc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:21.074366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce065b-19cf-4bff-a7c8-7561f083affc None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:21.074649 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce065b-19cf-4bff-a7c8-7561f083affc None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:21.074922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce065b-19cf-4bff-a7c8-7561f083affc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:21.075748 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce065b-19cf-4bff-a7c8-7561f083affc None admin] RBAC: Adding query filter params (role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.project.id=a536b2354b0b4ad08f52669844b09caf, user.id=8ff446187c4a4900899ecc0dbbd92c6e) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:21.076061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce065b-19cf-4bff-a7c8-7561f083affc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:21.077468 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce065b-19cf-4bff-a7c8-7561f083affc None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:21.082792 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 569/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:03:20 2022] GET /identity/v3/role_assignments?user.id=8ff446187c4a4900899ecc0dbbd92c6e&scope.project.id=a536b2354b0b4ad08f52669844b09caf&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:03:23.024064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49930d4f-6d89-440c-90f4-d40f167222eb None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:23.024614 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49930d4f-6d89-440c-90f4-d40f167222eb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:23.024614 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49930d4f-6d89-440c-90f4-d40f167222eb None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:23.025962 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 578/1147] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:03:23.031152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c250d8-342d-4c73-9b2a-f966fd2855fd None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:23.031533 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c250d8-342d-4c73-9b2a-f966fd2855fd None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:23.031711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c250d8-342d-4c73-9b2a-f966fd2855fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:23.050065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-27c250d8-342d-4c73-9b2a-f966fd2855fd None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:03:23.051242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-27c250d8-342d-4c73-9b2a-f966fd2855fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:03:23.114419 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 570/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:03:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:03:23.136317 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49930d4f-6d89-440c-90f4-d40f167222eb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:23.201455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:23.234763 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49930d4f-6d89-440c-90f4-d40f167222eb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:23.266633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddbdf6-ed57-444a-9bd6-93181c3cb1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:23.267405 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddbdf6-ed57-444a-9bd6-93181c3cb1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:23.267684 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddbdf6-ed57-444a-9bd6-93181c3cb1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:23.267953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddbdf6-ed57-444a-9bd6-93181c3cb1e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:23.278357 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeddbdf6-ed57-444a-9bd6-93181c3cb1e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:03:23.285840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-aeddbdf6-ed57-444a-9bd6-93181c3cb1e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:03:23.285840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:03:23.285840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:03:23.285840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:03:23.285840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:03:23.285840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:03:23.285840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:03:23.285840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:03:23.285840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:03:23.285840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:03:23.285840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:03:23.285840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:03:23.285840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:03:23.285840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:03:23.285840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:03:23.285840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:03:23.286908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:03:23.286908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:03:23.286908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:03:23.286908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:03:23.286908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:03:23.286908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:03:23.286908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:03:23.286908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:03:23.286908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:03:23.286908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:03:23.286908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:03:23.286908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:03:23.286908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:03:23.286908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:03:23.286908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:03:23.286908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:03:23.288053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:03:23.288053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:03:23.288053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:03:23.288053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:03:23.288053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:03:23.288053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:03:23.288053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:03:23.288053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:03:23.288053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:03:23.288053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:03:23.288053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:03:23.288053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:03:23.288053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 579/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:03:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:03:23.293425 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c250d8-342d-4c73-9b2a-f966fd2855fd None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:23.344180 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:23.388883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c250d8-342d-4c73-9b2a-f966fd2855fd None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:23.422050 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bd256-156b-4ac6-b8f8-cfa87cec0a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:23.422704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bd256-156b-4ac6-b8f8-cfa87cec0a69 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:23.422988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bd256-156b-4ac6-b8f8-cfa87cec0a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:23.423264 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bd256-156b-4ac6-b8f8-cfa87cec0a69 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:23.424003 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bd256-156b-4ac6-b8f8-cfa87cec0a69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:23.424309 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bd256-156b-4ac6-b8f8-cfa87cec0a69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:23.425656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bd256-156b-4ac6-b8f8-cfa87cec0a69 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:23.433448 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 571/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:03:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:23.439071 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddbdf6-ed57-444a-9bd6-93181c3cb1e4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:23.533455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddbdf6-ed57-444a-9bd6-93181c3cb1e4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:23.558372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:23.565965 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101ab30-cc8f-4abc-a867-e6a9bd871809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:23.566842 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101ab30-cc8f-4abc-a867-e6a9bd871809 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:23.567120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101ab30-cc8f-4abc-a867-e6a9bd871809 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:23.567390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101ab30-cc8f-4abc-a867-e6a9bd871809 None admin] PATH_INFO: `/v3/users/8ff446187c4a4900899ecc0dbbd92c6e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:23.568557 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101ab30-cc8f-4abc-a867-e6a9bd871809 None admin] RBAC: Authorizing `identity:get_user(user_id=8ff446187c4a4900899ecc0dbbd92c6e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:23.569967 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101ab30-cc8f-4abc-a867-e6a9bd871809 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:23.571607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 580/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:03:23 2022] GET /identity/v3/users/8ff446187c4a4900899ecc0dbbd92c6e => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:23.577892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bd256-156b-4ac6-b8f8-cfa87cec0a69 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:23.673876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bd256-156b-4ac6-b8f8-cfa87cec0a69 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:23.686881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:23.707182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd260f8-7721-4a3c-a113-fd3661e6d925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:23.708029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd260f8-7721-4a3c-a113-fd3661e6d925 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:23.708311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd260f8-7721-4a3c-a113-fd3661e6d925 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:23.708585 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd260f8-7721-4a3c-a113-fd3661e6d925 None admin] PATH_INFO: `/v3/projects/a536b2354b0b4ad08f52669844b09caf` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:23.709759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd260f8-7721-4a3c-a113-fd3661e6d925 None admin] RBAC: Authorizing `identity:get_project(project_id=a536b2354b0b4ad08f52669844b09caf)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:23.711210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd260f8-7721-4a3c-a113-fd3661e6d925 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:23.712880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 572/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:03:23 2022] GET /identity/v3/projects/a536b2354b0b4ad08f52669844b09caf => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:23.719150 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101ab30-cc8f-4abc-a867-e6a9bd871809 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:23.813173 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101ab30-cc8f-4abc-a867-e6a9bd871809 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:23.845770 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf1444-e3d7-449a-a979-f3cf5413dd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:23.846669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf1444-e3d7-449a-a979-f3cf5413dd82 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:23.846952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf1444-e3d7-449a-a979-f3cf5413dd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:23.847225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf1444-e3d7-449a-a979-f3cf5413dd82 None admin] PATH_INFO: `/v3/projects/a536b2354b0b4ad08f52669844b09caf/users/8ff446187c4a4900899ecc0dbbd92c6e/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:23.849154 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf1444-e3d7-449a-a979-f3cf5413dd82 None admin] RBAC: Authorizing `identity:create_grant(project_id=a536b2354b0b4ad08f52669844b09caf, user_id=8ff446187c4a4900899ecc0dbbd92c6e, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:23.850597 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf1444-e3d7-449a-a979-f3cf5413dd82 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:23.863184 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 581/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:03:23 2022] PUT /identity/v3/projects/a536b2354b0b4ad08f52669844b09caf/users/8ff446187c4a4900899ecc0dbbd92c6e/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:03:25.802065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c44001-8dc0-423b-bc07-f033ac520b64 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:25.802589 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c44001-8dc0-423b-bc07-f033ac520b64 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:25.802687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c44001-8dc0-423b-bc07-f033ac520b64 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:25.804011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 573/1154] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:03:25.809575 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ea98f-018d-476d-9359-c7889a0a6cc8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:25.810046 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ea98f-018d-476d-9359-c7889a0a6cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:25.810152 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ea98f-018d-476d-9359-c7889a0a6cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:25.828229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2f4ea98f-018d-476d-9359-c7889a0a6cc8 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:03:25.829385 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2f4ea98f-018d-476d-9359-c7889a0a6cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:03:25.877824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:25.894311 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 582/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:03:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:03:25.917585 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c44001-8dc0-423b-bc07-f033ac520b64 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:26.016345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c44001-8dc0-423b-bc07-f033ac520b64 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:26.049077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b7268-7c73-4548-8940-4b5bf8c7c77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:26.049847 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b7268-7c73-4548-8940-4b5bf8c7c77b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:26.050165 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b7268-7c73-4548-8940-4b5bf8c7c77b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:26.050448 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b7268-7c73-4548-8940-4b5bf8c7c77b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:26.060864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b7268-7c73-4548-8940-4b5bf8c7c77b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:03:26.068433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-266b7268-7c73-4548-8940-4b5bf8c7c77b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:03:26.068433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:03:26.068433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:03:26.068433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:03:26.068433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:03:26.068433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:03:26.068433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:03:26.068433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:03:26.068433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:03:26.068433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:03:26.068433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:03:26.068433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:03:26.068433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:03:26.068433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:03:26.068433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:03:26.068433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:03:26.069516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:03:26.069516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:03:26.069516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:03:26.069516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:03:26.069516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:03:26.069516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:03:26.069516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:03:26.069516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:03:26.069516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:03:26.069516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:03:26.069516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:03:26.069516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:03:26.069516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:03:26.069516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:03:26.069516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:03:26.069516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:03:26.070486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:03:26.070486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:03:26.070486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:03:26.070486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:03:26.070486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:03:26.070486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:03:26.070486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:03:26.070486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:03:26.070486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:03:26.070486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:03:26.070486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:03:26.070486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:03:26.070486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 574/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:03:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:03:26.075322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ea98f-018d-476d-9359-c7889a0a6cc8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:26.168687 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ea98f-018d-476d-9359-c7889a0a6cc8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:26.200956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fa920-8757-41d1-b5da-208671ab0e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:26.201603 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fa920-8757-41d1-b5da-208671ab0e62 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:26.201885 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fa920-8757-41d1-b5da-208671ab0e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:26.202184 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fa920-8757-41d1-b5da-208671ab0e62 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:26.202920 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fa920-8757-41d1-b5da-208671ab0e62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:26.203222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fa920-8757-41d1-b5da-208671ab0e62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:26.204587 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fa920-8757-41d1-b5da-208671ab0e62 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:26.212297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 583/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:03:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:03:26.218588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b7268-7c73-4548-8940-4b5bf8c7c77b None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:26.260686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:26.316492 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b7268-7c73-4548-8940-4b5bf8c7c77b None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:26.348691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92fb4e-c2fc-48b7-af01-b371112c33da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:26.349540 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92fb4e-c2fc-48b7-af01-b371112c33da None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:26.349826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92fb4e-c2fc-48b7-af01-b371112c33da None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:26.350134 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92fb4e-c2fc-48b7-af01-b371112c33da None admin] PATH_INFO: `/v3/users/8ff446187c4a4900899ecc0dbbd92c6e` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:26.351319 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92fb4e-c2fc-48b7-af01-b371112c33da None admin] RBAC: Authorizing `identity:get_user(user_id=8ff446187c4a4900899ecc0dbbd92c6e)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:26.352731 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92fb4e-c2fc-48b7-af01-b371112c33da None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:26.354995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 575/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:03:26 2022] GET /identity/v3/users/8ff446187c4a4900899ecc0dbbd92c6e => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:26.360601 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fa920-8757-41d1-b5da-208671ab0e62 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:26.406902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:26.454992 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fa920-8757-41d1-b5da-208671ab0e62 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:26.487325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2c4c4-1b90-47f1-908e-43ccc4db59c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:26.487960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2c4c4-1b90-47f1-908e-43ccc4db59c4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:26.488236 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2c4c4-1b90-47f1-908e-43ccc4db59c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:26.488505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2c4c4-1b90-47f1-908e-43ccc4db59c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:26.552113 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2c4c4-1b90-47f1-908e-43ccc4db59c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:26.553541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2c4c4-1b90-47f1-908e-43ccc4db59c4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:26.598369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:26.647557 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 584/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:03:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:03:26.653991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92fb4e-c2fc-48b7-af01-b371112c33da None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:26.751043 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92fb4e-c2fc-48b7-af01-b371112c33da None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:26.761446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:26.785157 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8c809-dcb4-4a11-96f7-b7f4ce7d7e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:26.786028 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8c809-dcb4-4a11-96f7-b7f4ce7d7e9d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:26.786318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8c809-dcb4-4a11-96f7-b7f4ce7d7e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:26.786595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8c809-dcb4-4a11-96f7-b7f4ce7d7e9d None admin] PATH_INFO: `/v3/projects/a536b2354b0b4ad08f52669844b09caf` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:26.787778 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8c809-dcb4-4a11-96f7-b7f4ce7d7e9d None admin] RBAC: Authorizing `identity:get_project(project_id=a536b2354b0b4ad08f52669844b09caf)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:26.789202 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8c809-dcb4-4a11-96f7-b7f4ce7d7e9d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:26.790930 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 576/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:03:26 2022] GET /identity/v3/projects/a536b2354b0b4ad08f52669844b09caf => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:26.797212 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2c4c4-1b90-47f1-908e-43ccc4db59c4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:26.891771 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2c4c4-1b90-47f1-908e-43ccc4db59c4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:26.924695 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47411082-7936-4e69-9954-bc78a1844450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:26.925336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47411082-7936-4e69-9954-bc78a1844450 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:26.925617 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47411082-7936-4e69-9954-bc78a1844450 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:26.925891 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47411082-7936-4e69-9954-bc78a1844450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:26.926744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47411082-7936-4e69-9954-bc78a1844450 None admin] RBAC: Adding query filter params (role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.project.id=a536b2354b0b4ad08f52669844b09caf, user.id=8ff446187c4a4900899ecc0dbbd92c6e) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:26.927059 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47411082-7936-4e69-9954-bc78a1844450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:26.928470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47411082-7936-4e69-9954-bc78a1844450 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:26.934582 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 585/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:03:26 2022] GET /identity/v3/role_assignments?user.id=8ff446187c4a4900899ecc0dbbd92c6e&scope.project.id=a536b2354b0b4ad08f52669844b09caf&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:28.896902 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a572485-4b58-4d25-bb48-db77e18cd8f0 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:28.897425 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a572485-4b58-4d25-bb48-db77e18cd8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:28.897535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a572485-4b58-4d25-bb48-db77e18cd8f0 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:28.898928 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 577/1162] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:03:28.904100 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c5c4-8b97-4d54-aa76-5a8f537c2dd6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:28.904485 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c5c4-8b97-4d54-aa76-5a8f537c2dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:28.904686 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c5c4-8b97-4d54-aa76-5a8f537c2dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:28.922952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c636c5c4-8b97-4d54-aa76-5a8f537c2dd6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:03:28.924111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c636c5c4-8b97-4d54-aa76-5a8f537c2dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:03:28.931285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:28.987761 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 586/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:03:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:03:29.009365 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a572485-4b58-4d25-bb48-db77e18cd8f0 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:29.109385 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a572485-4b58-4d25-bb48-db77e18cd8f0 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:29.142336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daada32-8111-4f69-8b7f-319d80334ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:29.142966 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daada32-8111-4f69-8b7f-319d80334ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:29.143251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daada32-8111-4f69-8b7f-319d80334ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:29.143528 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daada32-8111-4f69-8b7f-319d80334ec8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:29.187864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:29.209216 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daada32-8111-4f69-8b7f-319d80334ec8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:29.210672 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daada32-8111-4f69-8b7f-319d80334ec8 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:29.305727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 578/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:03:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:03:29.311572 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636c5c4-8b97-4d54-aa76-5a8f537c2dd6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:29.406554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636c5c4-8b97-4d54-aa76-5a8f537c2dd6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:29.439075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af8da5-2301-4ff8-b9f6-df1c36caa151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:29.439815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af8da5-2301-4ff8-b9f6-df1c36caa151 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:29.440097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af8da5-2301-4ff8-b9f6-df1c36caa151 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:29.440370 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af8da5-2301-4ff8-b9f6-df1c36caa151 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:29.447044 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af8da5-2301-4ff8-b9f6-df1c36caa151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:29.448492 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af8da5-2301-4ff8-b9f6-df1c36caa151 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:29.462389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-94af8da5-2301-4ff8-b9f6-df1c36caa151 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 12:03:29.462389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:03:29.462389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 25 12:03:29.462389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 25 12:03:29.462389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:03:29.462389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:03:29.462389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:03:29.462389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:03:29.462389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 25 12:03:29.462389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:03:29.462389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:03:29.462389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:03:29.462389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:03:29.462389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:03:29.462389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:03:29.462389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:03:29.462389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:03:29.463529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:03:29.463529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:03:29.463529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:03:29.463529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:03:29.463529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:03:29.463529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:03:29.463529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:03:29.463529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:03:29.463529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:03:29.463529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:03:29.463529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:03:29.463529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:03:29.463529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:03:29.463529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:03:29.463529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:03:29.463529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:03:29.465318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:03:29.465318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:03:29.465318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:03:29.465318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:03:29.465318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:03:29.465318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:03:29.465318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:03:29.465318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:03:29.465318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:03:29.465318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:03:29.465318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 25 12:03:29.465318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:03:29.465318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 12:03:29.465318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:03:29.465318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 587/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Mon Jul 25 12:03:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:03:29.469969 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daada32-8111-4f69-8b7f-319d80334ec8 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:29.545886 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:29.566907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daada32-8111-4f69-8b7f-319d80334ec8 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:29.600184 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1539d-1ce5-4d0a-8443-0623cd3e1ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:29.600831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1539d-1ce5-4d0a-8443-0623cd3e1ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:29.601115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1539d-1ce5-4d0a-8443-0623cd3e1ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:29.601393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1539d-1ce5-4d0a-8443-0623cd3e1ba8 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:29.602138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1539d-1ce5-4d0a-8443-0623cd3e1ba8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:29.602447 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1539d-1ce5-4d0a-8443-0623cd3e1ba8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:29.603832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1539d-1ce5-4d0a-8443-0623cd3e1ba8 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:29.610849 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 579/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Mon Jul 25 12:03:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:31.551302 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78ba24-2c48-4149-b8e2-f959c1103d14 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:31.551790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78ba24-2c48-4149-b8e2-f959c1103d14 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:31.551876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78ba24-2c48-4149-b8e2-f959c1103d14 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:31.553225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 588/1167] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:03:31.558745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abb3bb-1b6f-4ef9-8064-b4d9b4fb8442 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:31.559168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abb3bb-1b6f-4ef9-8064-b4d9b4fb8442 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:31.559310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abb3bb-1b6f-4ef9-8064-b4d9b4fb8442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:31.577560 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-20abb3bb-1b6f-4ef9-8064-b4d9b4fb8442 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:03:31.578776 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-20abb3bb-1b6f-4ef9-8064-b4d9b4fb8442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:03:31.642379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 580/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:03:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:03:31.664661 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78ba24-2c48-4149-b8e2-f959c1103d14 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:31.668218 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:31.763954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78ba24-2c48-4149-b8e2-f959c1103d14 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:31.802229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38a1dd-85b9-4aeb-9f71-d1583ec5b829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:31.802874 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38a1dd-85b9-4aeb-9f71-d1583ec5b829 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:31.803154 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38a1dd-85b9-4aeb-9f71-d1583ec5b829 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:31.803425 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38a1dd-85b9-4aeb-9f71-d1583ec5b829 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:31.804151 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38a1dd-85b9-4aeb-9f71-d1583ec5b829 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:31.805504 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38a1dd-85b9-4aeb-9f71-d1583ec5b829 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:31.820896 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 589/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Mon Jul 25 12:03:31 2022] POST /identity/v3/domains => generated 267 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:03:33.809041 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9920d0-1808-495f-b1be-bb8436bd8ee3 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:33.809549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9920d0-1808-495f-b1be-bb8436bd8ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:33.809634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9920d0-1808-495f-b1be-bb8436bd8ee3 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:33.811024 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 581/1170] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:03:33.816247 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946440e-ca4f-4999-9b29-a917cd14d99c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:33.816662 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946440e-ca4f-4999-9b29-a917cd14d99c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:33.816806 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946440e-ca4f-4999-9b29-a917cd14d99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:33.834892 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3946440e-ca4f-4999-9b29-a917cd14d99c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:03:33.836063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3946440e-ca4f-4999-9b29-a917cd14d99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:03:33.890212 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:33.901180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 590/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:03:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:03:33.923850 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9920d0-1808-495f-b1be-bb8436bd8ee3 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:33.991909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:34.022455 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9920d0-1808-495f-b1be-bb8436bd8ee3 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:34.054802 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9795e-0c80-4bdb-a24e-61425efeb83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:34.055649 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9795e-0c80-4bdb-a24e-61425efeb83b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:34.055935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9795e-0c80-4bdb-a24e-61425efeb83b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:34.056212 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9795e-0c80-4bdb-a24e-61425efeb83b None admin] PATH_INFO: `/v3/domains/60cd3abd1b7c49f49fc222d2aabafc40` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:34.066879 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9795e-0c80-4bdb-a24e-61425efeb83b None admin] RBAC: Authorizing `identity:get_domain(domain_id=60cd3abd1b7c49f49fc222d2aabafc40)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:34.068252 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9795e-0c80-4bdb-a24e-61425efeb83b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:34.069874 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 582/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Mon Jul 25 12:03:33 2022] GET /identity/v3/domains/60cd3abd1b7c49f49fc222d2aabafc40 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:34.076310 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946440e-ca4f-4999-9b29-a917cd14d99c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:34.170549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946440e-ca4f-4999-9b29-a917cd14d99c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:34.202842 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cdbe2-5dbd-4af3-bab0-debfb714bd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:34.203481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cdbe2-5dbd-4af3-bab0-debfb714bd1f None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:34.203759 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cdbe2-5dbd-4af3-bab0-debfb714bd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:34.204029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cdbe2-5dbd-4af3-bab0-debfb714bd1f None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:34.204718 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cdbe2-5dbd-4af3-bab0-debfb714bd1f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:34.206194 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cdbe2-5dbd-4af3-bab0-debfb714bd1f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:34.231476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 591/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 12:03:34 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:03:36.225154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d81eb2-cdff-4a20-ac2f-2836b89747ce None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:36.225676 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d81eb2-cdff-4a20-ac2f-2836b89747ce None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:36.225676 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d81eb2-cdff-4a20-ac2f-2836b89747ce None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:36.227118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 583/1174] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:03:36.232877 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fc3f3-612c-4369-9a76-b14f24a87a64 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:36.233280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fc3f3-612c-4369-9a76-b14f24a87a64 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:36.233441 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fc3f3-612c-4369-9a76-b14f24a87a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:36.251019 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d69fc3f3-612c-4369-9a76-b14f24a87a64 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:03:36.252224 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d69fc3f3-612c-4369-9a76-b14f24a87a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:03:36.290597 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:36.317455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 592/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:03:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:03:36.342487 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d81eb2-cdff-4a20-ac2f-2836b89747ce None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:36.440071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d81eb2-cdff-4a20-ac2f-2836b89747ce None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:36.469234 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:36.474253 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dce17-b64f-4fb4-8435-490de6cfe8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:36.475119 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dce17-b64f-4fb4-8435-490de6cfe8ba None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:36.475452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dce17-b64f-4fb4-8435-490de6cfe8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:36.475684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dce17-b64f-4fb4-8435-490de6cfe8ba None admin] PATH_INFO: `/v3/domains/60cd3abd1b7c49f49fc222d2aabafc40` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:36.476878 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dce17-b64f-4fb4-8435-490de6cfe8ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=60cd3abd1b7c49f49fc222d2aabafc40)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:36.478343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dce17-b64f-4fb4-8435-490de6cfe8ba None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:36.479996 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 584/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Mon Jul 25 12:03:36 2022] GET /identity/v3/domains/60cd3abd1b7c49f49fc222d2aabafc40 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:36.485632 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fc3f3-612c-4369-9a76-b14f24a87a64 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:36.579837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fc3f3-612c-4369-9a76-b14f24a87a64 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:36.612299 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af89a47-8758-474d-b8c5-1638324e34ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:36.612949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af89a47-8758-474d-b8c5-1638324e34ab None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:36.613225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af89a47-8758-474d-b8c5-1638324e34ab None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:36.613492 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af89a47-8758-474d-b8c5-1638324e34ab None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:36.614219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af89a47-8758-474d-b8c5-1638324e34ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:36.615628 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af89a47-8758-474d-b8c5-1638324e34ab None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:36.635328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 593/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 12:03:36 2022] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:03:38.642145 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a11e0-9098-4172-b990-633de5a448b9 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:38.642650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a11e0-9098-4172-b990-633de5a448b9 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:38.642758 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a11e0-9098-4172-b990-633de5a448b9 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:38.644081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 585/1178] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:03:38.649257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7942e3-772c-4cb8-a238-823bef4a1c4f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:38.649685 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7942e3-772c-4cb8-a238-823bef4a1c4f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:38.649817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7942e3-772c-4cb8-a238-823bef4a1c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:38.667859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4f7942e3-772c-4cb8-a238-823bef4a1c4f None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:03:38.669035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4f7942e3-772c-4cb8-a238-823bef4a1c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:03:38.692392 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:38.735926 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 594/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:03:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:03:38.758922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a11e0-9098-4172-b990-633de5a448b9 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:38.857661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a11e0-9098-4172-b990-633de5a448b9 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:38.890668 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bb130-4ced-498d-9709-189e41777164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:38.891445 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bb130-4ced-498d-9709-189e41777164 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:38.891733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bb130-4ced-498d-9709-189e41777164 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:38.892011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bb130-4ced-498d-9709-189e41777164 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:38.901907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bb130-4ced-498d-9709-189e41777164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:03:38.909495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-ee8bb130-4ced-498d-9709-189e41777164 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:03:38.909495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:03:38.909495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:03:38.909495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:03:38.909495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:03:38.909495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:03:38.909495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:03:38.909495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:03:38.909495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:03:38.909495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:03:38.909495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:03:38.909495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:03:38.909495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:03:38.909495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:03:38.909495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:03:38.909495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:03:38.910556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:03:38.910556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:03:38.910556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:03:38.910556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:03:38.910556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:03:38.910556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:03:38.910556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:03:38.910556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:03:38.910556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:03:38.910556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:03:38.910556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:03:38.910556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:03:38.910556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:03:38.910556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:03:38.910556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:03:38.910556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:03:38.911709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:03:38.911709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:03:38.911709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:03:38.911709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:03:38.911709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:03:38.911709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:03:38.911709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:03:38.911709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:03:38.911709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:03:38.911709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:03:38.911709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:03:38.911709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:03:38.911709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 586/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:03:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:03:38.916491 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7942e3-772c-4cb8-a238-823bef4a1c4f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:39.010273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7942e3-772c-4cb8-a238-823bef4a1c4f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:39.042708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92174e37-78fe-4d62-b2fc-ef6960a7387a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:39.043351 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92174e37-78fe-4d62-b2fc-ef6960a7387a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:39.043627 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92174e37-78fe-4d62-b2fc-ef6960a7387a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:39.043893 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92174e37-78fe-4d62-b2fc-ef6960a7387a None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:39.044898 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92174e37-78fe-4d62-b2fc-ef6960a7387a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:39.045196 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92174e37-78fe-4d62-b2fc-ef6960a7387a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:39.046579 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92174e37-78fe-4d62-b2fc-ef6960a7387a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:39.054241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 595/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:03:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:39.059664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bb130-4ced-498d-9709-189e41777164 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:39.117053 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:39.156420 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bb130-4ced-498d-9709-189e41777164 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:39.189262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ad45f-dd6d-46f3-ac94-50a90995f583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:39.190160 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ad45f-dd6d-46f3-ac94-50a90995f583 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:39.190446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ad45f-dd6d-46f3-ac94-50a90995f583 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:39.190721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ad45f-dd6d-46f3-ac94-50a90995f583 None admin] PATH_INFO: `/v3/users/a9e9cfd87b5d47ab9073cd4bee79a34d` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:39.203413 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ad45f-dd6d-46f3-ac94-50a90995f583 None admin] RBAC: Authorizing `identity:get_user(user_id=a9e9cfd87b5d47ab9073cd4bee79a34d)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:39.204847 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ad45f-dd6d-46f3-ac94-50a90995f583 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:39.206510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 587/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:03:39 2022] GET /identity/v3/users/a9e9cfd87b5d47ab9073cd4bee79a34d => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:39.212087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92174e37-78fe-4d62-b2fc-ef6960a7387a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:39.236962 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:39.310039 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92174e37-78fe-4d62-b2fc-ef6960a7387a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:39.342659 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b849b-52d0-4a16-9478-7deced910acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:39.343299 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b849b-52d0-4a16-9478-7deced910acd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:39.343585 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b849b-52d0-4a16-9478-7deced910acd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:39.343860 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b849b-52d0-4a16-9478-7deced910acd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:39.407916 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b849b-52d0-4a16-9478-7deced910acd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:39.409357 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b849b-52d0-4a16-9478-7deced910acd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:39.431277 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:39.504076 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 596/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:03:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:03:39.509807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ad45f-dd6d-46f3-ac94-50a90995f583 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:39.605022 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ad45f-dd6d-46f3-ac94-50a90995f583 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:39.621404 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:39.638621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8907f8-3597-4386-8186-dc0699f40309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:39.639470 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8907f8-3597-4386-8186-dc0699f40309 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:39.639751 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8907f8-3597-4386-8186-dc0699f40309 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:39.640036 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8907f8-3597-4386-8186-dc0699f40309 None admin] PATH_INFO: `/v3/projects/784d91b7e2b74a5c96ebe5f97ac103c3` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:39.641183 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8907f8-3597-4386-8186-dc0699f40309 None admin] RBAC: Authorizing `identity:get_project(project_id=784d91b7e2b74a5c96ebe5f97ac103c3)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:39.642632 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8907f8-3597-4386-8186-dc0699f40309 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:39.644319 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 588/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:03:39 2022] GET /identity/v3/projects/784d91b7e2b74a5c96ebe5f97ac103c3 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:39.650301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b849b-52d0-4a16-9478-7deced910acd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:39.745170 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b849b-52d0-4a16-9478-7deced910acd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:39.767541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:39.778984 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3365b38-2ea2-4a16-ae92-1c46624b6652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:39.779628 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3365b38-2ea2-4a16-ae92-1c46624b6652 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:39.779909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3365b38-2ea2-4a16-ae92-1c46624b6652 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:39.780181 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3365b38-2ea2-4a16-ae92-1c46624b6652 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:39.781005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3365b38-2ea2-4a16-ae92-1c46624b6652 None admin] RBAC: Adding query filter params (role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.project.id=784d91b7e2b74a5c96ebe5f97ac103c3, user.id=a9e9cfd87b5d47ab9073cd4bee79a34d) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:39.781314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3365b38-2ea2-4a16-ae92-1c46624b6652 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:39.782766 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3365b38-2ea2-4a16-ae92-1c46624b6652 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:39.788034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 597/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:03:39 2022] GET /identity/v3/role_assignments?user.id=a9e9cfd87b5d47ab9073cd4bee79a34d&scope.project.id=784d91b7e2b74a5c96ebe5f97ac103c3&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:41.743530 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51e81f-8519-4349-a8ba-157c53d7aefd None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:41.744075 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51e81f-8519-4349-a8ba-157c53d7aefd None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:41.744075 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51e81f-8519-4349-a8ba-157c53d7aefd None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:41.745446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 589/1186] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:03:41.751272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43693336-8e39-40fa-8edd-28d492f8d365 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:41.751702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43693336-8e39-40fa-8edd-28d492f8d365 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:41.751831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43693336-8e39-40fa-8edd-28d492f8d365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:41.770193 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-43693336-8e39-40fa-8edd-28d492f8d365 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:03:41.771380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-43693336-8e39-40fa-8edd-28d492f8d365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:03:41.835603 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 598/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:03:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:03:41.858261 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51e81f-8519-4349-a8ba-157c53d7aefd None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:41.954803 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51e81f-8519-4349-a8ba-157c53d7aefd None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:41.987298 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bed71a-a8de-4526-ad7a-a1792890e777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:41.988066 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bed71a-a8de-4526-ad7a-a1792890e777 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:41.988347 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bed71a-a8de-4526-ad7a-a1792890e777 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:41.988619 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bed71a-a8de-4526-ad7a-a1792890e777 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:41.998331 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bed71a-a8de-4526-ad7a-a1792890e777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:03:42.005760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-32bed71a-a8de-4526-ad7a-a1792890e777 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:03:42.005760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:03:42.005760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:03:42.005760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:03:42.005760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:03:42.005760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:03:42.005760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:03:42.005760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:03:42.005760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:03:42.005760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:03:42.005760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:03:42.005760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:03:42.005760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:03:42.005760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:03:42.005760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:03:42.005760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:03:42.007011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:03:42.007011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:03:42.007011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:03:42.007011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:03:42.007011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:03:42.007011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:03:42.007011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:03:42.007011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:03:42.007011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:03:42.007011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:03:42.007011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:03:42.007011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:03:42.007011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:03:42.007011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:03:42.007011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:03:42.007011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:03:42.008063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:03:42.008063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:03:42.008063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:03:42.008063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:03:42.008063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:03:42.008063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:03:42.008063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:03:42.008063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:03:42.008063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:03:42.008063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:03:42.008063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:03:42.008063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:03:42.008063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 590/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:03:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:03:42.012708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43693336-8e39-40fa-8edd-28d492f8d365 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:42.107823 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43693336-8e39-40fa-8edd-28d492f8d365 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:42.123244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:42.140446 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a816bf3-015f-47e1-9302-2e22d45a3c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:42.141102 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a816bf3-015f-47e1-9302-2e22d45a3c18 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:42.141380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a816bf3-015f-47e1-9302-2e22d45a3c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:42.141650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a816bf3-015f-47e1-9302-2e22d45a3c18 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:42.142412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a816bf3-015f-47e1-9302-2e22d45a3c18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:42.142716 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a816bf3-015f-47e1-9302-2e22d45a3c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:42.144086 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a816bf3-015f-47e1-9302-2e22d45a3c18 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:42.151782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 599/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:03:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:42.157828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bed71a-a8de-4526-ad7a-a1792890e777 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:42.203398 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:42.256854 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bed71a-a8de-4526-ad7a-a1792890e777 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:42.289847 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d990b67-a045-453b-84d1-178aa53d74c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:42.290724 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d990b67-a045-453b-84d1-178aa53d74c6 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:42.291007 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d990b67-a045-453b-84d1-178aa53d74c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:42.291279 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d990b67-a045-453b-84d1-178aa53d74c6 None admin] PATH_INFO: `/v3/users/a9e9cfd87b5d47ab9073cd4bee79a34d` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:42.292469 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d990b67-a045-453b-84d1-178aa53d74c6 None admin] RBAC: Authorizing `identity:get_user(user_id=a9e9cfd87b5d47ab9073cd4bee79a34d)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:42.293916 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d990b67-a045-453b-84d1-178aa53d74c6 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:42.295818 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 591/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:03:42 2022] GET /identity/v3/users/a9e9cfd87b5d47ab9073cd4bee79a34d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:42.301301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a816bf3-015f-47e1-9302-2e22d45a3c18 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:42.398161 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a816bf3-015f-47e1-9302-2e22d45a3c18 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:42.430425 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa83b73-91fd-4539-9547-e6a1d52cc344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:42.431263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa83b73-91fd-4539-9547-e6a1d52cc344 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:42.431540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa83b73-91fd-4539-9547-e6a1d52cc344 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:42.431814 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa83b73-91fd-4539-9547-e6a1d52cc344 None admin] PATH_INFO: `/v3/projects/784d91b7e2b74a5c96ebe5f97ac103c3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:42.432980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa83b73-91fd-4539-9547-e6a1d52cc344 None admin] RBAC: Authorizing `identity:get_project(project_id=784d91b7e2b74a5c96ebe5f97ac103c3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:42.434434 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa83b73-91fd-4539-9547-e6a1d52cc344 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:42.436095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 600/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:03:42 2022] GET /identity/v3/projects/784d91b7e2b74a5c96ebe5f97ac103c3 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:42.441974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d990b67-a045-453b-84d1-178aa53d74c6 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:42.538826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d990b67-a045-453b-84d1-178aa53d74c6 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:42.552062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:42.571814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9e42e-3828-41f0-860b-db29cbbb7535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:42.572692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9e42e-3828-41f0-860b-db29cbbb7535 None admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:42.572979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9e42e-3828-41f0-860b-db29cbbb7535 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:42.573261 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9e42e-3828-41f0-860b-db29cbbb7535 None admin] PATH_INFO: `/v3/projects/784d91b7e2b74a5c96ebe5f97ac103c3/users/a9e9cfd87b5d47ab9073cd4bee79a34d/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:42.575720 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9e42e-3828-41f0-860b-db29cbbb7535 None admin] RBAC: Authorizing `identity:create_grant(project_id=784d91b7e2b74a5c96ebe5f97ac103c3, user_id=a9e9cfd87b5d47ab9073cd4bee79a34d, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:42.577144 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9e42e-3828-41f0-860b-db29cbbb7535 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:42.589105 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 592/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:03:42 2022] PUT /identity/v3/projects/784d91b7e2b74a5c96ebe5f97ac103c3/users/a9e9cfd87b5d47ab9073cd4bee79a34d/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:03:44.552040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787aaa3-625c-4c60-ac32-59f14e0eb406 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:44.552539 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787aaa3-625c-4c60-ac32-59f14e0eb406 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:44.552637 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787aaa3-625c-4c60-ac32-59f14e0eb406 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:44.553952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 601/1193] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:03:44.559738 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8aaf7-1bf6-49bb-9d43-3143a1512a71 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:44.560147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8aaf7-1bf6-49bb-9d43-3143a1512a71 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:44.560294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8aaf7-1bf6-49bb-9d43-3143a1512a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:44.577777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-58b8aaf7-1bf6-49bb-9d43-3143a1512a71 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:03:44.578979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-58b8aaf7-1bf6-49bb-9d43-3143a1512a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:03:44.642088 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 593/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:03:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:03:44.664097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787aaa3-625c-4c60-ac32-59f14e0eb406 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:44.710553 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:44.762286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787aaa3-625c-4c60-ac32-59f14e0eb406 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:44.795225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0dbfb-f2e6-4b93-9224-90ffadcda561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:44.796004 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0dbfb-f2e6-4b93-9224-90ffadcda561 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:44.796279 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0dbfb-f2e6-4b93-9224-90ffadcda561 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:44.796548 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0dbfb-f2e6-4b93-9224-90ffadcda561 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:44.806279 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0dbfb-f2e6-4b93-9224-90ffadcda561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:03:44.814483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a8d0dbfb-f2e6-4b93-9224-90ffadcda561 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:03:44.814483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:03:44.814483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:03:44.814483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:03:44.814483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:03:44.814483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:03:44.814483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:03:44.814483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:03:44.814483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:03:44.814483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:03:44.814483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:03:44.814483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:03:44.814483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:03:44.814483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:03:44.814483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:03:44.814483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:03:44.815560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:03:44.815560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:03:44.815560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:03:44.815560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:03:44.815560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:03:44.815560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:03:44.815560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:03:44.815560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:03:44.815560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:03:44.815560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:03:44.815560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:03:44.815560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:03:44.815560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:03:44.815560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:03:44.815560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:03:44.815560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:03:44.816586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:03:44.816586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:03:44.816586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:03:44.816586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:03:44.816586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:03:44.816586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:03:44.816586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:03:44.816586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:03:44.816586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:03:44.816586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:03:44.816586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:03:44.816586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:03:44.816586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 602/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:03:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:03:44.821677 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8aaf7-1bf6-49bb-9d43-3143a1512a71 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:44.916156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8aaf7-1bf6-49bb-9d43-3143a1512a71 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:44.918431 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:44.963806 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cef88-5ad7-4690-a1a8-53341b32f144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:44.964461 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cef88-5ad7-4690-a1a8-53341b32f144 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:44.964742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cef88-5ad7-4690-a1a8-53341b32f144 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:44.965013 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cef88-5ad7-4690-a1a8-53341b32f144 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:44.966273 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cef88-5ad7-4690-a1a8-53341b32f144 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:44.966578 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cef88-5ad7-4690-a1a8-53341b32f144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:44.967920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cef88-5ad7-4690-a1a8-53341b32f144 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:44.975709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 594/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:03:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:44.982126 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0dbfb-f2e6-4b93-9224-90ffadcda561 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:45.077475 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0dbfb-f2e6-4b93-9224-90ffadcda561 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:45.084004 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:45.110574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67342a2d-1c0f-4517-b250-d56a869a1e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:45.111412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67342a2d-1c0f-4517-b250-d56a869a1e19 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:45.111689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67342a2d-1c0f-4517-b250-d56a869a1e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:45.111958 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67342a2d-1c0f-4517-b250-d56a869a1e19 None admin] PATH_INFO: `/v3/users/a9e9cfd87b5d47ab9073cd4bee79a34d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:45.113106 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67342a2d-1c0f-4517-b250-d56a869a1e19 None admin] RBAC: Authorizing `identity:get_user(user_id=a9e9cfd87b5d47ab9073cd4bee79a34d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:45.114629 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67342a2d-1c0f-4517-b250-d56a869a1e19 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:45.116213 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 603/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Mon Jul 25 12:03:44 2022] GET /identity/v3/users/a9e9cfd87b5d47ab9073cd4bee79a34d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:45.121887 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cef88-5ad7-4690-a1a8-53341b32f144 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:45.219554 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cef88-5ad7-4690-a1a8-53341b32f144 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:45.252680 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba8765-f12d-439a-a223-bfb1cabdb0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:45.253316 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba8765-f12d-439a-a223-bfb1cabdb0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:45.253598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba8765-f12d-439a-a223-bfb1cabdb0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:45.253873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba8765-f12d-439a-a223-bfb1cabdb0b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:45.286446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:45.318919 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba8765-f12d-439a-a223-bfb1cabdb0b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:45.320334 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba8765-f12d-439a-a223-bfb1cabdb0b5 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:45.416430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 595/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:03:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 12:03:45.422500 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67342a2d-1c0f-4517-b250-d56a869a1e19 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:45.521520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67342a2d-1c0f-4517-b250-d56a869a1e19 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:45.554038 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5a0a0-4701-4387-80bf-bb65c4d89966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:45.554881 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5a0a0-4701-4387-80bf-bb65c4d89966 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:45.555158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5a0a0-4701-4387-80bf-bb65c4d89966 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:45.555428 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5a0a0-4701-4387-80bf-bb65c4d89966 None admin] PATH_INFO: `/v3/projects/784d91b7e2b74a5c96ebe5f97ac103c3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:45.556583 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5a0a0-4701-4387-80bf-bb65c4d89966 None admin] RBAC: Authorizing `identity:get_project(project_id=784d91b7e2b74a5c96ebe5f97ac103c3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:45.558046 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5a0a0-4701-4387-80bf-bb65c4d89966 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:45.559748 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 604/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Mon Jul 25 12:03:45 2022] GET /identity/v3/projects/784d91b7e2b74a5c96ebe5f97ac103c3 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:03:45.565843 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba8765-f12d-439a-a223-bfb1cabdb0b5 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:03:45.629078 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:45.662916 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba8765-f12d-439a-a223-bfb1cabdb0b5 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:03:45.695561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9854360-98aa-453b-a182-d37402fc5aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:03:45.696147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9854360-98aa-453b-a182-d37402fc5aeb None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:03:45.696429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9854360-98aa-453b-a182-d37402fc5aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:03:45.696704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9854360-98aa-453b-a182-d37402fc5aeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:03:45.697527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9854360-98aa-453b-a182-d37402fc5aeb None admin] RBAC: Adding query filter params (role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.project.id=784d91b7e2b74a5c96ebe5f97ac103c3, user.id=a9e9cfd87b5d47ab9073cd4bee79a34d) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:03:45.697838 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9854360-98aa-453b-a182-d37402fc5aeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:03:45.699270 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9854360-98aa-453b-a182-d37402fc5aeb None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:03:45.705488 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 596/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:03:45 2022] GET /identity/v3/role_assignments?user.id=a9e9cfd87b5d47ab9073cd4bee79a34d&scope.project.id=784d91b7e2b74a5c96ebe5f97ac103c3&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:03:55.550045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=79 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:03:55.702966 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=35 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:39.725454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61df7b-b6f8-4bad-98ba-a5bd1bd735a7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:39.726029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61df7b-b6f8-4bad-98ba-a5bd1bd735a7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:39.726029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61df7b-b6f8-4bad-98ba-a5bd1bd735a7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:39.727669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 605/1201] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:04:39.734798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef8e19-3892-4df8-86a6-d1efe126d905 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:39.735339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef8e19-3892-4df8-86a6-d1efe126d905 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:39.735339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef8e19-3892-4df8-86a6-d1efe126d905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:39.758991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-c2ef8e19-3892-4df8-86a6-d1efe126d905 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:04:39.759816 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c2ef8e19-3892-4df8-86a6-d1efe126d905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:04:39.849791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 597/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:04:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:04:39.880268 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61df7b-b6f8-4bad-98ba-a5bd1bd735a7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:40.010966 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61df7b-b6f8-4bad-98ba-a5bd1bd735a7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:40.054219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d67e5-1e07-495d-8122-c25ad4e8f345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:40.055103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d67e5-1e07-495d-8122-c25ad4e8f345 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:40.055369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d67e5-1e07-495d-8122-c25ad4e8f345 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:40.055663 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d67e5-1e07-495d-8122-c25ad4e8f345 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:40.069355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d67e5-1e07-495d-8122-c25ad4e8f345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:40.071323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d67e5-1e07-495d-8122-c25ad4e8f345 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:40.093867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-235d67e5-1e07-495d-8122-c25ad4e8f345 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:04:40.093867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:40.093867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:40.093867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:40.093867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:40.093867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:40.093867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:40.093867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:40.093867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:40.093867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:40.093867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:40.093867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:40.093867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:04:40.093867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:04:40.093867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:04:40.094989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:04:40.094989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:40.094989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:40.094989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:40.094989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:40.094989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:40.094989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:40.094989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:40.094989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:40.094989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:40.094989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:40.094989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:40.094989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:40.094989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:40.094989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:40.094989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:40.094989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:40.095933 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:04:40.095933 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:04:40.095933 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:04:40.095933 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:04:40.098432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 606/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:04:40.105964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef8e19-3892-4df8-86a6-d1efe126d905 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:40.238137 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef8e19-3892-4df8-86a6-d1efe126d905 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:40.276541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:40.283888 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cf79a-13f1-4c27-9ecb-71806743fc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:40.284577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cf79a-13f1-4c27-9ecb-71806743fc28 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:40.284938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cf79a-13f1-4c27-9ecb-71806743fc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:40.285219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cf79a-13f1-4c27-9ecb-71806743fc28 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:40.286121 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cf79a-13f1-4c27-9ecb-71806743fc28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:40.286432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cf79a-13f1-4c27-9ecb-71806743fc28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:40.287949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cf79a-13f1-4c27-9ecb-71806743fc28 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:40.304573 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 598/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:04:40.312943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d67e5-1e07-495d-8122-c25ad4e8f345 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:40.405436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:40.464188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d67e5-1e07-495d-8122-c25ad4e8f345 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:40.505530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1343938-ddbf-41f6-8cc9-02c39a746ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:40.506350 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1343938-ddbf-41f6-8cc9-02c39a746ca6 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:40.506613 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1343938-ddbf-41f6-8cc9-02c39a746ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:40.506901 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1343938-ddbf-41f6-8cc9-02c39a746ca6 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:40.507658 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1343938-ddbf-41f6-8cc9-02c39a746ca6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:40.509124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1343938-ddbf-41f6-8cc9-02c39a746ca6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:40.540243 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 607/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Mon Jul 25 12:04:40 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:04:42.738724 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e9844-a972-45c6-bcba-f7bc6e0490c2 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:42.739284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e9844-a972-45c6-bcba-f7bc6e0490c2 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:42.739284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e9844-a972-45c6-bcba-f7bc6e0490c2 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:42.740573 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 599/1206] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:04:42.745840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa47f0-9285-4dd6-aea7-e396437ab33c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:42.746415 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa47f0-9285-4dd6-aea7-e396437ab33c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:42.746415 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa47f0-9285-4dd6-aea7-e396437ab33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:42.764959 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-68aa47f0-9285-4dd6-aea7-e396437ab33c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:04:42.766168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-68aa47f0-9285-4dd6-aea7-e396437ab33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:04:42.850122 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 608/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:04:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:04:42.878042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e9844-a972-45c6-bcba-f7bc6e0490c2 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:43.001106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e9844-a972-45c6-bcba-f7bc6e0490c2 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:43.041233 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423b1fc-1ec3-43c9-a457-b52561316a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:43.042135 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423b1fc-1ec3-43c9-a457-b52561316a5a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:43.042436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423b1fc-1ec3-43c9-a457-b52561316a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:43.042713 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423b1fc-1ec3-43c9-a457-b52561316a5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:43.055184 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423b1fc-1ec3-43c9-a457-b52561316a5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:04:43.063400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-0423b1fc-1ec3-43c9-a457-b52561316a5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:04:43.063400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:43.063400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:43.063400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:43.063400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:43.063400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:43.063400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:43.063400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:43.063400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:43.063400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:43.063400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:43.063400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:43.063400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:04:43.063400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:04:43.063400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:04:43.063400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:04:43.064424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:04:43.064424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:04:43.064424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:04:43.064424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:04:43.064424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:43.064424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:43.064424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:43.064424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:43.064424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:43.064424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:43.064424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:43.064424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:43.064424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:43.064424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:43.064424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:43.064424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:43.065339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:43.065339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:43.065339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:43.065339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:43.065339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:04:43.065339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:04:43.065339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:04:43.065339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:04:43.065339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:04:43.065339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:04:43.065339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:04:43.065339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:04:43.065339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 600/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:04:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:43.071534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa47f0-9285-4dd6-aea7-e396437ab33c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:43.118100 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:43.191759 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa47f0-9285-4dd6-aea7-e396437ab33c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:43.234191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681c63e-ad70-41dc-8a38-3730c2312d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:43.234918 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681c63e-ad70-41dc-8a38-3730c2312d8e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:43.235208 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681c63e-ad70-41dc-8a38-3730c2312d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:43.235440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681c63e-ad70-41dc-8a38-3730c2312d8e None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:43.236230 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681c63e-ad70-41dc-8a38-3730c2312d8e None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:43.236472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681c63e-ad70-41dc-8a38-3730c2312d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:43.237918 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681c63e-ad70-41dc-8a38-3730c2312d8e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:43.246253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 609/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:04:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:04:43.252809 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423b1fc-1ec3-43c9-a457-b52561316a5a None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:43.312305 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:43.370108 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423b1fc-1ec3-43c9-a457-b52561316a5a None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:43.408605 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e6e56-5b81-4f0b-aa62-dc63d3b3a00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:43.409379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e6e56-5b81-4f0b-aa62-dc63d3b3a00b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:43.409666 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e6e56-5b81-4f0b-aa62-dc63d3b3a00b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:43.409937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e6e56-5b81-4f0b-aa62-dc63d3b3a00b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:43.424239 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e6e56-5b81-4f0b-aa62-dc63d3b3a00b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:43.425688 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e6e56-5b81-4f0b-aa62-dc63d3b3a00b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:43.444019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-ad7e6e56-5b81-4f0b-aa62-dc63d3b3a00b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:04:43.444019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:43.444019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:43.444019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:43.444019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:43.444019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:43.444019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:43.444019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:43.444019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:43.444019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:43.444019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:43.444019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:43.444019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:04:43.444019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:04:43.444019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:04:43.445061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:04:43.445061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:43.445061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:43.445061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:43.445061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:43.445061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:43.445061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:43.445061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:43.445061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:43.445061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:43.445061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:43.445061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:43.445061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:43.445061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:43.445061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:43.445061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:43.445061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:43.445934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:04:43.445934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:04:43.445934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:04:43.445934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:04:43.450087 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 601/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:43.451453 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681c63e-ad70-41dc-8a38-3730c2312d8e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:43.564447 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:43.567330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681c63e-ad70-41dc-8a38-3730c2312d8e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:43.604450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abfbd8-421e-4499-8929-0d627c1775b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:43.605492 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abfbd8-421e-4499-8929-0d627c1775b0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:43.606100 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abfbd8-421e-4499-8929-0d627c1775b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:43.606343 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abfbd8-421e-4499-8929-0d627c1775b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:43.607058 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abfbd8-421e-4499-8929-0d627c1775b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:43.607354 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abfbd8-421e-4499-8929-0d627c1775b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:43.608754 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abfbd8-421e-4499-8929-0d627c1775b0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:43.621093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 610/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:04:43.630446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e6e56-5b81-4f0b-aa62-dc63d3b3a00b None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:43.755184 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e6e56-5b81-4f0b-aa62-dc63d3b3a00b None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:43.757124 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:43.798917 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65834b46-8b99-4dad-984c-a204291eb346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:43.799840 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65834b46-8b99-4dad-984c-a204291eb346 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:43.800119 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65834b46-8b99-4dad-984c-a204291eb346 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:43.800385 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65834b46-8b99-4dad-984c-a204291eb346 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:43.809509 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65834b46-8b99-4dad-984c-a204291eb346 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:43.811778 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65834b46-8b99-4dad-984c-a204291eb346 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:43.828023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-65834b46-8b99-4dad-984c-a204291eb346 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:04:43.828023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:43.828023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:43.828023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:43.828023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:43.828023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:43.828023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:43.828023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:43.828023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:43.828023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:43.828023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:43.828023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:43.828023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:04:43.828023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:04:43.828023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:04:43.828023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:04:43.829308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:43.829308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:43.829308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:04:43.829308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:04:43.829308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:04:43.829308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:04:43.829308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:43.829308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:43.829308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:43.829308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:43.829308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:43.829308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:43.829308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:43.829308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:43.829308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:43.829308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:43.829308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:43.829308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:43.836139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:43.836139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:43.836139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:04:43.836139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:04:43.836139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:04:43.836139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:04:43.836139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:04:43.836139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:04:43.836139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:04:43.836139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:04:43.836139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 602/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:04:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:43.836833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abfbd8-421e-4499-8929-0d627c1775b0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:43.961646 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abfbd8-421e-4499-8929-0d627c1775b0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:44.005310 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d2402-0e10-44e7-916f-9df2e6d6a461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:44.005982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d2402-0e10-44e7-916f-9df2e6d6a461 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:44.006288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d2402-0e10-44e7-916f-9df2e6d6a461 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:44.006559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d2402-0e10-44e7-916f-9df2e6d6a461 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:44.007420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d2402-0e10-44e7-916f-9df2e6d6a461 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:44.007690 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d2402-0e10-44e7-916f-9df2e6d6a461 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:44.009133 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d2402-0e10-44e7-916f-9df2e6d6a461 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:44.028140 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 611/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Mon Jul 25 12:04:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:04:44.034666 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65834b46-8b99-4dad-984c-a204291eb346 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:44.151928 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65834b46-8b99-4dad-984c-a204291eb346 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:44.198176 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a97451-e166-4303-9ba2-16b792bdb556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:44.199183 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a97451-e166-4303-9ba2-16b792bdb556 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:44.199489 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a97451-e166-4303-9ba2-16b792bdb556 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:44.199795 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a97451-e166-4303-9ba2-16b792bdb556 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:44.233854 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:44.281188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a97451-e166-4303-9ba2-16b792bdb556 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:44.283003 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a97451-e166-4303-9ba2-16b792bdb556 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:44.408200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 603/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:04:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:04:44.413825 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d2402-0e10-44e7-916f-9df2e6d6a461 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:44.435814 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:44.528377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d2402-0e10-44e7-916f-9df2e6d6a461 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:44.571283 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2eb1e-0210-440d-b917-6e36f861ee14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:44.572298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2eb1e-0210-440d-b917-6e36f861ee14 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:44.572783 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2eb1e-0210-440d-b917-6e36f861ee14 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:44.573155 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2eb1e-0210-440d-b917-6e36f861ee14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:44.583803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2eb1e-0210-440d-b917-6e36f861ee14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:44.585349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2eb1e-0210-440d-b917-6e36f861ee14 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:44.604220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6cd2eb1e-0210-440d-b917-6e36f861ee14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:04:44.604220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:44.604220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:44.604220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:44.604220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:44.604220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:44.604220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:44.604220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:44.604220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:44.604220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:44.604220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:44.604220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:44.604220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:04:44.604220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:04:44.604220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:04:44.605419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:04:44.605419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:44.605419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:44.605419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:44.605419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:44.605419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:44.605419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:44.605419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:44.605419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:44.605419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:44.605419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:44.605419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:44.605419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:44.605419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:44.605419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:44.605419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:44.605419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:44.606520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:04:44.606520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:04:44.606520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:04:44.606520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:04:44.607506 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 612/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:44.613551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a97451-e166-4303-9ba2-16b792bdb556 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:44.687209 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:44.733741 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a97451-e166-4303-9ba2-16b792bdb556 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:44.775324 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf3042-74f2-40ec-b2e1-a499e4e6e54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:44.776074 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf3042-74f2-40ec-b2e1-a499e4e6e54d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:44.776351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf3042-74f2-40ec-b2e1-a499e4e6e54d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:44.776633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf3042-74f2-40ec-b2e1-a499e4e6e54d None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:44.777397 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf3042-74f2-40ec-b2e1-a499e4e6e54d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:44.777710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf3042-74f2-40ec-b2e1-a499e4e6e54d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:44.779348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf3042-74f2-40ec-b2e1-a499e4e6e54d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:44.794390 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 604/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:04:44.800661 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2eb1e-0210-440d-b917-6e36f861ee14 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:44.889292 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:44.923780 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2eb1e-0210-440d-b917-6e36f861ee14 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:44.962798 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dcf56-884f-477c-be82-f61f2595c5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:44.963612 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dcf56-884f-477c-be82-f61f2595c5bb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:44.963932 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dcf56-884f-477c-be82-f61f2595c5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:44.964242 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dcf56-884f-477c-be82-f61f2595c5bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:44.972693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3dcf56-884f-477c-be82-f61f2595c5bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:44.974199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3dcf56-884f-477c-be82-f61f2595c5bb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:44.988487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-cf3dcf56-884f-477c-be82-f61f2595c5bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:04:44.988487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:44.988487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:44.988487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:44.988487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:44.988487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:44.988487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:44.988487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:44.988487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:44.988487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:44.988487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:44.988487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:44.988487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:04:44.988487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:04:44.988487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:04:44.989574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:04:44.989574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:44.989574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:44.989574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:44.989574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:44.989574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:44.989574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:44.989574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:44.989574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:44.989574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:44.989574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:44.989574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:44.989574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:44.989574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:44.989574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:44.989574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:44.989574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:44.990841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:04:44.990841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:04:44.990841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:04:44.990841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:04:44.990841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:04:44.990841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:04:44.990841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:04:44.990841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:04:44.990841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 613/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:04:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:44.995444 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf3042-74f2-40ec-b2e1-a499e4e6e54d None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:45.110779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf3042-74f2-40ec-b2e1-a499e4e6e54d None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:45.142370 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:45.150919 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5759635-50fc-4855-85aa-ca9fc9b93683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:45.151794 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5759635-50fc-4855-85aa-ca9fc9b93683 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:45.152163 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5759635-50fc-4855-85aa-ca9fc9b93683 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:45.152532 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5759635-50fc-4855-85aa-ca9fc9b93683 None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:45.153425 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5759635-50fc-4855-85aa-ca9fc9b93683 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:45.153841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5759635-50fc-4855-85aa-ca9fc9b93683 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:45.156167 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5759635-50fc-4855-85aa-ca9fc9b93683 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:45.178186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 605/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:04:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:04:45.184401 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dcf56-884f-477c-be82-f61f2595c5bb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:45.309626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dcf56-884f-477c-be82-f61f2595c5bb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:45.341488 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:45.349975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829e42c-badd-4078-b753-54ce41d201fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:45.350763 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e42c-badd-4078-b753-54ce41d201fb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:45.351123 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e42c-badd-4078-b753-54ce41d201fb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:45.351472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e42c-badd-4078-b753-54ce41d201fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:45.352579 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829e42c-badd-4078-b753-54ce41d201fb None admin] RBAC: Adding query filter params (role.id=0f49ec405a3c42a99beaaa0c79e67c5e, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=40f748b0f6b1433c87012793f0dda307) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:45.353012 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829e42c-badd-4078-b753-54ce41d201fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:45.354854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829e42c-badd-4078-b753-54ce41d201fb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:45.370238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 614/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:04:45 2022] GET /identity/v3/role_assignments?user.id=40f748b0f6b1433c87012793f0dda307&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=0f49ec405a3c42a99beaaa0c79e67c5e => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:04:47.430320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f94204-b657-4c69-82ad-683f50959347 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:47.430944 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f94204-b657-4c69-82ad-683f50959347 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:47.430944 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f94204-b657-4c69-82ad-683f50959347 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:47.432409 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 606/1220] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:04:47.438297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3341988-6edc-49f4-a015-58ed2a32c7bd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:47.438691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3341988-6edc-49f4-a015-58ed2a32c7bd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:47.438893 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3341988-6edc-49f4-a015-58ed2a32c7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:47.461183 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b3341988-6edc-49f4-a015-58ed2a32c7bd None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:04:47.462927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b3341988-6edc-49f4-a015-58ed2a32c7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:04:47.541708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 615/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:04:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:04:47.564812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f94204-b657-4c69-82ad-683f50959347 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:47.667347 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f94204-b657-4c69-82ad-683f50959347 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:47.702794 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ee989-a3a5-4514-a210-6451113601e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:47.703502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ee989-a3a5-4514-a210-6451113601e9 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:47.703779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ee989-a3a5-4514-a210-6451113601e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:47.704048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ee989-a3a5-4514-a210-6451113601e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:47.714495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ee989-a3a5-4514-a210-6451113601e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:04:47.722240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-643ee989-a3a5-4514-a210-6451113601e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:04:47.722240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:47.722240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:47.722240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:47.722240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:47.722240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:47.722240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:47.722240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:47.722240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:47.722240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:47.722240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:47.722240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:47.722240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:04:47.722240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:04:47.722240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:04:47.722240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:04:47.723377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:04:47.723377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:04:47.723377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:04:47.723377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:04:47.723377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:47.723377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:47.723377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:47.723377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:47.723377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:47.723377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:47.723377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:47.723377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:47.723377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:47.723377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:47.723377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:47.723377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:47.729112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:47.729112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:47.729112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:47.729112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:47.729112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:04:47.729112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:04:47.729112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:04:47.729112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:04:47.729112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:04:47.729112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:04:47.729112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:04:47.729112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:04:47.729112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 607/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:04:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:47.729980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3341988-6edc-49f4-a015-58ed2a32c7bd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:47.836444 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3341988-6edc-49f4-a015-58ed2a32c7bd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:47.861874 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:47.875034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b9831-a735-44dd-915a-4f5a3abeafaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:47.875711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b9831-a735-44dd-915a-4f5a3abeafaa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:47.875986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b9831-a735-44dd-915a-4f5a3abeafaa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:47.876260 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b9831-a735-44dd-915a-4f5a3abeafaa None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:47.877004 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b9831-a735-44dd-915a-4f5a3abeafaa None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:47.877306 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b9831-a735-44dd-915a-4f5a3abeafaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:47.878723 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b9831-a735-44dd-915a-4f5a3abeafaa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:47.886812 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 616/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:04:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:04:47.893411 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ee989-a3a5-4514-a210-6451113601e9 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:47.942723 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:48.005553 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ee989-a3a5-4514-a210-6451113601e9 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:48.040360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6e13a-ddff-4d96-845f-d75da4a8697f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:48.041212 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6e13a-ddff-4d96-845f-d75da4a8697f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:48.041493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6e13a-ddff-4d96-845f-d75da4a8697f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:48.041793 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6e13a-ddff-4d96-845f-d75da4a8697f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:48.056217 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6e13a-ddff-4d96-845f-d75da4a8697f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:48.057665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6e13a-ddff-4d96-845f-d75da4a8697f None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:48.079148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-45d6e13a-ddff-4d96-845f-d75da4a8697f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:04:48.079148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:48.079148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:48.079148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:48.079148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:48.079148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:48.079148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:48.079148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:48.079148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:48.079148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:48.079148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:48.079148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:48.079148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:04:48.079148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:04:48.079148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:04:48.080345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:04:48.080345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:48.080345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:48.080345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:48.080345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:48.080345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:48.080345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:48.080345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:48.080345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:48.080345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:48.080345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:48.080345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:48.080345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:48.080345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:48.080345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:48.080345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:48.080345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:48.081240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:04:48.081240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:04:48.081240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:04:48.081240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:04:48.081240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 608/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:48.086337 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b9831-a735-44dd-915a-4f5a3abeafaa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:48.194114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b9831-a735-44dd-915a-4f5a3abeafaa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:48.236089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921230fb-2e97-4147-9179-38e21c4416b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:48.236752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921230fb-2e97-4147-9179-38e21c4416b8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:48.237031 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921230fb-2e97-4147-9179-38e21c4416b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:48.237301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921230fb-2e97-4147-9179-38e21c4416b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:48.238042 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921230fb-2e97-4147-9179-38e21c4416b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:48.238355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921230fb-2e97-4147-9179-38e21c4416b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:48.239715 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921230fb-2e97-4147-9179-38e21c4416b8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:48.252339 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 617/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:04:48.258283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6e13a-ddff-4d96-845f-d75da4a8697f None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:48.361704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:48.369466 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6e13a-ddff-4d96-845f-d75da4a8697f None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:48.405277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fae35-c674-4c8a-8483-b23c48bb65a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:48.406112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fae35-c674-4c8a-8483-b23c48bb65a2 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:48.406425 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fae35-c674-4c8a-8483-b23c48bb65a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:48.406671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fae35-c674-4c8a-8483-b23c48bb65a2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:48.415214 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fae35-c674-4c8a-8483-b23c48bb65a2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:48.416979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fae35-c674-4c8a-8483-b23c48bb65a2 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:48.434456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-e98fae35-c674-4c8a-8483-b23c48bb65a2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:04:48.434456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:48.434456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:48.434456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:48.434456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:48.434456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:48.434456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:48.434456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:48.434456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:48.434456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:48.434456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:48.434456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:48.434456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:04:48.434456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:04:48.434456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:04:48.434456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:04:48.435933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:48.435933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:48.435933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:04:48.435933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:04:48.435933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:04:48.435933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:04:48.435933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:48.435933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:48.435933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:48.435933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:48.435933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:48.435933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:48.435933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:48.435933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:48.435933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:48.435933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:48.435933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:48.435933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:48.437432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:48.437432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:48.437432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:04:48.437432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:04:48.437432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:04:48.437432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:04:48.437432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:04:48.437432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:04:48.437432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:04:48.437432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:04:48.437432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 609/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:04:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:48.442323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921230fb-2e97-4147-9179-38e21c4416b8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:48.504062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:48.569450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921230fb-2e97-4147-9179-38e21c4416b8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:48.606465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223749d-97fd-4e94-bb33-330c64dce8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:48.607168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223749d-97fd-4e94-bb33-330c64dce8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:48.607414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223749d-97fd-4e94-bb33-330c64dce8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:48.607721 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223749d-97fd-4e94-bb33-330c64dce8f5 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:48.609106 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223749d-97fd-4e94-bb33-330c64dce8f5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:48.609413 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223749d-97fd-4e94-bb33-330c64dce8f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:48.610892 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223749d-97fd-4e94-bb33-330c64dce8f5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:48.630951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 618/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Mon Jul 25 12:04:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:04:48.636704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fae35-c674-4c8a-8483-b23c48bb65a2 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:48.756765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fae35-c674-4c8a-8483-b23c48bb65a2 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:48.797481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535d40c-8197-43f2-a737-51a529b0ddce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:48.798303 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535d40c-8197-43f2-a737-51a529b0ddce None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:48.798590 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535d40c-8197-43f2-a737-51a529b0ddce None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:48.798872 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535d40c-8197-43f2-a737-51a529b0ddce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:48.809381 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535d40c-8197-43f2-a737-51a529b0ddce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:48.811135 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535d40c-8197-43f2-a737-51a529b0ddce None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:48.830387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-f535d40c-8197-43f2-a737-51a529b0ddce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:04:48.830387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:48.830387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:48.830387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:48.830387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:48.830387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:48.830387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:48.830387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:48.830387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:48.830387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:48.830387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:48.830387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:48.830387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:04:48.830387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:04:48.830387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:04:48.831514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:04:48.831514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:48.831514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:48.831514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:48.831514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:48.831514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:48.831514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:48.831514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:48.831514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:48.831514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:48.831514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:48.831514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:48.831514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:48.831514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:48.831514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:48.831514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:48.831514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:48.832660 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:04:48.832660 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:04:48.832660 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:04:48.832660 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:04:48.832660 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 610/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:48.838084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223749d-97fd-4e94-bb33-330c64dce8f5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:48.957883 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223749d-97fd-4e94-bb33-330c64dce8f5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:48.960597 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:48.998764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dc704-acb9-4a8d-b549-add33a0e8f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:48.999444 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dc704-acb9-4a8d-b549-add33a0e8f05 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:48.999758 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dc704-acb9-4a8d-b549-add33a0e8f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:49.000032 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dc704-acb9-4a8d-b549-add33a0e8f05 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:49.000827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7dc704-acb9-4a8d-b549-add33a0e8f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:49.001141 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7dc704-acb9-4a8d-b549-add33a0e8f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:49.002589 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7dc704-acb9-4a8d-b549-add33a0e8f05 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:49.020317 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 619/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:04:49.021712 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535d40c-8197-43f2-a737-51a529b0ddce None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:49.033138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:49.131366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535d40c-8197-43f2-a737-51a529b0ddce None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:49.172382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ee776-a40a-4795-8a79-f8cce977605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:49.173692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ee776-a40a-4795-8a79-f8cce977605d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:49.174289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ee776-a40a-4795-8a79-f8cce977605d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:49.174643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ee776-a40a-4795-8a79-f8cce977605d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:49.183385 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ee776-a40a-4795-8a79-f8cce977605d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:49.184987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ee776-a40a-4795-8a79-f8cce977605d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:49.205115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-246ee776-a40a-4795-8a79-f8cce977605d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:04:49.205115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:49.205115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:49.205115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:49.205115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:49.205115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:49.205115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:49.205115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:49.205115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:49.205115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:49.205115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:49.205115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:49.205115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:04:49.205115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:04:49.205115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:04:49.206377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:04:49.206377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:49.206377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:49.206377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:49.206377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:49.206377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:49.206377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:49.206377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:49.206377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:49.206377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:49.206377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:49.206377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:49.206377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:49.206377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:49.206377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:49.206377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:49.206377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:49.207363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:04:49.207363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:04:49.207363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:04:49.207363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:04:49.207363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:04:49.207363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:04:49.207363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:04:49.207363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:04:49.207363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 611/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:04:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:04:49.213776 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dc704-acb9-4a8d-b549-add33a0e8f05 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:49.323598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dc704-acb9-4a8d-b549-add33a0e8f05 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:49.361331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be80f91-da1b-48ac-8d26-0c4d608f93eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:49.362064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be80f91-da1b-48ac-8d26-0c4d608f93eb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:49.362318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be80f91-da1b-48ac-8d26-0c4d608f93eb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:49.362594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be80f91-da1b-48ac-8d26-0c4d608f93eb None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:49.363442 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be80f91-da1b-48ac-8d26-0c4d608f93eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:49.363744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be80f91-da1b-48ac-8d26-0c4d608f93eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:49.365258 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be80f91-da1b-48ac-8d26-0c4d608f93eb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:49.379275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 620/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:04:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:04:49.385452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ee776-a40a-4795-8a79-f8cce977605d None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:49.461624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:49.500239 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ee776-a40a-4795-8a79-f8cce977605d None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:49.536380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c5b26-cb6d-41b0-99b0-c52a999e05c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:49.537266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c5b26-cb6d-41b0-99b0-c52a999e05c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:49.537545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c5b26-cb6d-41b0-99b0-c52a999e05c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:49.537818 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c5b26-cb6d-41b0-99b0-c52a999e05c2 None admin] PATH_INFO: `/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/40f748b0f6b1433c87012793f0dda307/roles/0f49ec405a3c42a99beaaa0c79e67c5e` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:49.554392 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c5b26-cb6d-41b0-99b0-c52a999e05c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c80b9db7ace42c0a0cd1f31901599fd, user_id=40f748b0f6b1433c87012793f0dda307, role_id=0f49ec405a3c42a99beaaa0c79e67c5e)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:49.555968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c5b26-cb6d-41b0-99b0-c52a999e05c2 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:49.568712 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 612/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:04:49 2022] PUT /identity/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/40f748b0f6b1433c87012793f0dda307/roles/0f49ec405a3c42a99beaaa0c79e67c5e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:04:51.768322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac25d1-e6dc-4a56-9f99-d0756b6e9199 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:51.768837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac25d1-e6dc-4a56-9f99-d0756b6e9199 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:51.768837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac25d1-e6dc-4a56-9f99-d0756b6e9199 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:51.770186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 621/1233] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:04:51.775457 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec647e7e-32f9-4762-81b7-c6d0991fd428 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:51.775865 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec647e7e-32f9-4762-81b7-c6d0991fd428 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:51.776006 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec647e7e-32f9-4762-81b7-c6d0991fd428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:51.794493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-ec647e7e-32f9-4762-81b7-c6d0991fd428 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:04:51.796544 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ec647e7e-32f9-4762-81b7-c6d0991fd428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:04:51.869594 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 613/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:04:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:04:51.896296 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac25d1-e6dc-4a56-9f99-d0756b6e9199 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:51.925523 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:52.008447 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac25d1-e6dc-4a56-9f99-d0756b6e9199 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:52.044255 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ff524-f6cb-404a-8d57-b87e595138ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:52.045220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ff524-f6cb-404a-8d57-b87e595138ed None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:52.045599 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ff524-f6cb-404a-8d57-b87e595138ed None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:52.045876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ff524-f6cb-404a-8d57-b87e595138ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:52.056239 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ff524-f6cb-404a-8d57-b87e595138ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:04:52.063945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-347ff524-f6cb-404a-8d57-b87e595138ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:04:52.063945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:52.063945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:52.063945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:52.063945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:52.063945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:52.063945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:52.063945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:52.063945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:52.063945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:52.063945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:52.063945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:52.063945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:04:52.063945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:04:52.063945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:04:52.063945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:04:52.065041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:04:52.065041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:04:52.065041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:04:52.065041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:04:52.065041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:52.065041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:52.065041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:52.065041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:52.065041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:52.065041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:52.065041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:52.065041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:52.065041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:52.065041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:52.065041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:52.065041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:52.065856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:52.065856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:52.065856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:52.065856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:52.065856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:04:52.065856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:04:52.065856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:04:52.065856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:04:52.065856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:04:52.065856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:04:52.065856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:04:52.065856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:04:52.065856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 622/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Mon Jul 25 12:04:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:52.071514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec647e7e-32f9-4762-81b7-c6d0991fd428 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:52.122180 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:52.183755 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec647e7e-32f9-4762-81b7-c6d0991fd428 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:52.230316 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36933147-d8f6-449b-801a-9bd2b90585dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:52.230980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36933147-d8f6-449b-801a-9bd2b90585dd None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:52.231301 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36933147-d8f6-449b-801a-9bd2b90585dd None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:52.231534 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36933147-d8f6-449b-801a-9bd2b90585dd None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:52.232276 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36933147-d8f6-449b-801a-9bd2b90585dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:52.232577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36933147-d8f6-449b-801a-9bd2b90585dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:52.233972 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36933147-d8f6-449b-801a-9bd2b90585dd None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:52.242882 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 614/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Mon Jul 25 12:04:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:04:52.248666 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ff524-f6cb-404a-8d57-b87e595138ed None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:52.338426 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:52.354925 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ff524-f6cb-404a-8d57-b87e595138ed None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:52.394782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2676d-e589-4af4-8db6-4eb4defc8c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:52.395724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2676d-e589-4af4-8db6-4eb4defc8c21 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:52.396006 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2676d-e589-4af4-8db6-4eb4defc8c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:52.396326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2676d-e589-4af4-8db6-4eb4defc8c21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:52.408890 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2676d-e589-4af4-8db6-4eb4defc8c21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:52.410636 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2676d-e589-4af4-8db6-4eb4defc8c21 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:52.431131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-85f2676d-e589-4af4-8db6-4eb4defc8c21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:04:52.431131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:52.431131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:52.431131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:52.431131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:52.431131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:52.431131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:52.431131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:52.431131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:52.431131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:52.431131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:52.431131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:52.431131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:04:52.431131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:04:52.431131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:04:52.432091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:04:52.432091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:52.432091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:52.432091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:52.432091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:52.432091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:52.432091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:52.432091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:52.432091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:52.432091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:52.432091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:52.432091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:52.432091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:52.432091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:52.432091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:52.432091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:52.432091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:52.433011 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:04:52.433011 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:04:52.433011 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:04:52.433011 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:04:52.433011 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 623/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:52.439212 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36933147-d8f6-449b-801a-9bd2b90585dd None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:52.552733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36933147-d8f6-449b-801a-9bd2b90585dd None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:52.562930 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:52.590557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627d3c6-56a8-4c8d-a403-431094acf2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:52.591148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627d3c6-56a8-4c8d-a403-431094acf2ed None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:52.591433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627d3c6-56a8-4c8d-a403-431094acf2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:52.591712 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627d3c6-56a8-4c8d-a403-431094acf2ed None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:52.592975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627d3c6-56a8-4c8d-a403-431094acf2ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:52.593317 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627d3c6-56a8-4c8d-a403-431094acf2ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:52.595059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627d3c6-56a8-4c8d-a403-431094acf2ed None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:52.610233 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 615/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:04:52.616172 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2676d-e589-4af4-8db6-4eb4defc8c21 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:52.734757 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2676d-e589-4af4-8db6-4eb4defc8c21 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:52.771243 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bac8da-5b84-42c7-b407-063a641677ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:52.772113 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bac8da-5b84-42c7-b407-063a641677ef None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:52.772516 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bac8da-5b84-42c7-b407-063a641677ef None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:52.772795 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bac8da-5b84-42c7-b407-063a641677ef None admin] PATH_INFO: `/v3/users/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:52.776571 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:52.782992 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bac8da-5b84-42c7-b407-063a641677ef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:52.785534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bac8da-5b84-42c7-b407-063a641677ef None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:52.802894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-25bac8da-5b84-42c7-b407-063a641677ef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:04:52.802894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:52.802894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:52.802894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:52.802894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:52.802894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:52.802894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:52.802894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:52.802894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:52.802894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:52.802894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:52.802894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:52.802894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:04:52.802894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:04:52.802894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:04:52.802894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:04:52.803990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:52.803990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:52.803990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:04:52.803990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:04:52.803990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:04:52.803990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:04:52.803990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:52.803990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:52.803990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:52.803990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:52.803990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:52.803990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:52.803990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:52.803990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:52.803990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:52.803990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:52.803990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:52.803990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:52.804922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:52.804922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:52.804922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:04:52.804922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:04:52.804922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:04:52.804922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:04:52.804922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:04:52.804922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:04:52.804922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:04:52.804922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:04:52.804922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 624/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:04:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:52.811698 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627d3c6-56a8-4c8d-a403-431094acf2ed None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:52.922460 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627d3c6-56a8-4c8d-a403-431094acf2ed None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:52.960246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebefa4-1dcf-4159-b3f1-3b6e097b2215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:52.960916 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebefa4-1dcf-4159-b3f1-3b6e097b2215 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:52.961198 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebefa4-1dcf-4159-b3f1-3b6e097b2215 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:52.961473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebefa4-1dcf-4159-b3f1-3b6e097b2215 None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:52.962348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebefa4-1dcf-4159-b3f1-3b6e097b2215 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:52.962664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebefa4-1dcf-4159-b3f1-3b6e097b2215 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:52.964079 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebefa4-1dcf-4159-b3f1-3b6e097b2215 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:52.982758 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 616/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Mon Jul 25 12:04:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:04:52.988536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bac8da-5b84-42c7-b407-063a641677ef None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:53.094953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bac8da-5b84-42c7-b407-063a641677ef None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:53.130022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3b334-c3cc-4bb9-99ae-5bfa4c957ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:53.130704 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3b334-c3cc-4bb9-99ae-5bfa4c957ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:53.130988 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3b334-c3cc-4bb9-99ae-5bfa4c957ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:53.131264 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3b334-c3cc-4bb9-99ae-5bfa4c957ee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:53.206919 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:53.216569 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3b334-c3cc-4bb9-99ae-5bfa4c957ee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:53.218569 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3b334-c3cc-4bb9-99ae-5bfa4c957ee7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:53.334873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 625/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:04:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:04:53.341142 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebefa4-1dcf-4159-b3f1-3b6e097b2215 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:53.373137 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:53.455181 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebefa4-1dcf-4159-b3f1-3b6e097b2215 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:53.494709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153d0a8-e7e0-4252-8641-1c611b35a7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:53.495514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153d0a8-e7e0-4252-8641-1c611b35a7eb None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:53.495801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153d0a8-e7e0-4252-8641-1c611b35a7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:53.496077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153d0a8-e7e0-4252-8641-1c611b35a7eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:53.506837 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153d0a8-e7e0-4252-8641-1c611b35a7eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:53.508284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153d0a8-e7e0-4252-8641-1c611b35a7eb None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:53.527829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-8153d0a8-e7e0-4252-8641-1c611b35a7eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:04:53.527829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:53.527829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:53.527829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:53.527829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:53.527829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:53.527829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:53.527829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:53.527829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:53.527829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:53.527829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:53.527829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:53.527829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:04:53.527829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:04:53.527829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:04:53.529058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:04:53.529058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:53.529058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:53.529058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:53.529058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:53.529058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:53.529058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:53.529058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:53.529058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:53.529058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:53.529058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:53.529058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:53.529058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:53.529058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:53.529058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:53.529058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:53.529058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:53.530578 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:04:53.530578 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:04:53.530578 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:04:53.530578 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:04:53.530578 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 617/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:53.535927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3b334-c3cc-4bb9-99ae-5bfa4c957ee7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:53.638726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:53.645008 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3b334-c3cc-4bb9-99ae-5bfa4c957ee7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:53.679771 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54017e2-3f1d-443b-bea6-8c2ec0d556d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:53.680432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54017e2-3f1d-443b-bea6-8c2ec0d556d5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:53.681687 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54017e2-3f1d-443b-bea6-8c2ec0d556d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:53.681964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54017e2-3f1d-443b-bea6-8c2ec0d556d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:53.682836 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54017e2-3f1d-443b-bea6-8c2ec0d556d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:53.683144 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54017e2-3f1d-443b-bea6-8c2ec0d556d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:53.684675 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54017e2-3f1d-443b-bea6-8c2ec0d556d5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:53.697698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 626/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:04:53.703629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153d0a8-e7e0-4252-8641-1c611b35a7eb None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:53.793431 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:53.821394 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153d0a8-e7e0-4252-8641-1c611b35a7eb None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:53.860192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd33a7-7fd8-4f30-af24-0df9670bcba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:53.860987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd33a7-7fd8-4f30-af24-0df9670bcba9 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:53.861268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd33a7-7fd8-4f30-af24-0df9670bcba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:53.861541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd33a7-7fd8-4f30-af24-0df9670bcba9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:53.868447 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd33a7-7fd8-4f30-af24-0df9670bcba9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:53.869885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd33a7-7fd8-4f30-af24-0df9670bcba9 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:53.884200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-b5fd33a7-7fd8-4f30-af24-0df9670bcba9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:04:53.884200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:53.884200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:53.884200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:53.884200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:53.884200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:53.884200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:53.884200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:53.884200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:53.884200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:53.884200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:53.884200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:53.884200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:04:53.884200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:04:53.884200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:04:53.885295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:04:53.885295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:53.885295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:53.885295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:53.885295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:53.885295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:53.885295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:53.885295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:53.885295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:53.885295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:53.885295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:53.885295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:53.885295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:53.885295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:53.885295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:53.885295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:53.885295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:53.886249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:04:53.886249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:04:53.886249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:04:53.886249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:04:53.886249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:04:53.886249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:04:53.886249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:04:53.886249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:04:53.886249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 618/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:04:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:53.891556 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54017e2-3f1d-443b-bea6-8c2ec0d556d5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:54.008356 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54017e2-3f1d-443b-bea6-8c2ec0d556d5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:54.047235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79b06a-aa36-4e15-a2cf-858b375de74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:54.048063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79b06a-aa36-4e15-a2cf-858b375de74a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:54.048445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79b06a-aa36-4e15-a2cf-858b375de74a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:54.048754 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79b06a-aa36-4e15-a2cf-858b375de74a None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:54.049777 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79b06a-aa36-4e15-a2cf-858b375de74a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:54.050117 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79b06a-aa36-4e15-a2cf-858b375de74a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:54.051634 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79b06a-aa36-4e15-a2cf-858b375de74a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:54.066979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 627/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:04:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:04:54.073439 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd33a7-7fd8-4f30-af24-0df9670bcba9 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:54.182812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd33a7-7fd8-4f30-af24-0df9670bcba9 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:54.223514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da5af2-be20-4bb9-a545-215e62a04cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:54.224254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da5af2-be20-4bb9-a545-215e62a04cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:54.224579 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da5af2-be20-4bb9-a545-215e62a04cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:54.224929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da5af2-be20-4bb9-a545-215e62a04cc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:54.225742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da5af2-be20-4bb9-a545-215e62a04cc1 None admin] RBAC: Adding query filter params (role.id=0f49ec405a3c42a99beaaa0c79e67c5e, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=40f748b0f6b1433c87012793f0dda307) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:54.226128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da5af2-be20-4bb9-a545-215e62a04cc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:54.227660 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da5af2-be20-4bb9-a545-215e62a04cc1 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:54.234768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 619/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:04:54 2022] GET /identity/v3/role_assignments?user.id=40f748b0f6b1433c87012793f0dda307&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=0f49ec405a3c42a99beaaa0c79e67c5e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:04:56.348951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09fe29-b973-488a-96ac-c73a81877796 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:56.349520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09fe29-b973-488a-96ac-c73a81877796 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:56.349520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09fe29-b973-488a-96ac-c73a81877796 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:56.351074 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 628/1247] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:04:56.356271 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c453307-a296-4a99-be4f-e16948bd46c4 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:56.356701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c453307-a296-4a99-be4f-e16948bd46c4 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:56.356828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c453307-a296-4a99-be4f-e16948bd46c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:56.363732 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:56.377271 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-9c453307-a296-4a99-be4f-e16948bd46c4 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:04:56.378496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-9c453307-a296-4a99-be4f-e16948bd46c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:04:56.453008 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 620/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:04:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:04:56.476793 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09fe29-b973-488a-96ac-c73a81877796 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:56.498525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:56.591495 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09fe29-b973-488a-96ac-c73a81877796 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:56.630219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ec4d8-1cbc-4186-88f3-b4d1504b9a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:56.630935 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ec4d8-1cbc-4186-88f3-b4d1504b9a30 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:56.631218 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ec4d8-1cbc-4186-88f3-b4d1504b9a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:56.631489 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ec4d8-1cbc-4186-88f3-b4d1504b9a30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:56.644978 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ec4d8-1cbc-4186-88f3-b4d1504b9a30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:04:56.653174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-909ec4d8-1cbc-4186-88f3-b4d1504b9a30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:04:56.653174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:56.653174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:56.653174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:56.653174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:56.653174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:56.653174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:56.653174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:56.653174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:56.653174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:56.653174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:56.653174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:56.653174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:04:56.653174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:04:56.653174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:04:56.653174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:04:56.654294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:04:56.654294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:04:56.654294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:04:56.654294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:04:56.654294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:56.654294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:56.654294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:56.654294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:56.654294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:56.654294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:56.654294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:56.654294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:56.654294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:56.654294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:56.654294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:56.654294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:56.655176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:56.655176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:56.655176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:56.655176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:56.655176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:04:56.655176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:04:56.655176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:04:56.655176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:04:56.655176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:04:56.655176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:04:56.655176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:04:56.655176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:04:56.655176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 629/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:04:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:56.660524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c453307-a296-4a99-be4f-e16948bd46c4 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:56.777082 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c453307-a296-4a99-be4f-e16948bd46c4 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:56.812758 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:56.819018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41055e39-134d-420c-a21c-9373403e290e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:56.819867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41055e39-134d-420c-a21c-9373403e290e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:56.820163 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41055e39-134d-420c-a21c-9373403e290e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:56.820577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41055e39-134d-420c-a21c-9373403e290e None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:56.821365 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41055e39-134d-420c-a21c-9373403e290e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:56.821779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41055e39-134d-420c-a21c-9373403e290e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:56.823382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41055e39-134d-420c-a21c-9373403e290e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:56.833422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 621/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:04:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:04:56.839189 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ec4d8-1cbc-4186-88f3-b4d1504b9a30 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:56.922178 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:56.946925 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ec4d8-1cbc-4186-88f3-b4d1504b9a30 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:56.985451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb302b-f415-4380-96b6-780c3e8ddf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:56.986367 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb302b-f415-4380-96b6-780c3e8ddf6a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:56.986670 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb302b-f415-4380-96b6-780c3e8ddf6a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:56.986926 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb302b-f415-4380-96b6-780c3e8ddf6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:56.998354 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb302b-f415-4380-96b6-780c3e8ddf6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:57.000277 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb302b-f415-4380-96b6-780c3e8ddf6a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:57.019219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c5bb302b-f415-4380-96b6-780c3e8ddf6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:04:57.019219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:57.019219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:57.019219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:57.019219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:57.019219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:57.019219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:57.019219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:57.019219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:57.019219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:57.019219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:57.019219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:57.019219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:04:57.019219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:04:57.019219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:04:57.020168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:04:57.020168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:57.020168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:57.020168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:57.020168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:57.020168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:57.020168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:57.020168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:57.020168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:57.020168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:57.020168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:57.020168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:57.020168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:57.020168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:57.020168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:57.020168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:57.020168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:57.021018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:04:57.021018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:04:57.021018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:04:57.021018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:04:57.021018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 630/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:57.026415 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41055e39-134d-420c-a21c-9373403e290e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:57.144687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41055e39-134d-420c-a21c-9373403e290e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:57.189140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfbb58-ef07-48bb-8444-49b8c73b6b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:57.189947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfbb58-ef07-48bb-8444-49b8c73b6b55 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:57.190266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfbb58-ef07-48bb-8444-49b8c73b6b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:57.190545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfbb58-ef07-48bb-8444-49b8c73b6b55 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:57.191291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfbb58-ef07-48bb-8444-49b8c73b6b55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:57.191600 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfbb58-ef07-48bb-8444-49b8c73b6b55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:57.193114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfbb58-ef07-48bb-8444-49b8c73b6b55 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:57.210300 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 622/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:04:57.216525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb302b-f415-4380-96b6-780c3e8ddf6a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:57.333212 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb302b-f415-4380-96b6-780c3e8ddf6a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:57.363767 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:57.372268 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1483441-1610-4edb-a1b5-67e99df56add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:57.373204 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1483441-1610-4edb-a1b5-67e99df56add None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:57.373476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1483441-1610-4edb-a1b5-67e99df56add None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:57.373767 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1483441-1610-4edb-a1b5-67e99df56add None admin] PATH_INFO: `/v3/users/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:57.381301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1483441-1610-4edb-a1b5-67e99df56add None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:57.382821 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1483441-1610-4edb-a1b5-67e99df56add None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:57.398241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c1483441-1610-4edb-a1b5-67e99df56add None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:04:57.398241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:57.398241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:57.398241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:57.398241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:57.398241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:57.398241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:57.398241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:57.398241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:57.398241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:57.398241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:57.398241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:57.398241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:04:57.398241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:04:57.398241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:04:57.398241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:04:57.399593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:57.399593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:57.399593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:04:57.399593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:04:57.399593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:04:57.399593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:04:57.399593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:57.399593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:57.399593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:57.399593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:57.399593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:57.399593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:57.399593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:57.399593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:57.399593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:57.399593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:57.399593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:57.399593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:57.400802 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:57.400802 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:57.400802 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:04:57.400802 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:04:57.400802 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:04:57.400802 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:04:57.400802 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:04:57.400802 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:04:57.400802 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:04:57.400802 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:04:57.400802 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 631/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:04:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:57.405888 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfbb58-ef07-48bb-8444-49b8c73b6b55 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:57.465920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:57.514757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfbb58-ef07-48bb-8444-49b8c73b6b55 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:57.559774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15302177-485c-41b6-8cfe-5b9f01ea69a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:57.560461 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15302177-485c-41b6-8cfe-5b9f01ea69a9 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:57.560776 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15302177-485c-41b6-8cfe-5b9f01ea69a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:57.561096 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15302177-485c-41b6-8cfe-5b9f01ea69a9 None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:57.561993 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15302177-485c-41b6-8cfe-5b9f01ea69a9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:57.562343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15302177-485c-41b6-8cfe-5b9f01ea69a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:57.563881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15302177-485c-41b6-8cfe-5b9f01ea69a9 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:57.584038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 623/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Mon Jul 25 12:04:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:04:57.590195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1483441-1610-4edb-a1b5-67e99df56add None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:57.694659 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1483441-1610-4edb-a1b5-67e99df56add None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:57.730752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d68652-e299-4f6b-9482-7eabd12fae2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:57.731407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d68652-e299-4f6b-9482-7eabd12fae2d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:57.731698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d68652-e299-4f6b-9482-7eabd12fae2d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:57.731968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d68652-e299-4f6b-9482-7eabd12fae2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:57.794453 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:57.808507 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d68652-e299-4f6b-9482-7eabd12fae2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:57.810019 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d68652-e299-4f6b-9482-7eabd12fae2d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:57.917895 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 632/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:04:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:04:57.924783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15302177-485c-41b6-8cfe-5b9f01ea69a9 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:58.025887 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15302177-485c-41b6-8cfe-5b9f01ea69a9 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:58.039868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:58.064040 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b04d6f-9a69-49b8-9a45-2f952ec3ba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:58.064836 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b04d6f-9a69-49b8-9a45-2f952ec3ba72 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:58.065120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b04d6f-9a69-49b8-9a45-2f952ec3ba72 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:58.065395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b04d6f-9a69-49b8-9a45-2f952ec3ba72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:58.075752 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b04d6f-9a69-49b8-9a45-2f952ec3ba72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:58.078200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b04d6f-9a69-49b8-9a45-2f952ec3ba72 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:58.098991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-26b04d6f-9a69-49b8-9a45-2f952ec3ba72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:04:58.098991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:58.098991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:58.098991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:58.098991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:58.098991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:58.098991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:58.098991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:58.098991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:58.098991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:58.098991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:58.098991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:58.098991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:04:58.098991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:04:58.098991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:04:58.100048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:04:58.100048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:58.100048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:58.100048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:58.100048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:58.100048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:58.100048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:58.100048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:58.100048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:58.100048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:58.100048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:58.100048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:58.100048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:58.100048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:58.100048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:58.100048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:58.100048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:58.101008 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:04:58.101008 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:04:58.101008 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:04:58.101008 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:04:58.101008 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 624/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:58.106265 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d68652-e299-4f6b-9482-7eabd12fae2d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:58.206615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:58.222979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d68652-e299-4f6b-9482-7eabd12fae2d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:58.263320 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb5a69-63d2-491d-8a42-86c9aab4c114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:58.264127 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb5a69-63d2-491d-8a42-86c9aab4c114 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:58.264454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb5a69-63d2-491d-8a42-86c9aab4c114 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:58.264802 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb5a69-63d2-491d-8a42-86c9aab4c114 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:58.265671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb5a69-63d2-491d-8a42-86c9aab4c114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:58.266040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb5a69-63d2-491d-8a42-86c9aab4c114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:58.267823 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb5a69-63d2-491d-8a42-86c9aab4c114 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:58.280155 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 633/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:04:58.285146 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b04d6f-9a69-49b8-9a45-2f952ec3ba72 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:58.398052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b04d6f-9a69-49b8-9a45-2f952ec3ba72 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:58.434074 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa9057-bd5b-468b-a545-eec36cdf5ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:58.434884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa9057-bd5b-468b-a545-eec36cdf5ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:58.435154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa9057-bd5b-468b-a545-eec36cdf5ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:58.435422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa9057-bd5b-468b-a545-eec36cdf5ba9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:58.443028 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa9057-bd5b-468b-a545-eec36cdf5ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:58.444503 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa9057-bd5b-468b-a545-eec36cdf5ba9 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:58.458393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-82aa9057-bd5b-468b-a545-eec36cdf5ba9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:04:58.458393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:04:58.458393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:04:58.458393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:04:58.458393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:04:58.458393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:04:58.458393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:04:58.458393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:04:58.458393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:04:58.458393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:04:58.458393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:04:58.458393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:04:58.458393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:04:58.458393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:04:58.458393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:04:58.459527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:04:58.459527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:04:58.459527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:04:58.459527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:04:58.459527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:04:58.459527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:04:58.459527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:04:58.459527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:04:58.459527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:04:58.459527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:04:58.459527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:04:58.459527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:04:58.459527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:04:58.459527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:04:58.459527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:04:58.459527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:04:58.459527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:04:58.460781 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:04:58.460781 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:04:58.460781 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:04:58.460781 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:04:58.460781 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:04:58.460781 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:04:58.460781 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:04:58.460781 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:04:58.460781 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 625/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:04:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:04:58.465347 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb5a69-63d2-491d-8a42-86c9aab4c114 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:58.572934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb5a69-63d2-491d-8a42-86c9aab4c114 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:58.610107 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242b973-9edf-4190-852c-022a3e5a39f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:58.610785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242b973-9edf-4190-852c-022a3e5a39f5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:58.611066 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242b973-9edf-4190-852c-022a3e5a39f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:58.611337 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242b973-9edf-4190-852c-022a3e5a39f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:58.612136 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242b973-9edf-4190-852c-022a3e5a39f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:58.612443 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242b973-9edf-4190-852c-022a3e5a39f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:58.613915 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242b973-9edf-4190-852c-022a3e5a39f5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:58.627019 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 634/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:04:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:04:58.633329 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa9057-bd5b-468b-a545-eec36cdf5ba9 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:04:58.661015 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:04:58.740189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa9057-bd5b-468b-a545-eec36cdf5ba9 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:04:58.774252 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9993279-994b-4db0-9a33-ff3c93a5087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:04:58.774915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9993279-994b-4db0-9a33-ff3c93a5087b None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:04:58.775195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9993279-994b-4db0-9a33-ff3c93a5087b None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:04:58.775466 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9993279-994b-4db0-9a33-ff3c93a5087b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:04:58.776310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9993279-994b-4db0-9a33-ff3c93a5087b None admin] RBAC: Adding query filter params (role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=40f748b0f6b1433c87012793f0dda307) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:04:58.776619 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9993279-994b-4db0-9a33-ff3c93a5087b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:04:58.778079 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9993279-994b-4db0-9a33-ff3c93a5087b None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:04:58.794052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 626/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:04:58 2022] GET /identity/v3/role_assignments?user.id=40f748b0f6b1433c87012793f0dda307&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:05:00.771350 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6e4fd-48af-455e-a765-1a51df5d482c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:00.771876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6e4fd-48af-455e-a765-1a51df5d482c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:00.771971 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6e4fd-48af-455e-a765-1a51df5d482c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:00.773283 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 635/1261] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:05:00.778352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbba18b-ea09-4ef5-a3ef-a3799fa601c1 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:00.778755 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbba18b-ea09-4ef5-a3ef-a3799fa601c1 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:00.778897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbba18b-ea09-4ef5-a3ef-a3799fa601c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:00.796649 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-9fbba18b-ea09-4ef5-a3ef-a3799fa601c1 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:05:00.797807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-9fbba18b-ea09-4ef5-a3ef-a3799fa601c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:05:00.861297 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 627/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:05:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:05:00.883512 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6e4fd-48af-455e-a765-1a51df5d482c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:00.894760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:00.981910 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6e4fd-48af-455e-a765-1a51df5d482c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:01.014937 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308feb37-275a-4992-8d5f-a3263438a3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:01.015711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308feb37-275a-4992-8d5f-a3263438a3cc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:01.015995 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308feb37-275a-4992-8d5f-a3263438a3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:01.016270 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308feb37-275a-4992-8d5f-a3263438a3cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:01.026158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308feb37-275a-4992-8d5f-a3263438a3cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:05:01.033772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-308feb37-275a-4992-8d5f-a3263438a3cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:05:01.033772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:05:01.033772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:05:01.033772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:05:01.033772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:05:01.033772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:05:01.033772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:05:01.033772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:05:01.033772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:05:01.033772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:05:01.033772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:05:01.033772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:05:01.033772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:05:01.033772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:05:01.033772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:05:01.033772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:05:01.034866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:05:01.034866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:05:01.034866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:05:01.034866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:05:01.034866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:05:01.034866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:05:01.034866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:05:01.034866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:05:01.034866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:05:01.034866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:05:01.034866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:05:01.034866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:05:01.034866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:05:01.034866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:05:01.034866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:05:01.034866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:05:01.035736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:05:01.035736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:05:01.035736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:05:01.035736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:05:01.035736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:05:01.035736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:05:01.035736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:05:01.035736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:05:01.035736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:05:01.035736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:05:01.035736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:05:01.035736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:05:01.035736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 636/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:05:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:05:01.040734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbba18b-ea09-4ef5-a3ef-a3799fa601c1 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:01.059206 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:01.137793 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbba18b-ea09-4ef5-a3ef-a3799fa601c1 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:01.169845 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e7eb4-ec64-412c-9bd9-46aab4058bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:01.171057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e7eb4-ec64-412c-9bd9-46aab4058bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:01.171335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e7eb4-ec64-412c-9bd9-46aab4058bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:01.171856 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e7eb4-ec64-412c-9bd9-46aab4058bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:01.172596 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e7eb4-ec64-412c-9bd9-46aab4058bb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:05:01.172894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e7eb4-ec64-412c-9bd9-46aab4058bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:01.174279 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e7eb4-ec64-412c-9bd9-46aab4058bb1 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:01.183261 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 628/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:05:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:05:01.189685 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308feb37-275a-4992-8d5f-a3263438a3cc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:01.265817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:01.298597 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308feb37-275a-4992-8d5f-a3263438a3cc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:01.330697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdd3f8-c1c0-488d-bf72-7ccd31f5c380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:01.331480 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdd3f8-c1c0-488d-bf72-7ccd31f5c380 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:01.331758 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdd3f8-c1c0-488d-bf72-7ccd31f5c380 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:01.332028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdd3f8-c1c0-488d-bf72-7ccd31f5c380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:01.342157 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdd3f8-c1c0-488d-bf72-7ccd31f5c380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:01.343617 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdd3f8-c1c0-488d-bf72-7ccd31f5c380 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:01.360520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7fbdd3f8-c1c0-488d-bf72-7ccd31f5c380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:05:01.360520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:05:01.360520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:05:01.360520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:05:01.360520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:05:01.360520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:05:01.360520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:05:01.360520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:05:01.360520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:05:01.360520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:05:01.360520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:05:01.360520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:05:01.360520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:05:01.360520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:05:01.360520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:05:01.361517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:05:01.361517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:05:01.361517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:05:01.361517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:05:01.361517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:05:01.361517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:05:01.361517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:05:01.361517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:05:01.361517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:05:01.361517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:05:01.361517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:05:01.361517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:05:01.361517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:05:01.361517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:05:01.361517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:05:01.361517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:05:01.361517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:05:01.362454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:05:01.362454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:05:01.362454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:05:01.362454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:05:01.362454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 637/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:05:01.367467 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e7eb4-ec64-412c-9bd9-46aab4058bb1 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:01.446074 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:01.464884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e7eb4-ec64-412c-9bd9-46aab4058bb1 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:01.497870 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c83671-ea6f-4aa4-9536-dfaa26971d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:01.498563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c83671-ea6f-4aa4-9536-dfaa26971d73 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:01.498845 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c83671-ea6f-4aa4-9536-dfaa26971d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:01.499116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c83671-ea6f-4aa4-9536-dfaa26971d73 None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:01.499831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c83671-ea6f-4aa4-9536-dfaa26971d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:05:01.500130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c83671-ea6f-4aa4-9536-dfaa26971d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:01.501472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c83671-ea6f-4aa4-9536-dfaa26971d73 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:01.512733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 629/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:05:01.518389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdd3f8-c1c0-488d-bf72-7ccd31f5c380 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:01.615540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdd3f8-c1c0-488d-bf72-7ccd31f5c380 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:01.634050 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:01.647623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f39412-d6e9-477e-ad09-8f91a76aae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:01.648407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f39412-d6e9-477e-ad09-8f91a76aae62 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:01.648684 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f39412-d6e9-477e-ad09-8f91a76aae62 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:01.648951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f39412-d6e9-477e-ad09-8f91a76aae62 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:01.656655 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f39412-d6e9-477e-ad09-8f91a76aae62 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:01.658124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f39412-d6e9-477e-ad09-8f91a76aae62 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:01.672914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-51f39412-d6e9-477e-ad09-8f91a76aae62 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:05:01.672914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:05:01.672914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:05:01.672914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:05:01.672914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:05:01.672914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:05:01.672914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:05:01.672914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:05:01.672914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:05:01.672914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:05:01.672914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:05:01.672914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:05:01.672914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:05:01.672914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:05:01.672914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:05:01.672914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:05:01.674097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:05:01.674097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:05:01.674097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:05:01.674097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:05:01.674097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:05:01.674097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:05:01.674097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:05:01.674097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:05:01.674097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:05:01.674097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:05:01.674097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:05:01.674097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:05:01.674097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:05:01.674097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:05:01.674097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:05:01.674097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:05:01.674097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:05:01.674097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:05:01.675393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:05:01.675393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:05:01.675393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:05:01.675393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:05:01.675393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:05:01.675393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:05:01.675393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:05:01.675393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:05:01.675393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:05:01.675393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:05:01.675393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 638/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:05:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:05:01.679728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c83671-ea6f-4aa4-9536-dfaa26971d73 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:01.774054 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c83671-ea6f-4aa4-9536-dfaa26971d73 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:01.807853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2c32f-9336-4088-a51e-defa6745508e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:01.808510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2c32f-9336-4088-a51e-defa6745508e None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:01.808794 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2c32f-9336-4088-a51e-defa6745508e None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:01.809072 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2c32f-9336-4088-a51e-defa6745508e None admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:01.809904 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2c32f-9336-4088-a51e-defa6745508e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:05:01.810247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2c32f-9336-4088-a51e-defa6745508e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:01.811664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2c32f-9336-4088-a51e-defa6745508e None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:01.820004 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:01.829344 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 630/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Mon Jul 25 12:05:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:05:01.834896 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f39412-d6e9-477e-ad09-8f91a76aae62 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:01.931156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f39412-d6e9-477e-ad09-8f91a76aae62 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:01.962484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae32293-f703-43e2-b421-7b4a527d5fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:01.963253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae32293-f703-43e2-b421-7b4a527d5fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:01.963528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae32293-f703-43e2-b421-7b4a527d5fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:01.963794 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae32293-f703-43e2-b421-7b4a527d5fe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:01.974596 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae32293-f703-43e2-b421-7b4a527d5fe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:01.976027 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae32293-f703-43e2-b421-7b4a527d5fe3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:01.992315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5ae32293-f703-43e2-b421-7b4a527d5fe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:05:01.992315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:05:01.992315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:05:01.992315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:05:01.992315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:05:01.992315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:05:01.992315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:05:01.992315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:05:01.992315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:05:01.992315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:05:01.992315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:05:01.992315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:05:01.992315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:05:01.992315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:05:01.992315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:05:01.993314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:05:01.993314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:05:01.993314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:05:01.993314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:05:01.993314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:05:01.993314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:05:01.993314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:05:01.993314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:05:01.993314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:05:01.993314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:05:01.993314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:05:01.993314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:05:01.993314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:05:01.993314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:05:01.993314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:05:01.993314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:05:01.993314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:05:01.994363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:05:01.994363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:05:01.994363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:05:01.994363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:05:01.994363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 639/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:05:01.999048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2c32f-9336-4088-a51e-defa6745508e None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:02.095009 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2c32f-9336-4088-a51e-defa6745508e None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:02.127490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e86a6-e8f6-4955-a502-16b3c9c6a9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:02.128135 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e86a6-e8f6-4955-a502-16b3c9c6a9cd None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:02.128418 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e86a6-e8f6-4955-a502-16b3c9c6a9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:02.128691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e86a6-e8f6-4955-a502-16b3c9c6a9cd None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:02.129410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e86a6-e8f6-4955-a502-16b3c9c6a9cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:05:02.129713 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e86a6-e8f6-4955-a502-16b3c9c6a9cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:02.131102 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e86a6-e8f6-4955-a502-16b3c9c6a9cd None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:02.142483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 631/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:05:02.147985 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae32293-f703-43e2-b421-7b4a527d5fe3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:02.179312 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:02.251025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae32293-f703-43e2-b421-7b4a527d5fe3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:02.284145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38285c-c03b-482c-b686-dfaeb8fadb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:02.284921 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38285c-c03b-482c-b686-dfaeb8fadb7d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:02.285203 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38285c-c03b-482c-b686-dfaeb8fadb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:02.285477 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38285c-c03b-482c-b686-dfaeb8fadb7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:02.292011 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38285c-c03b-482c-b686-dfaeb8fadb7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:02.293465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38285c-c03b-482c-b686-dfaeb8fadb7d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:02.308294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2e38285c-c03b-482c-b686-dfaeb8fadb7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:05:02.308294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:05:02.308294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:05:02.308294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:05:02.308294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:05:02.308294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:05:02.308294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:05:02.308294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:05:02.308294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:05:02.308294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:05:02.308294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:05:02.308294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:05:02.308294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:05:02.308294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:05:02.308294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:05:02.309288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:05:02.309288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:05:02.309288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:05:02.309288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:05:02.309288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:05:02.309288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:05:02.309288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:05:02.309288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:05:02.309288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:05:02.309288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:05:02.309288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:05:02.309288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:05:02.309288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:05:02.309288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:05:02.309288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:05:02.309288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:05:02.309288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:05:02.310372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:05:02.310372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:05:02.310372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:05:02.310372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:05:02.310372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:05:02.310372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:05:02.310372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:05:02.310372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:05:02.310372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 640/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:05:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:05:02.315249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e86a6-e8f6-4955-a502-16b3c9c6a9cd None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:02.371639 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:02.412193 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e86a6-e8f6-4955-a502-16b3c9c6a9cd None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:02.444982 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7e87d-a7b5-45b2-b9d9-af23e820b57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:02.445634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7e87d-a7b5-45b2-b9d9-af23e820b57f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:02.445914 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7e87d-a7b5-45b2-b9d9-af23e820b57f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:02.446214 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7e87d-a7b5-45b2-b9d9-af23e820b57f None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:02.446999 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7e87d-a7b5-45b2-b9d9-af23e820b57f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:05:02.447308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7e87d-a7b5-45b2-b9d9-af23e820b57f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:02.448716 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7e87d-a7b5-45b2-b9d9-af23e820b57f None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:02.460420 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 632/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:05:02.466347 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38285c-c03b-482c-b686-dfaeb8fadb7d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:02.553159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:02.561748 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38285c-c03b-482c-b686-dfaeb8fadb7d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:02.594314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c95555-0700-49bb-96b7-cacf94ff2565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:02.595184 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c95555-0700-49bb-96b7-cacf94ff2565 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:02.595461 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c95555-0700-49bb-96b7-cacf94ff2565 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:02.595731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c95555-0700-49bb-96b7-cacf94ff2565 None admin] PATH_INFO: `/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/40f748b0f6b1433c87012793f0dda307/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:02.597628 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c95555-0700-49bb-96b7-cacf94ff2565 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c80b9db7ace42c0a0cd1f31901599fd, user_id=40f748b0f6b1433c87012793f0dda307, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:02.599070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c95555-0700-49bb-96b7-cacf94ff2565 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:02.610625 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 641/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Mon Jul 25 12:05:02 2022] PUT /identity/v3/projects/8c80b9db7ace42c0a0cd1f31901599fd/users/40f748b0f6b1433c87012793f0dda307/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:05:04.577547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4434a0-ddc9-48b8-9c6e-5940380e88be None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:04.578058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4434a0-ddc9-48b8-9c6e-5940380e88be None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:04.578174 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4434a0-ddc9-48b8-9c6e-5940380e88be None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:04.579492 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 633/1274] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:05:04.585020 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be3403-de51-45c6-b607-d726b7719116 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:04.585389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be3403-de51-45c6-b607-d726b7719116 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:04.585586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be3403-de51-45c6-b607-d726b7719116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:04.603285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f2be3403-de51-45c6-b607-d726b7719116 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:05:04.604480 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f2be3403-de51-45c6-b607-d726b7719116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:05:04.668720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 642/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:05:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:05:04.691955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4434a0-ddc9-48b8-9c6e-5940380e88be None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:04.789256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4434a0-ddc9-48b8-9c6e-5940380e88be None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:04.806746 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:04.824138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2e1b7-dc04-4212-a48e-8f28cc930271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:04.824910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2e1b7-dc04-4212-a48e-8f28cc930271 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:04.825188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2e1b7-dc04-4212-a48e-8f28cc930271 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:04.825459 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2e1b7-dc04-4212-a48e-8f28cc930271 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:04.835576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2e1b7-dc04-4212-a48e-8f28cc930271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:05:04.843120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-98f2e1b7-dc04-4212-a48e-8f28cc930271 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:05:04.843120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:05:04.843120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:05:04.843120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:05:04.843120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:05:04.843120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:05:04.843120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:05:04.843120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:05:04.843120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:05:04.843120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:05:04.843120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:05:04.843120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:05:04.843120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:05:04.843120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:05:04.843120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:05:04.843120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:05:04.844186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:05:04.844186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:05:04.844186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:05:04.844186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:05:04.844186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:05:04.844186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:05:04.844186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:05:04.844186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:05:04.844186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:05:04.844186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:05:04.844186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:05:04.844186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:05:04.844186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:05:04.844186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:05:04.844186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:05:04.844186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:05:04.845175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:05:04.845175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:05:04.845175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:05:04.845175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:05:04.845175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:05:04.845175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:05:04.845175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:05:04.845175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:05:04.845175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:05:04.845175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:05:04.845175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:05:04.845175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:05:04.845175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 634/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Mon Jul 25 12:05:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:05:04.850230 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be3403-de51-45c6-b607-d726b7719116 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:04.928540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:04.946536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be3403-de51-45c6-b607-d726b7719116 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:04.978042 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba47cc-3a6d-4d70-9404-581593b2da41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:04.978677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba47cc-3a6d-4d70-9404-581593b2da41 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:04.978955 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba47cc-3a6d-4d70-9404-581593b2da41 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:04.979224 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba47cc-3a6d-4d70-9404-581593b2da41 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:04.979958 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba47cc-3a6d-4d70-9404-581593b2da41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:05:04.980258 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba47cc-3a6d-4d70-9404-581593b2da41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:04.981608 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba47cc-3a6d-4d70-9404-581593b2da41 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:04.989818 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 643/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Mon Jul 25 12:05:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:05:04.995272 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2e1b7-dc04-4212-a48e-8f28cc930271 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:05.091330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2e1b7-dc04-4212-a48e-8f28cc930271 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:05.124763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e6618-6c2a-400e-8372-a30745654c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:05.125541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e6618-6c2a-400e-8372-a30745654c79 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:05.125822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e6618-6c2a-400e-8372-a30745654c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:05.126129 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e6618-6c2a-400e-8372-a30745654c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:05.136463 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e6618-6c2a-400e-8372-a30745654c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:05.137901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e6618-6c2a-400e-8372-a30745654c79 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:05.154356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-878e6618-6c2a-400e-8372-a30745654c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:05:05.154356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:05:05.154356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:05:05.154356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:05:05.154356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:05:05.154356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:05:05.154356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:05:05.154356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:05:05.154356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:05:05.154356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:05:05.154356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:05:05.154356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:05:05.154356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:05:05.154356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:05:05.154356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:05:05.155733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:05:05.155733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:05:05.155733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:05:05.155733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:05:05.155733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:05:05.155733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:05:05.155733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:05:05.155733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:05:05.155733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:05:05.155733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:05:05.155733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:05:05.155733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:05:05.155733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:05:05.155733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:05:05.155733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:05:05.155733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:05:05.155733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:05:05.156621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:05:05.156621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:05:05.156621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:05:05.156621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:05:05.156621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 635/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:05:05.161845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba47cc-3a6d-4d70-9404-581593b2da41 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:05.262361 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba47cc-3a6d-4d70-9404-581593b2da41 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:05.294986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d53942-8c89-4f13-9616-faa2ce4f5bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:05.296244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d53942-8c89-4f13-9616-faa2ce4f5bfa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:05.296783 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d53942-8c89-4f13-9616-faa2ce4f5bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:05.297051 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d53942-8c89-4f13-9616-faa2ce4f5bfa None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:05.297765 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d53942-8c89-4f13-9616-faa2ce4f5bfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:05:05.298093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d53942-8c89-4f13-9616-faa2ce4f5bfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:05.299466 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d53942-8c89-4f13-9616-faa2ce4f5bfa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:05.310886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 644/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:05:05.316640 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e6618-6c2a-400e-8372-a30745654c79 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:05.347470 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:05.415403 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e6618-6c2a-400e-8372-a30745654c79 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:05.447738 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a71dd-d60e-456a-9c02-540ea81ad9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:05.448524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a71dd-d60e-456a-9c02-540ea81ad9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:05.448800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a71dd-d60e-456a-9c02-540ea81ad9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:05.449067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a71dd-d60e-456a-9c02-540ea81ad9a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:05.456270 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a71dd-d60e-456a-9c02-540ea81ad9a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:05.457683 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a71dd-d60e-456a-9c02-540ea81ad9a5 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:05.471964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-cd6a71dd-d60e-456a-9c02-540ea81ad9a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:05:05.471964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:05:05.471964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:05:05.471964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:05:05.471964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:05:05.471964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:05:05.471964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:05:05.471964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:05:05.471964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:05:05.471964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:05:05.471964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:05:05.471964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:05:05.471964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:05:05.471964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:05:05.471964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:05:05.471964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:05:05.473068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:05:05.473068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:05:05.473068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:05:05.473068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:05:05.473068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:05:05.473068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:05:05.473068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:05:05.473068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:05:05.473068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:05:05.473068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:05:05.473068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:05:05.473068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:05:05.473068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:05:05.473068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:05:05.473068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:05:05.473068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:05:05.473068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:05:05.473068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:05:05.474268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:05:05.474268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:05:05.474268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:05:05.474268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:05:05.474268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:05:05.474268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:05:05.474268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:05:05.474268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:05:05.474268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:05:05.474268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:05:05.474268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 636/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:05:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:05:05.478959 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d53942-8c89-4f13-9616-faa2ce4f5bfa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:05.482808 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:05.575541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d53942-8c89-4f13-9616-faa2ce4f5bfa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:05.608513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8abe8-afee-4d57-b7e7-1b10d28f37e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:05.609116 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8abe8-afee-4d57-b7e7-1b10d28f37e1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:05.609390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8abe8-afee-4d57-b7e7-1b10d28f37e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:05.609657 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8abe8-afee-4d57-b7e7-1b10d28f37e1 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:05.610511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8abe8-afee-4d57-b7e7-1b10d28f37e1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:05:05.610812 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8abe8-afee-4d57-b7e7-1b10d28f37e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:05.612222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8abe8-afee-4d57-b7e7-1b10d28f37e1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:05.628334 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 645/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Mon Jul 25 12:05:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:05:05.633944 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a71dd-d60e-456a-9c02-540ea81ad9a5 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:05.721919 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:05.731235 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a71dd-d60e-456a-9c02-540ea81ad9a5 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:05.764020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679d85e-4cb4-47c6-a797-7923ed34ad4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:05.764677 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679d85e-4cb4-47c6-a797-7923ed34ad4f None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:05.764963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679d85e-4cb4-47c6-a797-7923ed34ad4f None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:05.765239 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679d85e-4cb4-47c6-a797-7923ed34ad4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:05.829915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679d85e-4cb4-47c6-a797-7923ed34ad4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:05.831366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679d85e-4cb4-47c6-a797-7923ed34ad4f None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:05.915386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:05.926232 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 637/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Mon Jul 25 12:05:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:05:05.931900 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8abe8-afee-4d57-b7e7-1b10d28f37e1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:05.990936 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:06.027648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8abe8-afee-4d57-b7e7-1b10d28f37e1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:06.060777 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf199c-3428-4bfd-9706-7e5fa02a1acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:06.061583 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf199c-3428-4bfd-9706-7e5fa02a1acc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:06.061862 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf199c-3428-4bfd-9706-7e5fa02a1acc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:06.062167 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf199c-3428-4bfd-9706-7e5fa02a1acc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:06.071850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf199c-3428-4bfd-9706-7e5fa02a1acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:06.073294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf199c-3428-4bfd-9706-7e5fa02a1acc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:06.090261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-eecf199c-3428-4bfd-9706-7e5fa02a1acc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:05:06.090261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:05:06.090261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:05:06.090261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:05:06.090261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:05:06.090261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:05:06.090261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:05:06.090261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:05:06.090261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:05:06.090261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:05:06.090261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:05:06.090261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:05:06.090261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:05:06.090261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:05:06.090261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:05:06.091250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:05:06.091250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:05:06.091250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:05:06.091250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:05:06.091250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:05:06.091250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:05:06.091250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:05:06.091250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:05:06.091250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:05:06.091250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:05:06.091250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:05:06.091250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:05:06.091250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:05:06.091250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:05:06.091250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:05:06.091250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:05:06.091250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:05:06.092820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:05:06.092820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:05:06.092820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:05:06.092820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:05:06.092820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 646/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:05:06.097416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679d85e-4cb4-47c6-a797-7923ed34ad4f None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:06.200123 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679d85e-4cb4-47c6-a797-7923ed34ad4f None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:06.232791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409b09f-a554-4d79-8f16-055ef3d5fcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:06.233936 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409b09f-a554-4d79-8f16-055ef3d5fcde None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:06.234235 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409b09f-a554-4d79-8f16-055ef3d5fcde None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:06.234506 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409b09f-a554-4d79-8f16-055ef3d5fcde None admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:06.235215 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409b09f-a554-4d79-8f16-055ef3d5fcde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:05:06.235515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409b09f-a554-4d79-8f16-055ef3d5fcde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:06.236848 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409b09f-a554-4d79-8f16-055ef3d5fcde None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:06.247619 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 638/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Mon Jul 25 12:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:05:06.254047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf199c-3428-4bfd-9706-7e5fa02a1acc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:06.349612 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf199c-3428-4bfd-9706-7e5fa02a1acc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:06.363530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:06.383545 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bae0f5-155c-487e-8eab-872490be5248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:06.384322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bae0f5-155c-487e-8eab-872490be5248 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:06.384605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bae0f5-155c-487e-8eab-872490be5248 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:06.384880 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bae0f5-155c-487e-8eab-872490be5248 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:06.391477 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bae0f5-155c-487e-8eab-872490be5248 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:06.392932 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bae0f5-155c-487e-8eab-872490be5248 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:06.406394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-81bae0f5-155c-487e-8eab-872490be5248 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:05:06.406394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:05:06.406394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:05:06.406394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:05:06.406394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:05:06.406394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:05:06.406394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:05:06.406394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:05:06.406394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:05:06.406394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:05:06.406394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:05:06.406394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:05:06.406394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:05:06.406394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:05:06.406394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:05:06.407399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:05:06.407399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:05:06.407399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:05:06.407399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:05:06.407399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:05:06.407399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:05:06.407399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:05:06.407399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:05:06.407399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 25 12:05:06.407399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:05:06.407399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:05:06.407399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:05:06.407399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:05:06.407399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:05:06.407399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:05:06.407399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:05:06.407399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:05:06.408479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:05:06.408479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:05:06.408479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:05:06.408479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:05:06.408479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:05:06.408479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:05:06.408479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:05:06.408479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 25 12:05:06.408479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 647/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Mon Jul 25 12:05:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:05:06.413222 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409b09f-a554-4d79-8f16-055ef3d5fcde None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:06.462721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:06.512179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409b09f-a554-4d79-8f16-055ef3d5fcde None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:06.544320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065fbd8-43fb-4820-9dd0-36279de36e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:06.544971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065fbd8-43fb-4820-9dd0-36279de36e90 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:06.545258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065fbd8-43fb-4820-9dd0-36279de36e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:06.546047 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065fbd8-43fb-4820-9dd0-36279de36e90 None admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:06.547092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065fbd8-43fb-4820-9dd0-36279de36e90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:05:06.547401 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065fbd8-43fb-4820-9dd0-36279de36e90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:06.548821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065fbd8-43fb-4820-9dd0-36279de36e90 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:06.561038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 639/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Mon Jul 25 12:05:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:05:06.567588 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bae0f5-155c-487e-8eab-872490be5248 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:06.664308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bae0f5-155c-487e-8eab-872490be5248 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:06.697025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14754503-ce6f-47f3-8e9e-c31a65a3ccb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:06.697662 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14754503-ce6f-47f3-8e9e-c31a65a3ccb9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:06.697945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14754503-ce6f-47f3-8e9e-c31a65a3ccb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:06.698248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14754503-ce6f-47f3-8e9e-c31a65a3ccb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:06.699072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14754503-ce6f-47f3-8e9e-c31a65a3ccb9 None admin] RBAC: Adding query filter params (role.id=d0665d2cada24a7d9f40ff3e34ef6cb8, scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd, user.id=40f748b0f6b1433c87012793f0dda307) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:05:06.699386 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14754503-ce6f-47f3-8e9e-c31a65a3ccb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:06.700809 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14754503-ce6f-47f3-8e9e-c31a65a3ccb9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:06.706540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 648/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Mon Jul 25 12:05:06 2022] GET /identity/v3/role_assignments?user.id=40f748b0f6b1433c87012793f0dda307&scope.project.id=8c80b9db7ace42c0a0cd1f31901599fd&role.id=d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:05:08.676133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99edae4-8eba-4490-8ca4-d44ce975b92d None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:08.676670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99edae4-8eba-4490-8ca4-d44ce975b92d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:08.676670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99edae4-8eba-4490-8ca4-d44ce975b92d None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:08.678074 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 640/1288] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:05:08.683116 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33e5a3-a520-447e-b090-e36286ca675f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:08.683516 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33e5a3-a520-447e-b090-e36286ca675f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:08.683669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33e5a3-a520-447e-b090-e36286ca675f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:08.701296 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fa33e5a3-a520-447e-b090-e36286ca675f None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:05:08.703028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fa33e5a3-a520-447e-b090-e36286ca675f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:05:08.731527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:08.767732 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 649/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:05:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:05:08.788891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99edae4-8eba-4490-8ca4-d44ce975b92d None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:08.886582 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99edae4-8eba-4490-8ca4-d44ce975b92d None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:08.896659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:08.919208 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a68457-2e1d-4146-ab29-27cbb309cb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:08.919984 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a68457-2e1d-4146-ab29-27cbb309cb9d None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:08.920261 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a68457-2e1d-4146-ab29-27cbb309cb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:08.920581 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a68457-2e1d-4146-ab29-27cbb309cb9d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:08.921970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a68457-2e1d-4146-ab29-27cbb309cb9d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:08.923334 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a68457-2e1d-4146-ab29-27cbb309cb9d None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:08.934788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-b5a68457-2e1d-4146-ab29-27cbb309cb9d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 12:05:08.934788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:05:08.934788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:05:08.934788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:05:08.934788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:05:08.934788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:05:08.934788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:05:08.934788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:05:08.934788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 12:05:08.934788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:05:08.934788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:05:08.934788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:05:08.934788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:05:08.934788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:05:08.934788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:05:08.934788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:05:08.934788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:05:08.935968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:05:08.935968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:05:08.935968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:05:08.935968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:05:08.935968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:05:08.935968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:05:08.935968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:05:08.935968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:05:08.935968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:05:08.935968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:05:08.935968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:05:08.935968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:05:08.935968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:05:08.935968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:05:08.935968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:05:08.935968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:05:08.937002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:05:08.937002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:05:08.937002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:05:08.937002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:05:08.937002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:05:08.937002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:05:08.937002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:05:08.937002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:05:08.937002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:05:08.937002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:05:08.937002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:05:08.937002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:05:08.937002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 12:05:08.937002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:05:08.937002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 641/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Mon Jul 25 12:05:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:05:08.942149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33e5a3-a520-447e-b090-e36286ca675f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:09.035312 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33e5a3-a520-447e-b090-e36286ca675f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:09.067496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f52d1-24df-48f5-bbc8-2e873243fe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:09.068137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f52d1-24df-48f5-bbc8-2e873243fe45 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:09.068413 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f52d1-24df-48f5-bbc8-2e873243fe45 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:09.068680 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f52d1-24df-48f5-bbc8-2e873243fe45 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:09.069373 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f52d1-24df-48f5-bbc8-2e873243fe45 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:05:09.069672 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f52d1-24df-48f5-bbc8-2e873243fe45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:09.071044 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f52d1-24df-48f5-bbc8-2e873243fe45 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:09.075630 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 650/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Mon Jul 25 12:05:08 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:05:09.081081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a68457-2e1d-4146-ab29-27cbb309cb9d None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:09.178492 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a68457-2e1d-4146-ab29-27cbb309cb9d None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:09.215974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1898d14-a5bb-43c7-8dc5-b3916355cd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:09.216633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1898d14-a5bb-43c7-8dc5-b3916355cd10 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:09.216913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1898d14-a5bb-43c7-8dc5-b3916355cd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:09.217181 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1898d14-a5bb-43c7-8dc5-b3916355cd10 None admin] PATH_INFO: `/v3/services` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:09.218453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1898d14-a5bb-43c7-8dc5-b3916355cd10 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:05:09.218743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1898d14-a5bb-43c7-8dc5-b3916355cd10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:09.220092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1898d14-a5bb-43c7-8dc5-b3916355cd10 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:09.224715 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 642/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Mon Jul 25 12:05:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:05:11.163003 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ef263-9d98-4e46-970d-53c34891128d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:11.163558 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ef263-9d98-4e46-970d-53c34891128d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:11.163558 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ef263-9d98-4e46-970d-53c34891128d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:11.164909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 651/1293] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:05:11.170438 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67b210-b19e-4e8b-a803-59e032525a14 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:11.170937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67b210-b19e-4e8b-a803-59e032525a14 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:11.171317 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67b210-b19e-4e8b-a803-59e032525a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:11.191778 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-4d67b210-b19e-4e8b-a803-59e032525a14 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:05:11.192966 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-4d67b210-b19e-4e8b-a803-59e032525a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:05:11.222985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:11.263045 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 643/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:05:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:05:11.286083 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ef263-9d98-4e46-970d-53c34891128d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:11.317609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:11.385859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ef263-9d98-4e46-970d-53c34891128d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:11.419143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e615361-c9b2-4194-92d0-ad176cc5961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:11.419742 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e615361-c9b2-4194-92d0-ad176cc5961d None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:11.420022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e615361-c9b2-4194-92d0-ad176cc5961d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:11.420295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e615361-c9b2-4194-92d0-ad176cc5961d None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:11.421061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e615361-c9b2-4194-92d0-ad176cc5961d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:11.422707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e615361-c9b2-4194-92d0-ad176cc5961d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:11.437417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 652/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Mon Jul 25 12:05:11 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:05:13.426465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389675e9-2755-47e9-a4ca-4a3155d655ce None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:13.427055 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389675e9-2755-47e9-a4ca-4a3155d655ce None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:13.427055 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389675e9-2755-47e9-a4ca-4a3155d655ce None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:13.428376 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 644/1296] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:05:13.433499 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebbe10-8517-45ce-8462-d5f6bf7c759b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:13.433922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebbe10-8517-45ce-8462-d5f6bf7c759b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:13.434095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebbe10-8517-45ce-8462-d5f6bf7c759b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:13.451689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4eebbe10-8517-45ce-8462-d5f6bf7c759b None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:05:13.452853 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4eebbe10-8517-45ce-8462-d5f6bf7c759b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:05:13.523354 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 653/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:05:13 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:05:13.546470 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389675e9-2755-47e9-a4ca-4a3155d655ce None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:13.644224 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389675e9-2755-47e9-a4ca-4a3155d655ce None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:13.678027 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f8a63-5bb1-46e5-8170-5191220fef9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:13.678764 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f8a63-5bb1-46e5-8170-5191220fef9a None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:13.679049 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f8a63-5bb1-46e5-8170-5191220fef9a None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:13.679326 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f8a63-5bb1-46e5-8170-5191220fef9a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:13.680001 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f8a63-5bb1-46e5-8170-5191220fef9a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:13.681387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f8a63-5bb1-46e5-8170-5191220fef9a None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:13.692989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-b64f8a63-5bb1-46e5-8170-5191220fef9a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 12:05:13.692989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:05:13.692989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:05:13.692989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:05:13.692989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:05:13.692989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:05:13.692989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:05:13.692989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:05:13.692989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 12:05:13.692989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:05:13.692989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:05:13.692989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:05:13.692989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:05:13.692989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:05:13.692989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:05:13.692989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:05:13.692989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:05:13.694256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:05:13.694256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:05:13.694256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:05:13.694256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:05:13.694256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:05:13.694256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:05:13.694256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:05:13.694256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:05:13.694256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:05:13.694256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:05:13.694256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:05:13.694256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:05:13.694256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:05:13.694256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:05:13.694256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:05:13.694256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:05:13.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:05:13.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:05:13.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:05:13.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:05:13.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:05:13.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:05:13.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:05:13.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:05:13.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:05:13.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:05:13.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:05:13.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:05:13.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 12:05:13.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:05:13.695386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 645/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Mon Jul 25 12:05:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:05:13.700307 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebbe10-8517-45ce-8462-d5f6bf7c759b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:13.718523 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:13.797803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebbe10-8517-45ce-8462-d5f6bf7c759b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:13.830206 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6087a2-caa5-4b19-becd-57b7b7fa2639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:13.830854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6087a2-caa5-4b19-becd-57b7b7fa2639 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:13.831132 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6087a2-caa5-4b19-becd-57b7b7fa2639 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:13.831402 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6087a2-caa5-4b19-becd-57b7b7fa2639 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:13.832095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6087a2-caa5-4b19-becd-57b7b7fa2639 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:05:13.832395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6087a2-caa5-4b19-becd-57b7b7fa2639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:13.833747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6087a2-caa5-4b19-becd-57b7b7fa2639 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:13.839551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 654/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Mon Jul 25 12:05:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:05:13.845934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f8a63-5bb1-46e5-8170-5191220fef9a None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:13.876026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:13.941810 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f8a63-5bb1-46e5-8170-5191220fef9a None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:13.974267 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a988323-44ce-463f-8355-efbcfa938aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:13.974898 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a988323-44ce-463f-8355-efbcfa938aff None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:13.975181 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a988323-44ce-463f-8355-efbcfa938aff None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:13.975451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a988323-44ce-463f-8355-efbcfa938aff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:13.976227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a988323-44ce-463f-8355-efbcfa938aff None admin] RBAC: Adding query filter params (interface=public, service_id=fbcc05ad94734819aa49beb550d2dc2c, region_id=RegionOne) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:05:13.976531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a988323-44ce-463f-8355-efbcfa938aff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:13.977862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a988323-44ce-463f-8355-efbcfa938aff None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:13.982736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 646/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Mon Jul 25 12:05:13 2022] GET /identity/v3/endpoints?service_id=fbcc05ad94734819aa49beb550d2dc2c&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:05:13.988214 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6087a2-caa5-4b19-becd-57b7b7fa2639 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:14.067074 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:14.085257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6087a2-caa5-4b19-becd-57b7b7fa2639 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:14.118234 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705c3cb-59eb-46ae-8b48-2de26421aacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:14.118880 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705c3cb-59eb-46ae-8b48-2de26421aacf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:14.119161 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705c3cb-59eb-46ae-8b48-2de26421aacf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:14.119430 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705c3cb-59eb-46ae-8b48-2de26421aacf None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:14.120099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705c3cb-59eb-46ae-8b48-2de26421aacf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:14.121461 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705c3cb-59eb-46ae-8b48-2de26421aacf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:14.128613 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 655/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Mon Jul 25 12:05:13 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:05:16.110602 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed22f1-91a9-497f-8e53-b1f919187f7d None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:16.111156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed22f1-91a9-497f-8e53-b1f919187f7d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:16.111156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed22f1-91a9-497f-8e53-b1f919187f7d None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:16.112536 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 647/1302] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:05:16.117506 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387fe9c-edd9-4e46-aa72-a0d5b8ccecd1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:16.117868 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387fe9c-edd9-4e46-aa72-a0d5b8ccecd1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:16.118091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387fe9c-edd9-4e46-aa72-a0d5b8ccecd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:16.136167 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f387fe9c-edd9-4e46-aa72-a0d5b8ccecd1 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:05:16.137339 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f387fe9c-edd9-4e46-aa72-a0d5b8ccecd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:05:16.207439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 656/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:05:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:05:16.229821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed22f1-91a9-497f-8e53-b1f919187f7d None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:16.323941 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:16.330572 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed22f1-91a9-497f-8e53-b1f919187f7d None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:16.363161 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08573958-0c7f-4454-a069-86656d1b37e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:16.363911 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08573958-0c7f-4454-a069-86656d1b37e2 None admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:16.364196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08573958-0c7f-4454-a069-86656d1b37e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:16.364473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08573958-0c7f-4454-a069-86656d1b37e2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:16.365124 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08573958-0c7f-4454-a069-86656d1b37e2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:16.366521 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08573958-0c7f-4454-a069-86656d1b37e2 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:16.378610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application [None req-08573958-0c7f-4454-a069-86656d1b37e2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 12:05:16.378610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:05:16.378610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:05:16.378610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:05:16.378610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:05:16.378610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:05:16.378610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:05:16.378610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:05:16.378610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 12:05:16.378610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:05:16.378610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:05:16.378610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:05:16.378610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:05:16.378610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:05:16.378610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:05:16.378610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:05:16.378610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:05:16.379745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:05:16.379745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:05:16.379745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:05:16.379745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:05:16.379745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:05:16.379745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:05:16.379745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:05:16.379745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:05:16.379745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:05:16.379745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:05:16.379745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:05:16.379745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:05:16.379745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:05:16.379745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:05:16.379745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:05:16.379745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:05:16.380743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:05:16.380743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application with Lock( Jul 25 12:05:16.380743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:05:16.380743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:05:16.380743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:05:16.380743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:05:16.380743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:05:16.380743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:05:16.380743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:05:16.380743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:05:16.380743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:05:16.380743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:05:16.380743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 12:05:16.380743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: ERROR keystone.server.flask.application Jul 25 12:05:16.380743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 648/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Mon Jul 25 12:05:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:05:16.385702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387fe9c-edd9-4e46-aa72-a0d5b8ccecd1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:16.458758 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:16.481398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387fe9c-edd9-4e46-aa72-a0d5b8ccecd1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:16.514096 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8a383-f31b-4ee2-9de8-1b3f3da7b0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:16.514757 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8a383-f31b-4ee2-9de8-1b3f3da7b0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:16.515044 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8a383-f31b-4ee2-9de8-1b3f3da7b0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:16.515319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8a383-f31b-4ee2-9de8-1b3f3da7b0e3 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:16.516026 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8a383-f31b-4ee2-9de8-1b3f3da7b0e3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:05:16.516331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8a383-f31b-4ee2-9de8-1b3f3da7b0e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:16.517697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8a383-f31b-4ee2-9de8-1b3f3da7b0e3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:16.522759 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 657/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Mon Jul 25 12:05:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:05:16.528542 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08573958-0c7f-4454-a069-86656d1b37e2 None admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:05:16.626492 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08573958-0c7f-4454-a069-86656d1b37e2 None admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:05:16.658763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f13120-14c2-4a6a-9a36-879fdecdef94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:05:16.659401 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f13120-14c2-4a6a-9a36-879fdecdef94 None admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:05:16.659686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f13120-14c2-4a6a-9a36-879fdecdef94 None admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:05:16.659964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f13120-14c2-4a6a-9a36-879fdecdef94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:05:16.660691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f13120-14c2-4a6a-9a36-879fdecdef94 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:05:16.662070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f13120-14c2-4a6a-9a36-879fdecdef94 None admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:05:16.681685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 649/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:05:16 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:05:26.519755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=30 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:05:26.677471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:18.540599 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38160e-c8a7-4e65-982b-07611288fd31 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:18.541619 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38160e-c8a7-4e65-982b-07611288fd31 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:18.542174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38160e-c8a7-4e65-982b-07611288fd31 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:18.549688 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46c1ba-b41e-41af-9b5f-8985eb9b737d None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:18.550545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46c1ba-b41e-41af-9b5f-8985eb9b737d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:18.551055 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46c1ba-b41e-41af-9b5f-8985eb9b737d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:18.556075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 658/1307] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:06:18 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:06:18.642775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-5b46c1ba-b41e-41af-9b5f-8985eb9b737d None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:06:18.644018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5b46c1ba-b41e-41af-9b5f-8985eb9b737d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:18.760728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 650/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:06:18.812716 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec6035-8047-4f8f-b598-981b7f5cbff0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:18.813103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec6035-8047-4f8f-b598-981b7f5cbff0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:18.813267 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec6035-8047-4f8f-b598-981b7f5cbff0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:18.815057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 659/1309] 10.222.0.48 () {54 vars in 965 bytes} [Mon Jul 25 12:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:06:18.821058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d2035-d36c-4620-9de7-cff9ad4417ad None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:18.821351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d2035-d36c-4620-9de7-cff9ad4417ad None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:18.821627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d2035-d36c-4620-9de7-cff9ad4417ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:18.926103 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-bb3d2035-d36c-4620-9de7-cff9ad4417ad None None] MFA Rules not processed for user `fbc9fad7089b4c95ac92e846d46cb5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:06:18.927448 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-bb3d2035-d36c-4620-9de7-cff9ad4417ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:18.948552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:19.014949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec6035-8047-4f8f-b598-981b7f5cbff0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:06:19.017288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-58ec6035-8047-4f8f-b598-981b7f5cbff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:19.021742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 651/1310] 10.222.0.48 () {58 vars in 1062 bytes} [Mon Jul 25 12:06:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:06:19.159252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec6035-8047-4f8f-b598-981b7f5cbff0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:06:19.235616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ef0ac-ffcb-4a67-abf1-8fca0858dc53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:06:19.236268 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ef0ac-ffcb-4a67-abf1-8fca0858dc53 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:19.236547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ef0ac-ffcb-4a67-abf1-8fca0858dc53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:19.236817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ef0ac-ffcb-4a67-abf1-8fca0858dc53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:19.238475 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-291ef0ac-ffcb-4a67-abf1-8fca0858dc53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:19.295494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:19.353408 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ef0ac-ffcb-4a67-abf1-8fca0858dc53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:06:19.354800 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ef0ac-ffcb-4a67-abf1-8fca0858dc53 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:06:19.373947 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 660/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:06:21.662112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f4128-381d-4b69-809a-569de71ed549 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:21.662640 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f4128-381d-4b69-809a-569de71ed549 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:21.662640 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f4128-381d-4b69-809a-569de71ed549 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:21.664145 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 652/1312] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:06:21.669531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1165df-a025-4fab-aea8-dc587c57581a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:21.669960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1165df-a025-4fab-aea8-dc587c57581a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:21.670134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1165df-a025-4fab-aea8-dc587c57581a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:21.745199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ef1165df-a025-4fab-aea8-dc587c57581a None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:06:21.746448 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ef1165df-a025-4fab-aea8-dc587c57581a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:21.851204 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 661/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:06:21.890246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f4128-381d-4b69-809a-569de71ed549 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:06:21.892521 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-819f4128-381d-4b69-809a-569de71ed549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:22.010868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f4128-381d-4b69-809a-569de71ed549 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:06:22.084490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:22.087668 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5119772-bda2-4882-b623-fd8cfec72307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:06:22.088498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5119772-bda2-4882-b623-fd8cfec72307 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:22.089165 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5119772-bda2-4882-b623-fd8cfec72307 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:22.089753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5119772-bda2-4882-b623-fd8cfec72307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:22.091744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b5119772-bda2-4882-b623-fd8cfec72307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:22.210156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5119772-bda2-4882-b623-fd8cfec72307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:06:22.211589 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5119772-bda2-4882-b623-fd8cfec72307 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:06:22.232198 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 653/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:06:24.539647 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1d074-d26a-4251-8335-03d0da62f77c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:24.540134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1d074-d26a-4251-8335-03d0da62f77c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:24.540134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1d074-d26a-4251-8335-03d0da62f77c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:24.541514 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 662/1315] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:06:24.546863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f256b1b-826d-4b78-b899-c8a2621b2475 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:24.547270 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f256b1b-826d-4b78-b899-c8a2621b2475 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:24.547416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f256b1b-826d-4b78-b899-c8a2621b2475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:24.611339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-1f256b1b-826d-4b78-b899-c8a2621b2475 None None] MFA Rules not processed for user `b4f363b5e16e42eea33d3a46852cf542`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:06:24.612532 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-1f256b1b-826d-4b78-b899-c8a2621b2475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:24.663798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:24.707971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 654/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:06:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:06:24.746580 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1d074-d26a-4251-8335-03d0da62f77c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:06:24.748100 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-52d1d074-d26a-4251-8335-03d0da62f77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:24.758354 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:24.850084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1d074-d26a-4251-8335-03d0da62f77c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:06:24.920293 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bc12c-35a8-43f7-99b5-c81b7cfc7a61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:06:24.920934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bc12c-35a8-43f7-99b5-c81b7cfc7a61 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:24.921210 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bc12c-35a8-43f7-99b5-c81b7cfc7a61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:24.921478 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bc12c-35a8-43f7-99b5-c81b7cfc7a61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:24.923406 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f65bc12c-35a8-43f7-99b5-c81b7cfc7a61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:24.985253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:25.031266 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bc12c-35a8-43f7-99b5-c81b7cfc7a61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:06:25.032739 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bc12c-35a8-43f7-99b5-c81b7cfc7a61 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:06:25.052442 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 663/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:06:24 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:06:27.577866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7bf47-44ae-48ac-9e3e-e73843d240e7 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:27.578898 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7bf47-44ae-48ac-9e3e-e73843d240e7 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:27.579010 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7bf47-44ae-48ac-9e3e-e73843d240e7 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:27.580314 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 655/1318] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:06:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:06:27.585451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd3eed-2312-477d-acd1-53c247caa0f2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:27.585868 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd3eed-2312-477d-acd1-53c247caa0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:27.586016 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd3eed-2312-477d-acd1-53c247caa0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:27.650270 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5bbd3eed-2312-477d-acd1-53c247caa0f2 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:06:27.651463 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5bbd3eed-2312-477d-acd1-53c247caa0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:27.743930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 664/1319] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:06:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:06:27.782556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7bf47-44ae-48ac-9e3e-e73843d240e7 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:06:27.784123 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d7a7bf47-44ae-48ac-9e3e-e73843d240e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:27.885060 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7bf47-44ae-48ac-9e3e-e73843d240e7 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:06:27.957230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf96e1e-7d2a-4e39-a703-8fb6bccd9023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:06:27.957867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf96e1e-7d2a-4e39-a703-8fb6bccd9023 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:27.958177 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf96e1e-7d2a-4e39-a703-8fb6bccd9023 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:27.958457 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf96e1e-7d2a-4e39-a703-8fb6bccd9023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:27.960067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-8bf96e1e-7d2a-4e39-a703-8fb6bccd9023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:27.967256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:28.068238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf96e1e-7d2a-4e39-a703-8fb6bccd9023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:06:28.069592 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf96e1e-7d2a-4e39-a703-8fb6bccd9023 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:06:28.088195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 656/1320] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:06:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:06:30.732148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571f10a-3bea-4cd7-bcc4-a91bd23f1f5b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:30.732685 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571f10a-3bea-4cd7-bcc4-a91bd23f1f5b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:30.732685 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571f10a-3bea-4cd7-bcc4-a91bd23f1f5b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:30.734241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 665/1321] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:06:30.739454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9bbdf-0c84-4381-9c5d-21f0aa8af48f None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:30.739888 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9bbdf-0c84-4381-9c5d-21f0aa8af48f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:30.740033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9bbdf-0c84-4381-9c5d-21f0aa8af48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:30.805531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-99a9bbdf-0c84-4381-9c5d-21f0aa8af48f None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:06:30.806752 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-99a9bbdf-0c84-4381-9c5d-21f0aa8af48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:30.865348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:30.913136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 657/1322] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:06:30.963786 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65533531-c3e6-4c13-a587-fcd75421f209 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:30.964069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65533531-c3e6-4c13-a587-fcd75421f209 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:30.964347 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65533531-c3e6-4c13-a587-fcd75421f209 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:30.965729 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 666/1323] 10.222.0.48 () {54 vars in 965 bytes} [Mon Jul 25 12:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:06:30.972001 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c17df6-54dc-415a-860a-bcf247ea92da None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:30.972384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c17df6-54dc-415a-860a-bcf247ea92da None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:30.972728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c17df6-54dc-415a-860a-bcf247ea92da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:31.053403 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-51c17df6-54dc-415a-860a-bcf247ea92da None None] MFA Rules not processed for user `fbc9fad7089b4c95ac92e846d46cb5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:06:31.054697 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-51c17df6-54dc-415a-860a-bcf247ea92da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:31.130062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 658/1324] 10.222.0.48 () {58 vars in 1062 bytes} [Mon Jul 25 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:06:31.138997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65533531-c3e6-4c13-a587-fcd75421f209 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:06:31.141052 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-65533531-c3e6-4c13-a587-fcd75421f209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:31.160111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:31.246317 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65533531-c3e6-4c13-a587-fcd75421f209 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:06:31.317545 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36facb45-d991-40c1-b813-eb12ec304b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:06:31.318110 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36facb45-d991-40c1-b813-eb12ec304b2c service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:31.318390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36facb45-d991-40c1-b813-eb12ec304b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:31.318659 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36facb45-d991-40c1-b813-eb12ec304b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:31.320268 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-36facb45-d991-40c1-b813-eb12ec304b2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:31.390264 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:31.427771 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36facb45-d991-40c1-b813-eb12ec304b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:06:31.429205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36facb45-d991-40c1-b813-eb12ec304b2c service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:06:31.447831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 667/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:06:33.704231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe43bb-a0c5-4fdd-bcae-b733f44655c4 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:33.704834 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe43bb-a0c5-4fdd-bcae-b733f44655c4 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:33.704834 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe43bb-a0c5-4fdd-bcae-b733f44655c4 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:33.706254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 659/1326] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:06:33.712174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eaf22-b5b6-4ec1-a0dc-90008c628121 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:33.712730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eaf22-b5b6-4ec1-a0dc-90008c628121 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:33.712730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eaf22-b5b6-4ec1-a0dc-90008c628121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:33.790598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bf9eaf22-b5b6-4ec1-a0dc-90008c628121 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:06:33.791727 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bf9eaf22-b5b6-4ec1-a0dc-90008c628121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:33.886025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 668/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:06:33.926174 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe43bb-a0c5-4fdd-bcae-b733f44655c4 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:06:33.927700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-74fe43bb-a0c5-4fdd-bcae-b733f44655c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:33.988876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:34.033724 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe43bb-a0c5-4fdd-bcae-b733f44655c4 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:06:34.108077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617ab19-8c73-47e1-9892-c44a704e8da0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:06:34.108660 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617ab19-8c73-47e1-9892-c44a704e8da0 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:34.108947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617ab19-8c73-47e1-9892-c44a704e8da0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:34.109245 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617ab19-8c73-47e1-9892-c44a704e8da0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:34.110930 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-f617ab19-8c73-47e1-9892-c44a704e8da0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:34.224243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:34.226702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617ab19-8c73-47e1-9892-c44a704e8da0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:06:34.228444 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617ab19-8c73-47e1-9892-c44a704e8da0 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:06:34.247048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 660/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:06:36.273792 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007f672-062e-4d7f-89c5-61e6e6acc5c9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:36.274302 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007f672-062e-4d7f-89c5-61e6e6acc5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:36.274519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007f672-062e-4d7f-89c5-61e6e6acc5c9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:36.276000 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 669/1329] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:06:36.281138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5a158-8114-4367-b02b-548785fa5fc7 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:36.282202 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5a158-8114-4367-b02b-548785fa5fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:36.282295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5a158-8114-4367-b02b-548785fa5fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:36.351255 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-deb5a158-8114-4367-b02b-548785fa5fc7 None None] MFA Rules not processed for user `b4f363b5e16e42eea33d3a46852cf542`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:06:36.352503 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-deb5a158-8114-4367-b02b-548785fa5fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:36.449203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 661/1330] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:06:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:06:36.505084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007f672-062e-4d7f-89c5-61e6e6acc5c9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:06:36.506530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0007f672-062e-4d7f-89c5-61e6e6acc5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:36.542915 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:36.620331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007f672-062e-4d7f-89c5-61e6e6acc5c9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:06:36.692301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47709d-c9cf-4d6b-b0f3-4ca2d4abee0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:06:36.692953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47709d-c9cf-4d6b-b0f3-4ca2d4abee0f service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:36.693237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47709d-c9cf-4d6b-b0f3-4ca2d4abee0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:36.693514 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47709d-c9cf-4d6b-b0f3-4ca2d4abee0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:36.695193 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6e47709d-c9cf-4d6b-b0f3-4ca2d4abee0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:36.772705 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:36.804328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47709d-c9cf-4d6b-b0f3-4ca2d4abee0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:06:36.805718 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47709d-c9cf-4d6b-b0f3-4ca2d4abee0f service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:06:36.824588 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 670/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:06:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:06:39.205927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae6f80-507c-43be-b30d-beb117586fb1 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:39.206486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae6f80-507c-43be-b30d-beb117586fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:39.206486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae6f80-507c-43be-b30d-beb117586fb1 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:39.207888 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 662/1332] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:06:39.212944 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9a55b-206e-4a48-823a-4c0d43f83ae9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:39.213366 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9a55b-206e-4a48-823a-4c0d43f83ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:39.213491 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9a55b-206e-4a48-823a-4c0d43f83ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:39.277983 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-52b9a55b-206e-4a48-823a-4c0d43f83ae9 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:06:39.279196 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-52b9a55b-206e-4a48-823a-4c0d43f83ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:39.372135 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 671/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:06:39.408737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae6f80-507c-43be-b30d-beb117586fb1 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:06:39.410284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-aeae6f80-507c-43be-b30d-beb117586fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:39.478659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:39.512256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae6f80-507c-43be-b30d-beb117586fb1 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:06:39.590141 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3451f-fc72-4d3f-83ad-8d8099fc9088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:06:39.590782 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3451f-fc72-4d3f-83ad-8d8099fc9088 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:39.591062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3451f-fc72-4d3f-83ad-8d8099fc9088 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:39.591335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3451f-fc72-4d3f-83ad-8d8099fc9088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:39.592956 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-43a3451f-fc72-4d3f-83ad-8d8099fc9088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:39.698945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3451f-fc72-4d3f-83ad-8d8099fc9088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:06:39.700373 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3451f-fc72-4d3f-83ad-8d8099fc9088 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:06:39.710229 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:39.719505 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 663/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:06:41.748974 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630488a7-d1d0-4cea-8a87-7e4a2172c271 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:41.749480 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630488a7-d1d0-4cea-8a87-7e4a2172c271 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:41.749598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630488a7-d1d0-4cea-8a87-7e4a2172c271 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:41.751516 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 672/1335] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:06:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:06:41.756507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dcc4f-8360-4acb-99ea-d792517ffadf None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:41.756921 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dcc4f-8360-4acb-99ea-d792517ffadf None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:41.757063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dcc4f-8360-4acb-99ea-d792517ffadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:41.823748 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-9e9dcc4f-8360-4acb-99ea-d792517ffadf None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:06:41.824963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-9e9dcc4f-8360-4acb-99ea-d792517ffadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:41.919045 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 664/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:06:41.959346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630488a7-d1d0-4cea-8a87-7e4a2172c271 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:06:41.960899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-630488a7-d1d0-4cea-8a87-7e4a2172c271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:41.999676 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:42.062302 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630488a7-d1d0-4cea-8a87-7e4a2172c271 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:06:42.132835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d0d30-4813-43da-9624-978ebbe9dd4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:06:42.133476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d0d30-4813-43da-9624-978ebbe9dd4a service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:42.133752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d0d30-4813-43da-9624-978ebbe9dd4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:42.134044 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d0d30-4813-43da-9624-978ebbe9dd4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:42.135673 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-652d0d30-4813-43da-9624-978ebbe9dd4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:42.217982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:42.243808 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d0d30-4813-43da-9624-978ebbe9dd4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:06:42.245238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d0d30-4813-43da-9624-978ebbe9dd4a service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:06:42.263637 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 673/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:06:44.550989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6f964-f3de-42d9-8942-f40e5726bb7e None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:44.551514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6f964-f3de-42d9-8942-f40e5726bb7e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:44.551514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6f964-f3de-42d9-8942-f40e5726bb7e None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:44.552913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 665/1338] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:06:44.557939 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791b552-d2b7-4cf3-b62a-3e02ec3c42dd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:44.558409 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791b552-d2b7-4cf3-b62a-3e02ec3c42dd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:44.558541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791b552-d2b7-4cf3-b62a-3e02ec3c42dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:44.622938 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e791b552-d2b7-4cf3-b62a-3e02ec3c42dd None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:06:44.624145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e791b552-d2b7-4cf3-b62a-3e02ec3c42dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:44.719535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 674/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:06:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:06:44.754955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6f964-f3de-42d9-8942-f40e5726bb7e None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:06:44.756500 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-f8d6f964-f3de-42d9-8942-f40e5726bb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:44.830350 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:44.858563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6f964-f3de-42d9-8942-f40e5726bb7e None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:06:44.930638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0edfb-12f4-4fd7-a4f9-8853a6f00b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:06:44.931277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0edfb-12f4-4fd7-a4f9-8853a6f00b61 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:44.931560 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0edfb-12f4-4fd7-a4f9-8853a6f00b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:44.931835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0edfb-12f4-4fd7-a4f9-8853a6f00b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:44.933449 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-88a0edfb-12f4-4fd7-a4f9-8853a6f00b61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:45.038549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0edfb-12f4-4fd7-a4f9-8853a6f00b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:06:45.039969 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0edfb-12f4-4fd7-a4f9-8853a6f00b61 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:06:45.058730 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 666/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:06:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:06:48.944312 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea5601-257a-498a-be55-e7b72c264259 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:48.944798 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea5601-257a-498a-be55-e7b72c264259 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:48.944798 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea5601-257a-498a-be55-e7b72c264259 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:48.946247 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 675/1341] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:06:48.951466 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398f15f-b507-44ee-8185-c0976ddc8a1f None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:48.951864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398f15f-b507-44ee-8185-c0976ddc8a1f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:48.952052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398f15f-b507-44ee-8185-c0976ddc8a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:48.958203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:49.019870 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-3398f15f-b507-44ee-8185-c0976ddc8a1f None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:06:49.021099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-3398f15f-b507-44ee-8185-c0976ddc8a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:49.122389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 667/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:06:49.161544 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea5601-257a-498a-be55-e7b72c264259 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:06:49.163172 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-48ea5601-257a-498a-be55-e7b72c264259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:49.211780 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:49.265002 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea5601-257a-498a-be55-e7b72c264259 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:06:49.338077 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe792e-95fa-44d1-b0dd-85ea79eb65ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:06:49.338890 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe792e-95fa-44d1-b0dd-85ea79eb65ce service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:49.339241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe792e-95fa-44d1-b0dd-85ea79eb65ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:49.339604 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe792e-95fa-44d1-b0dd-85ea79eb65ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:49.341341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-afbe792e-95fa-44d1-b0dd-85ea79eb65ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:49.435434 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:49.454316 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe792e-95fa-44d1-b0dd-85ea79eb65ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:06:49.455774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe792e-95fa-44d1-b0dd-85ea79eb65ce service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:06:49.477234 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 676/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:06:52.126869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c977b6-c149-47b9-ac06-8cd5e24448e6 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:52.127442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c977b6-c149-47b9-ac06-8cd5e24448e6 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:52.127442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c977b6-c149-47b9-ac06-8cd5e24448e6 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:52.128834 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 668/1344] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:06:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:06:52.134716 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f381b92-e01e-4da8-b3de-e6842d8eb7f5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:52.135206 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f381b92-e01e-4da8-b3de-e6842d8eb7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:52.135404 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f381b92-e01e-4da8-b3de-e6842d8eb7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:52.209120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1f381b92-e01e-4da8-b3de-e6842d8eb7f5 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:06:52.210398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1f381b92-e01e-4da8-b3de-e6842d8eb7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:52.314410 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 677/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:06:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:06:52.351314 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c977b6-c149-47b9-ac06-8cd5e24448e6 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:06:52.352862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a8c977b6-c149-47b9-ac06-8cd5e24448e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:52.439653 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:52.458652 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c977b6-c149-47b9-ac06-8cd5e24448e6 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:06:52.533919 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cea319-115b-4962-a411-7cca9fbd33e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:06:52.534527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cea319-115b-4962-a411-7cca9fbd33e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:52.534815 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cea319-115b-4962-a411-7cca9fbd33e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:52.535089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cea319-115b-4962-a411-7cca9fbd33e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:52.536762 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-84cea319-115b-4962-a411-7cca9fbd33e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:52.644335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cea319-115b-4962-a411-7cca9fbd33e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:06:52.645757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cea319-115b-4962-a411-7cca9fbd33e3 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:06:52.664443 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 669/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:06:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:06:56.585815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755bab7-44c3-43a1-8f51-53015fa2dff9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:56.586398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755bab7-44c3-43a1-8f51-53015fa2dff9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:56.586510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755bab7-44c3-43a1-8f51-53015fa2dff9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:56.587893 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 678/1347] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:06:56.593266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e0c97-1adb-4f2a-b92d-c033c9d11f71 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:56.593709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e0c97-1adb-4f2a-b92d-c033c9d11f71 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:56.593900 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e0c97-1adb-4f2a-b92d-c033c9d11f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:56.610973 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:56.665969 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-9f8e0c97-1adb-4f2a-b92d-c033c9d11f71 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:06:56.667214 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-9f8e0c97-1adb-4f2a-b92d-c033c9d11f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:56.767618 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 670/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:06:56.808526 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755bab7-44c3-43a1-8f51-53015fa2dff9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:06:56.810143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7755bab7-44c3-43a1-8f51-53015fa2dff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:56.991841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:57.041059 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755bab7-44c3-43a1-8f51-53015fa2dff9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:06:57.116736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a68668-49ec-48cf-b667-b3cef7ccee5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:06:57.117525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a68668-49ec-48cf-b667-b3cef7ccee5a service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:06:57.117879 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a68668-49ec-48cf-b667-b3cef7ccee5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:06:57.118246 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a68668-49ec-48cf-b667-b3cef7ccee5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:06:57.119989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a9a68668-49ec-48cf-b667-b3cef7ccee5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:06:57.232050 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:06:57.237117 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a68668-49ec-48cf-b667-b3cef7ccee5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:06:57.238633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a68668-49ec-48cf-b667-b3cef7ccee5a service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:06:57.257747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 679/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:07:02.195146 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d39c-521d-4068-97e9-7f9de556f526 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:02.195680 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d39c-521d-4068-97e9-7f9de556f526 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:02.195680 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d39c-521d-4068-97e9-7f9de556f526 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:02.197240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 671/1350] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 12:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:02.201953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6235bc-30d2-4ce9-8afd-6a53af4cdaaf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:02.202392 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6235bc-30d2-4ce9-8afd-6a53af4cdaaf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:02.202567 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6235bc-30d2-4ce9-8afd-6a53af4cdaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:02.281893 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ae6235bc-30d2-4ce9-8afd-6a53af4cdaaf None None] MFA Rules not processed for user `40f748b0f6b1433c87012793f0dda307`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:02.283189 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ae6235bc-30d2-4ce9-8afd-6a53af4cdaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:02.414622 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 680/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 12:07:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:07:06.385735 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63cd71-8796-4566-97a4-79bb0b34c456 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:06.386269 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63cd71-8796-4566-97a4-79bb0b34c456 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:06.386348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63cd71-8796-4566-97a4-79bb0b34c456 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:06.387891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 672/1352] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 12:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:07:06.392820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3f9cc-f5d5-4581-8d4c-10811090e4c4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:06.393232 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3f9cc-f5d5-4581-8d4c-10811090e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:06.393366 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3f9cc-f5d5-4581-8d4c-10811090e4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:06.450772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:06.476368 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7ec3f9cc-f5d5-4581-8d4c-10811090e4c4 None None] MFA Rules not processed for user `40f748b0f6b1433c87012793f0dda307`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:06.477596 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7ec3f9cc-f5d5-4581-8d4c-10811090e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:06.588870 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 681/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 12:07:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:07:06.765735 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=59 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:07.915967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acad77-b5d7-4af6-a274-188d2aa605f6 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:07.916611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acad77-b5d7-4af6-a274-188d2aa605f6 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:07.916611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acad77-b5d7-4af6-a274-188d2aa605f6 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:07.917898 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 673/1354] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 12:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:07.923615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db952403-161b-4c1c-b72d-d6610c0a821e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:07.924297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db952403-161b-4c1c-b72d-d6610c0a821e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:07.924551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db952403-161b-4c1c-b72d-d6610c0a821e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:07.999631 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-db952403-161b-4c1c-b72d-d6610c0a821e None None] MFA Rules not processed for user `40f748b0f6b1433c87012793f0dda307`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:08.001382 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-db952403-161b-4c1c-b72d-d6610c0a821e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:08.041376 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:08.107179 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 682/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 12:07:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:07:11.447785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f70f1-8823-404c-9d49-959e06a2458d None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:11.448291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f70f1-8823-404c-9d49-959e06a2458d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:11.448291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f70f1-8823-404c-9d49-959e06a2458d None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:11.450539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 674/1356] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:07:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:11.456193 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e97d8-ec8d-4946-af33-05ecebe82ce8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:11.457012 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e97d8-ec8d-4946-af33-05ecebe82ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:11.457292 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e97d8-ec8d-4946-af33-05ecebe82ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:11.536293 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7c5e97d8-ec8d-4946-af33-05ecebe82ce8 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:11.537743 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7c5e97d8-ec8d-4946-af33-05ecebe82ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:11.670110 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 683/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:07:11.711680 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80fec3-ea4f-494d-8ae0-6e22664aa071 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:11.712242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80fec3-ea4f-494d-8ae0-6e22664aa071 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:11.712530 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80fec3-ea4f-494d-8ae0-6e22664aa071 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:11.714875 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 675/1358] 10.222.0.48 () {54 vars in 962 bytes} [Mon Jul 25 12:07:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:11.732935 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4268626-cc62-4089-94a5-33c18ec17564 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:11.733237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4268626-cc62-4089-94a5-33c18ec17564 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:11.733546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4268626-cc62-4089-94a5-33c18ec17564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:11.754218 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:11.836201 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e4268626-cc62-4089-94a5-33c18ec17564 None None] MFA Rules not processed for user `6d9db26891a04b0bb7e655c21feeffdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:11.837384 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e4268626-cc62-4089-94a5-33c18ec17564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:11.965201 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 684/1359] 10.222.0.48 () {58 vars in 1059 bytes} [Mon Jul 25 12:07:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:07:11.978220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80fec3-ea4f-494d-8ae0-6e22664aa071 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:07:11.982473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-2a80fec3-ea4f-494d-8ae0-6e22664aa071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:12.154381 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80fec3-ea4f-494d-8ae0-6e22664aa071 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:07:12.231647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:12.273589 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45029181-a9f3-403e-b098-194a58a223e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:07:12.274286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45029181-a9f3-403e-b098-194a58a223e8 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:12.274566 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45029181-a9f3-403e-b098-194a58a223e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:12.274845 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45029181-a9f3-403e-b098-194a58a223e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:12.276505 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-45029181-a9f3-403e-b098-194a58a223e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:12.370492 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45029181-a9f3-403e-b098-194a58a223e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:07:12.372097 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45029181-a9f3-403e-b098-194a58a223e8 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:07:12.391382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 676/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:07:14.613433 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d645977-9ba8-4581-b461-75b2fe38fa9e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:14.613827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d645977-9ba8-4581-b461-75b2fe38fa9e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:14.614162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d645977-9ba8-4581-b461-75b2fe38fa9e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:14.615409 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 685/1361] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:14.620727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8cc1e-1854-4f81-92ec-581ab71c69f4 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:14.621121 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8cc1e-1854-4f81-92ec-581ab71c69f4 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:14.621373 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8cc1e-1854-4f81-92ec-581ab71c69f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:14.690845 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-29c8cc1e-1854-4f81-92ec-581ab71c69f4 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:14.692043 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-29c8cc1e-1854-4f81-92ec-581ab71c69f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:14.741839 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:14.805717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 677/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:07:14.850365 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d645977-9ba8-4581-b461-75b2fe38fa9e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:07:14.852041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4d645977-9ba8-4581-b461-75b2fe38fa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:14.933763 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:15.032754 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d645977-9ba8-4581-b461-75b2fe38fa9e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:07:15.192869 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb48cdc-a25c-4068-bb06-e3a7f0dc1689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:07:15.193534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48cdc-a25c-4068-bb06-e3a7f0dc1689 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:15.193811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48cdc-a25c-4068-bb06-e3a7f0dc1689 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:15.194117 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48cdc-a25c-4068-bb06-e3a7f0dc1689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:15.195766 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2eb48cdc-a25c-4068-bb06-e3a7f0dc1689 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:15.220829 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:15.291536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb48cdc-a25c-4068-bb06-e3a7f0dc1689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:07:15.293141 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb48cdc-a25c-4068-bb06-e3a7f0dc1689 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:07:15.312180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 686/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:07:17.662253 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e88ae-44b8-456e-998b-dc66bb5077f9 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:17.662775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e88ae-44b8-456e-998b-dc66bb5077f9 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:17.662775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e88ae-44b8-456e-998b-dc66bb5077f9 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:17.664188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 678/1364] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:17.669588 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcfb42-75a9-4275-b557-68a34806d3b8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:17.670427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcfb42-75a9-4275-b557-68a34806d3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:17.670710 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcfb42-75a9-4275-b557-68a34806d3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:17.755719 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a4dcfb42-75a9-4275-b557-68a34806d3b8 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:17.756977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a4dcfb42-75a9-4275-b557-68a34806d3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:17.869511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:17.880212 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 687/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:07:17.919346 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362959de-3d4a-4472-b82c-1500d3c6d6f5 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:17.919701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362959de-3d4a-4472-b82c-1500d3c6d6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:17.920178 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362959de-3d4a-4472-b82c-1500d3c6d6f5 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:17.921707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 679/1366] 10.222.0.48 () {54 vars in 962 bytes} [Mon Jul 25 12:07:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:17.927551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e00b3f-2dc2-44ed-85f8-4ad81ec46e27 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:17.927843 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e00b3f-2dc2-44ed-85f8-4ad81ec46e27 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:17.928128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e00b3f-2dc2-44ed-85f8-4ad81ec46e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:18.014155 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-35e00b3f-2dc2-44ed-85f8-4ad81ec46e27 None None] MFA Rules not processed for user `6d9db26891a04b0bb7e655c21feeffdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:18.015299 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-35e00b3f-2dc2-44ed-85f8-4ad81ec46e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:18.143492 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 688/1367] 10.222.0.48 () {58 vars in 1059 bytes} [Mon Jul 25 12:07:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:07:18.151257 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362959de-3d4a-4472-b82c-1500d3c6d6f5 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:07:18.152761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-362959de-3d4a-4472-b82c-1500d3c6d6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:18.314795 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362959de-3d4a-4472-b82c-1500d3c6d6f5 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:07:18.343474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:18.447390 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc136ea5-0baf-409d-ad38-2ab927918a23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:07:18.448041 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc136ea5-0baf-409d-ad38-2ab927918a23 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:18.448319 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc136ea5-0baf-409d-ad38-2ab927918a23 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:18.448588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc136ea5-0baf-409d-ad38-2ab927918a23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:18.450310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-dc136ea5-0baf-409d-ad38-2ab927918a23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:18.547813 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc136ea5-0baf-409d-ad38-2ab927918a23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:07:18.549588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc136ea5-0baf-409d-ad38-2ab927918a23 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:07:18.568934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 680/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:07:19.586486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed13f6-a225-41d2-a19d-3c0a6937de3d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:19.587037 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed13f6-a225-41d2-a19d-3c0a6937de3d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:19.587037 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed13f6-a225-41d2-a19d-3c0a6937de3d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:19.588437 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 689/1369] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:19.593625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d5649-0b96-49f4-b387-1b3a053e5e22 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:19.594553 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d5649-0b96-49f4-b387-1b3a053e5e22 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:19.594733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d5649-0b96-49f4-b387-1b3a053e5e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:19.627222 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:19.662773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-b51d5649-0b96-49f4-b387-1b3a053e5e22 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:19.664122 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b51d5649-0b96-49f4-b387-1b3a053e5e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:19.769983 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 681/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:07:20.115850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ae8d7-e686-48ae-80bb-dcf9b9f742fc None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:20.116244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ae8d7-e686-48ae-80bb-dcf9b9f742fc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:20.116615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ae8d7-e686-48ae-80bb-dcf9b9f742fc None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:20.118435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 690/1371] 10.222.0.48 () {54 vars in 964 bytes} [Mon Jul 25 12:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:20.123604 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0523d6-6abd-46e7-bff7-95c96917ddfb None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:20.124056 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0523d6-6abd-46e7-bff7-95c96917ddfb None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:20.124340 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0523d6-6abd-46e7-bff7-95c96917ddfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:20.214325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-2e0523d6-6abd-46e7-bff7-95c96917ddfb None None] MFA Rules not processed for user `f014af35de5c47ab86ec02ebed360678`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:20.215576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-2e0523d6-6abd-46e7-bff7-95c96917ddfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:20.264221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:20.302960 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 682/1372] 10.222.0.48 () {58 vars in 1061 bytes} [Mon Jul 25 12:07:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:07:20.310519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ae8d7-e686-48ae-80bb-dcf9b9f742fc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:07:20.312300 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5c6ae8d7-e686-48ae-80bb-dcf9b9f742fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:20.370805 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:20.428636 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ae8d7-e686-48ae-80bb-dcf9b9f742fc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:07:20.511130 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc8339-7066-4e48-b3d3-a7240a1ff710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:07:20.511798 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8339-7066-4e48-b3d3-a7240a1ff710 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:20.512082 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8339-7066-4e48-b3d3-a7240a1ff710 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:20.512356 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8339-7066-4e48-b3d3-a7240a1ff710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:20.514019 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c5dc8339-7066-4e48-b3d3-a7240a1ff710 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:20.619754 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:20.645322 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3eee2c-03b3-40a2-b2ad-67d380d93ea5 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:20.645822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3eee2c-03b3-40a2-b2ad-67d380d93ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:20.645904 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3eee2c-03b3-40a2-b2ad-67d380d93ea5 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:20.647345 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc8339-7066-4e48-b3d3-a7240a1ff710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:07:20.648609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 683/1373] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:07:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:20.648988 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc8339-7066-4e48-b3d3-a7240a1ff710 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:07:20.654098 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f493e-8f40-4e6f-af2b-46e66ad7335c None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:20.654393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f493e-8f40-4e6f-af2b-46e66ad7335c None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:20.654674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f493e-8f40-4e6f-af2b-46e66ad7335c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:20.671125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 691/1374] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:07:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:07:20.737184 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-b29f493e-8f40-4e6f-af2b-46e66ad7335c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:20.738454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b29f493e-8f40-4e6f-af2b-46e66ad7335c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:20.853172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 684/1375] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:07:20.902525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc8339-7066-4e48-b3d3-a7240a1ff710 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:07:20.902525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c5dc8339-7066-4e48-b3d3-a7240a1ff710 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:21.010052 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc8339-7066-4e48-b3d3-a7240a1ff710 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:07:21.111524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:21.123326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d33af-21e1-458b-8468-9e07d24c8b7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:07:21.123968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d33af-21e1-458b-8468-9e07d24c8b7f service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:21.124274 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d33af-21e1-458b-8468-9e07d24c8b7f service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:21.124542 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d33af-21e1-458b-8468-9e07d24c8b7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:21.126719 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-db7d33af-21e1-458b-8468-9e07d24c8b7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:21.215833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d33af-21e1-458b-8468-9e07d24c8b7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:07:21.217476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d33af-21e1-458b-8468-9e07d24c8b7f service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:07:21.235867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 692/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:07:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:07:23.244145 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87bb69-0f62-4844-8d54-d4325fd8d98c None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:23.244634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87bb69-0f62-4844-8d54-d4325fd8d98c None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:23.244634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87bb69-0f62-4844-8d54-d4325fd8d98c None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:23.246061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 685/1377] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:23.251270 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf68f9-9762-4397-9808-6c742c10296c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:23.251701 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf68f9-9762-4397-9808-6c742c10296c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:23.251827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf68f9-9762-4397-9808-6c742c10296c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:23.318153 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-45cf68f9-9762-4397-9808-6c742c10296c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:23.319355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-45cf68f9-9762-4397-9808-6c742c10296c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:23.377456 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:23.422967 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 693/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:07:23.470454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87bb69-0f62-4844-8d54-d4325fd8d98c None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:07:23.473368 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-4f87bb69-0f62-4844-8d54-d4325fd8d98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:23.534790 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:23.651052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87bb69-0f62-4844-8d54-d4325fd8d98c None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:07:23.767901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c9189-71bf-47f8-b3bf-f3782c572f84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:07:23.768547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c9189-71bf-47f8-b3bf-f3782c572f84 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:23.768832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c9189-71bf-47f8-b3bf-f3782c572f84 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:23.769109 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c9189-71bf-47f8-b3bf-f3782c572f84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:23.770798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ec6c9189-71bf-47f8-b3bf-f3782c572f84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:23.782236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:23.862380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c9189-71bf-47f8-b3bf-f3782c572f84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:07:23.865345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c9189-71bf-47f8-b3bf-f3782c572f84 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:07:23.882913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 686/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:07:25.941787 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127e20f-6479-4e8e-9f7f-93eb44af7d90 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:25.942322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127e20f-6479-4e8e-9f7f-93eb44af7d90 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:25.942407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127e20f-6479-4e8e-9f7f-93eb44af7d90 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:25.943766 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 694/1380] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:25.949148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbbadd-5c61-4200-8c07-5bdd259cd8f0 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:25.949917 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbbadd-5c61-4200-8c07-5bdd259cd8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:25.950570 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbbadd-5c61-4200-8c07-5bdd259cd8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:26.021505 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-05bbbadd-5c61-4200-8c07-5bdd259cd8f0 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:26.022655 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-05bbbadd-5c61-4200-8c07-5bdd259cd8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:26.119562 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:26.136682 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 687/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:07:26.181373 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127e20f-6479-4e8e-9f7f-93eb44af7d90 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:07:26.183327 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c127e20f-6479-4e8e-9f7f-93eb44af7d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:26.349203 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127e20f-6479-4e8e-9f7f-93eb44af7d90 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:07:26.403787 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:26.484893 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c2956-5395-4160-bfcd-d5bff6c18489 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:07:26.485547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c2956-5395-4160-bfcd-d5bff6c18489 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:26.485825 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c2956-5395-4160-bfcd-d5bff6c18489 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:26.486124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c2956-5395-4160-bfcd-d5bff6c18489 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:26.487743 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-aa9c2956-5395-4160-bfcd-d5bff6c18489 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:26.581674 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c2956-5395-4160-bfcd-d5bff6c18489 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:07:26.583227 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c2956-5395-4160-bfcd-d5bff6c18489 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:07:26.601651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 695/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:07:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:07:28.630747 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7546d-e3ce-4b5b-b1a5-ac328bf01f60 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:28.631268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7546d-e3ce-4b5b-b1a5-ac328bf01f60 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:28.631457 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7546d-e3ce-4b5b-b1a5-ac328bf01f60 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:28.632996 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 688/1383] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:07:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:07:28.638082 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67e8fb-f2bb-4973-bcfb-976587eb293f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:28.638519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67e8fb-f2bb-4973-bcfb-976587eb293f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:28.638615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67e8fb-f2bb-4973-bcfb-976587eb293f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:28.708757 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7b67e8fb-f2bb-4973-bcfb-976587eb293f None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:28.710029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7b67e8fb-f2bb-4973-bcfb-976587eb293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:28.712177 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:28.810738 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 696/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:07:28.855697 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7546d-e3ce-4b5b-b1a5-ac328bf01f60 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:07:28.857257 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-e6f7546d-e3ce-4b5b-b1a5-ac328bf01f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:29.004165 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7546d-e3ce-4b5b-b1a5-ac328bf01f60 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:07:29.074774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:29.134502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ed230-ce18-440a-ac71-fdac8e144342 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:07:29.135314 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ed230-ce18-440a-ac71-fdac8e144342 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:29.135667 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ed230-ce18-440a-ac71-fdac8e144342 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:29.136018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ed230-ce18-440a-ac71-fdac8e144342 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:29.138205 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-2b9ed230-ce18-440a-ac71-fdac8e144342 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:29.235073 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ed230-ce18-440a-ac71-fdac8e144342 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:07:29.236724 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ed230-ce18-440a-ac71-fdac8e144342 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:07:29.255899 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 689/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:07:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:07:31.263242 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a37e9-895e-40a7-a6d1-d10970d45107 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:31.263747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a37e9-895e-40a7-a6d1-d10970d45107 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:31.263747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a37e9-895e-40a7-a6d1-d10970d45107 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:31.265182 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 697/1386] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:31.271067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c8423-26a5-493c-8a05-a30538ac9b5c None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:31.271516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c8423-26a5-493c-8a05-a30538ac9b5c None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:31.271753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c8423-26a5-493c-8a05-a30538ac9b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:31.340347 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-7b8c8423-26a5-493c-8a05-a30538ac9b5c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:31.341591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-7b8c8423-26a5-493c-8a05-a30538ac9b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:31.368519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:31.449889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 690/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:07:31.495505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a37e9-895e-40a7-a6d1-d10970d45107 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:07:31.497075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bf4a37e9-895e-40a7-a6d1-d10970d45107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:31.635217 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:31.657840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a37e9-895e-40a7-a6d1-d10970d45107 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:07:31.782727 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f3fa3-a589-496b-bccc-f46335b7632a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:07:31.783610 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f3fa3-a589-496b-bccc-f46335b7632a service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:31.783972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f3fa3-a589-496b-bccc-f46335b7632a service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:31.784319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f3fa3-a589-496b-bccc-f46335b7632a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:31.786570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4d6f3fa3-a589-496b-bccc-f46335b7632a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:31.892228 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f3fa3-a589-496b-bccc-f46335b7632a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:07:31.893794 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f3fa3-a589-496b-bccc-f46335b7632a service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:07:31.898988 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:31.915111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 698/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:07:33.986417 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f183d-30c3-4b69-b812-fdc8a2ed2db0 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:33.987006 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f183d-30c3-4b69-b812-fdc8a2ed2db0 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:33.987006 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f183d-30c3-4b69-b812-fdc8a2ed2db0 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:33.988379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 691/1389] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:33.993531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36056d67-5b86-434d-b0ad-e431ab424e67 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:33.993933 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36056d67-5b86-434d-b0ad-e431ab424e67 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:33.994123 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36056d67-5b86-434d-b0ad-e431ab424e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:34.062677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-36056d67-5b86-434d-b0ad-e431ab424e67 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:34.064398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-36056d67-5b86-434d-b0ad-e431ab424e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:34.160605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 699/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:07:34.205772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f183d-30c3-4b69-b812-fdc8a2ed2db0 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:07:34.207338 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-2d8f183d-30c3-4b69-b812-fdc8a2ed2db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:34.354849 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f183d-30c3-4b69-b812-fdc8a2ed2db0 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:07:34.364421 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:34.474445 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47c92e-bd45-4f92-b4b3-b74daa611919 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:07:34.475103 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47c92e-bd45-4f92-b4b3-b74daa611919 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:34.475438 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47c92e-bd45-4f92-b4b3-b74daa611919 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:34.475830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47c92e-bd45-4f92-b4b3-b74daa611919 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:34.477503 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-4f47c92e-bd45-4f92-b4b3-b74daa611919 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:34.566392 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47c92e-bd45-4f92-b4b3-b74daa611919 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:07:34.567931 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47c92e-bd45-4f92-b4b3-b74daa611919 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:07:34.586687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 692/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:07:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:07:35.787906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7480524-ffff-4a26-908e-2a1616959560 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:35.788520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7480524-ffff-4a26-908e-2a1616959560 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:35.788520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7480524-ffff-4a26-908e-2a1616959560 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:35.789843 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 700/1392] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:35.795057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c870b8d-8d03-4cef-81d5-15df5bcaea81 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:35.795468 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c870b8d-8d03-4cef-81d5-15df5bcaea81 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:35.795619 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c870b8d-8d03-4cef-81d5-15df5bcaea81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:35.811803 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:35.864158 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-7c870b8d-8d03-4cef-81d5-15df5bcaea81 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:35.865367 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-7c870b8d-8d03-4cef-81d5-15df5bcaea81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:35.960763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 693/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:07:36.016291 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdfee4-80f7-4de9-9276-a3961d614107 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:36.016581 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdfee4-80f7-4de9-9276-a3961d614107 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:36.016859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdfee4-80f7-4de9-9276-a3961d614107 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:36.018273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 701/1394] 10.222.0.48 () {54 vars in 966 bytes} [Mon Jul 25 12:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:36.023351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3e052-d47d-4257-9b22-ff69644c2da5 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:36.023648 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3e052-d47d-4257-9b22-ff69644c2da5 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:36.024031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3e052-d47d-4257-9b22-ff69644c2da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:36.099652 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-76c3e052-d47d-4257-9b22-ff69644c2da5 None None] MFA Rules not processed for user `cd52ff8138094d64bce9de60c819ab4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:36.100770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-76c3e052-d47d-4257-9b22-ff69644c2da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:36.135603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:36.178574 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 694/1395] 10.222.0.48 () {58 vars in 1063 bytes} [Mon Jul 25 12:07:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:07:36.186459 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdfee4-80f7-4de9-9276-a3961d614107 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:07:36.188500 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e7fdfee4-80f7-4de9-9276-a3961d614107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:36.260747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:36.292656 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdfee4-80f7-4de9-9276-a3961d614107 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:07:36.366498 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760802e9-00da-4ccc-bbfd-e59bde4b0492 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52ff8138094d64bce9de60c819ab4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:07:36.367062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760802e9-00da-4ccc-bbfd-e59bde4b0492 service glance] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:36.367347 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760802e9-00da-4ccc-bbfd-e59bde4b0492 service glance] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:36.367626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760802e9-00da-4ccc-bbfd-e59bde4b0492 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:36.369263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-760802e9-00da-4ccc-bbfd-e59bde4b0492 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:36.482259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760802e9-00da-4ccc-bbfd-e59bde4b0492 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:07:36.483704 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760802e9-00da-4ccc-bbfd-e59bde4b0492 service glance] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:07:36.499135 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:36.502258 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 702/1396] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:07:36.610925 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f94056-5477-44c5-8c9e-385effcbb537 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:36.611213 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f94056-5477-44c5-8c9e-385effcbb537 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:36.611492 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f94056-5477-44c5-8c9e-385effcbb537 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:36.612916 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 695/1397] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:36.618204 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9947cfe-483a-4e3e-a829-05a01e37e1c8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:36.618435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9947cfe-483a-4e3e-a829-05a01e37e1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:36.618712 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9947cfe-483a-4e3e-a829-05a01e37e1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:36.686868 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c9947cfe-483a-4e3e-a829-05a01e37e1c8 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:36.690369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c9947cfe-483a-4e3e-a829-05a01e37e1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:36.794589 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 703/1398] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:07:36.839149 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f94056-5477-44c5-8c9e-385effcbb537 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:07:36.840762 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-e2f94056-5477-44c5-8c9e-385effcbb537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:36.997400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f94056-5477-44c5-8c9e-385effcbb537 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:07:37.039746 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:37.122804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eecef6-3b72-4c27-8c9b-500a02d0d584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:07:37.123465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eecef6-3b72-4c27-8c9b-500a02d0d584 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:37.123745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eecef6-3b72-4c27-8c9b-500a02d0d584 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:37.124016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eecef6-3b72-4c27-8c9b-500a02d0d584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:37.126400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-11eecef6-3b72-4c27-8c9b-500a02d0d584 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:37.221909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eecef6-3b72-4c27-8c9b-500a02d0d584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:07:37.223570 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eecef6-3b72-4c27-8c9b-500a02d0d584 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:07:37.238820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b2121-bbea-4994-8500-4074c2837285 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:37.239105 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b2121-bbea-4994-8500-4074c2837285 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:37.239379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b2121-bbea-4994-8500-4074c2837285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:37.242132 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 696/1399] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:07:37.314775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-579b2121-bbea-4994-8500-4074c2837285 None None] MFA Rules not processed for user `30c0516b85e74bdb829a3019e71e6ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:37.316023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-579b2121-bbea-4994-8500-4074c2837285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:37.349133 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:37.415306 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 704/1400] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 12:07:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:07:37.460688 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e44fbc-e0a8-4040-b227-31937047d3b1 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:37.461060 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e44fbc-e0a8-4040-b227-31937047d3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:37.461408 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e44fbc-e0a8-4040-b227-31937047d3b1 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:37.462963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 697/1401] 10.222.0.48 () {54 vars in 943 bytes} [Mon Jul 25 12:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:37.470165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdf5d2-40e8-444c-b378-2db4b282e3c7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:37.470472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdf5d2-40e8-444c-b378-2db4b282e3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:37.470734 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdf5d2-40e8-444c-b378-2db4b282e3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:37.546104 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9ccdf5d2-40e8-444c-b378-2db4b282e3c7 None None] MFA Rules not processed for user `e71de21b4b6d4971953f0c1ca92d9f23`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:37.547886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9ccdf5d2-40e8-444c-b378-2db4b282e3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:37.653259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 705/1402] 10.222.0.48 () {58 vars in 1040 bytes} [Mon Jul 25 12:07:37 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:07:37.663114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e44fbc-e0a8-4040-b227-31937047d3b1 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:07:37.664642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-22e44fbc-e0a8-4040-b227-31937047d3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:37.713951 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:37.802510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e44fbc-e0a8-4040-b227-31937047d3b1 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:07:37.912354 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfc467-3fe3-4728-988d-2271482a1a6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71de21b4b6d4971953f0c1ca92d9f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:07:37.913013 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfc467-3fe3-4728-988d-2271482a1a6e service swift] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:37.913287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfc467-3fe3-4728-988d-2271482a1a6e service swift] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:37.913562 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfc467-3fe3-4728-988d-2271482a1a6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:37.915402 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-f4bfc467-3fe3-4728-988d-2271482a1a6e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:37.945776 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:38.001305 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfc467-3fe3-4728-988d-2271482a1a6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:07:38.002961 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfc467-3fe3-4728-988d-2271482a1a6e service swift] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:07:38.010968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 698/1403] 10.222.0.48 () {60 vars in 1384 bytes} [Mon Jul 25 12:07:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:07:39.277472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0c287-ab21-4c02-b5cd-e1fd673caccc None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:39.278037 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0c287-ab21-4c02-b5cd-e1fd673caccc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:39.278037 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0c287-ab21-4c02-b5cd-e1fd673caccc None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:39.279492 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 706/1404] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:39.289299 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908e89e-4637-4d6b-944c-95b0b8db275e None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:39.289822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908e89e-4637-4d6b-944c-95b0b8db275e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:39.289994 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908e89e-4637-4d6b-944c-95b0b8db275e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:39.366208 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-f908e89e-4637-4d6b-944c-95b0b8db275e None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:39.367853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-f908e89e-4637-4d6b-944c-95b0b8db275e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:39.601949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 699/1405] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:07:39.648677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0c287-ab21-4c02-b5cd-e1fd673caccc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:07:39.650214 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-72e0c287-ab21-4c02-b5cd-e1fd673caccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:39.653081 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:39.851042 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0c287-ab21-4c02-b5cd-e1fd673caccc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:07:39.934015 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:39.977660 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af097d-3030-4ba5-a53e-b2e6e53c7ed9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:07:39.978447 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af097d-3030-4ba5-a53e-b2e6e53c7ed9 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:39.978840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af097d-3030-4ba5-a53e-b2e6e53c7ed9 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:39.981394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af097d-3030-4ba5-a53e-b2e6e53c7ed9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:39.983143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-59af097d-3030-4ba5-a53e-b2e6e53c7ed9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:40.076166 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af097d-3030-4ba5-a53e-b2e6e53c7ed9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:07:40.077795 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af097d-3030-4ba5-a53e-b2e6e53c7ed9 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:07:40.100912 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 707/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:07:42.248815 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeeea5-b032-44b1-a750-f8b4f4b755f0 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:42.249408 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeeea5-b032-44b1-a750-f8b4f4b755f0 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:42.249408 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeeea5-b032-44b1-a750-f8b4f4b755f0 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:42.251552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 700/1407] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:07:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:07:42.256946 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239163e-1e37-4355-b10e-281d30693c7d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:42.257436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239163e-1e37-4355-b10e-281d30693c7d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:42.257544 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239163e-1e37-4355-b10e-281d30693c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:42.332392 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8239163e-1e37-4355-b10e-281d30693c7d None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:07:42.333659 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8239163e-1e37-4355-b10e-281d30693c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:42.388137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:42.478297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 708/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:07:42.510430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aeeea5-b032-44b1-a750-f8b4f4b755f0 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:07:42.512322 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b3aeeea5-b032-44b1-a750-f8b4f4b755f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:42.539466 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:42.682707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aeeea5-b032-44b1-a750-f8b4f4b755f0 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:07:42.785845 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:42.807257 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c656532-e144-4be7-bd41-2a5c0f19b843 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:07:42.807914 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c656532-e144-4be7-bd41-2a5c0f19b843 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:07:42.808195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c656532-e144-4be7-bd41-2a5c0f19b843 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:07:42.808471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c656532-e144-4be7-bd41-2a5c0f19b843 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:07:42.810274 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-4c656532-e144-4be7-bd41-2a5c0f19b843 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:07:42.911390 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c656532-e144-4be7-bd41-2a5c0f19b843 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:07:42.913123 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c656532-e144-4be7-bd41-2a5c0f19b843 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:07:42.933400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 701/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:07:52.461962 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=26 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:07:52.930789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=52 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:00.034098 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6e5d9-858f-442f-af0e-425337c9e649 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:00.034669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6e5d9-858f-442f-af0e-425337c9e649 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:00.034669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6e5d9-858f-442f-af0e-425337c9e649 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:00.036046 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 709/1410] 10.222.0.48 () {54 vars in 918 bytes} [Mon Jul 25 12:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:00.041049 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c10997-e27f-459b-bc8d-8b60bd64620d None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:00.041481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c10997-e27f-459b-bc8d-8b60bd64620d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:00.041621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c10997-e27f-459b-bc8d-8b60bd64620d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:00.117396 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-b3c10997-e27f-459b-bc8d-8b60bd64620d None None] MFA Rules not processed for user `40f748b0f6b1433c87012793f0dda307`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:00.118638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b3c10997-e27f-459b-bc8d-8b60bd64620d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:00.222906 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 702/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Mon Jul 25 12:08:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:00.236991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3840a90-4ff4-4094-9111-60afaed75365 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:00.237280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3840a90-4ff4-4094-9111-60afaed75365 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:00.237555 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3840a90-4ff4-4094-9111-60afaed75365 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:00.238962 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 710/1412] 10.222.0.48 () {54 vars in 918 bytes} [Mon Jul 25 12:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:00.243512 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fa341-7aa1-4f81-b9c7-3c1fb123a365 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:00.243797 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fa341-7aa1-4f81-b9c7-3c1fb123a365 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:00.244071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fa341-7aa1-4f81-b9c7-3c1fb123a365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:00.317882 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:00.320933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-bb2fa341-7aa1-4f81-b9c7-3c1fb123a365 None None] MFA Rules not processed for user `6d9db26891a04b0bb7e655c21feeffdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:00.322759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-bb2fa341-7aa1-4f81-b9c7-3c1fb123a365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:00.435975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 703/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Mon Jul 25 12:08:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:02.859452 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ae3b0-435e-40e2-a3ec-e53daf436c21 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:02.859975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ae3b0-435e-40e2-a3ec-e53daf436c21 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:02.860072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ae3b0-435e-40e2-a3ec-e53daf436c21 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:02.861403 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:02.866529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa0343-28cc-47d2-bb60-3bb1cbc1042a None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:02.866933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa0343-28cc-47d2-bb60-3bb1cbc1042a None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:02.867069 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa0343-28cc-47d2-bb60-3bb1cbc1042a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:02.932672 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-bcaa0343-28cc-47d2-bb60-3bb1cbc1042a None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:02.933787 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-bcaa0343-28cc-47d2-bb60-3bb1cbc1042a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:02.986345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:03.027419 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:03.069712 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ae3b0-435e-40e2-a3ec-e53daf436c21 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:03.071311 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7c9ae3b0-435e-40e2-a3ec-e53daf436c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:03.214513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ae3b0-435e-40e2-a3ec-e53daf436c21 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:03.283720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:03.323060 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9ff52-78ab-4801-bbf9-1eeecf40f278 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:03.323698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9ff52-78ab-4801-bbf9-1eeecf40f278 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:03.323970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9ff52-78ab-4801-bbf9-1eeecf40f278 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:03.324237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9ff52-78ab-4801-bbf9-1eeecf40f278 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:03.325837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f3d9ff52-78ab-4801-bbf9-1eeecf40f278 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:03.410642 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9ff52-78ab-4801-bbf9-1eeecf40f278 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:03.412211 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9ff52-78ab-4801-bbf9-1eeecf40f278 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:03.430301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 712/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:04.330516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d93fa8-46b9-4f72-b460-2fd27103344c None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:04.331078 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d93fa8-46b9-4f72-b460-2fd27103344c None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:04.331176 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d93fa8-46b9-4f72-b460-2fd27103344c None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:04.332510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:04.337488 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7ba3d-c388-4ee2-9e33-291ff555e059 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:04.338278 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7ba3d-c388-4ee2-9e33-291ff555e059 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:04.338561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7ba3d-c388-4ee2-9e33-291ff555e059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:04.414332 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a7a7ba3d-c388-4ee2-9e33-291ff555e059 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:04.415543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a7a7ba3d-c388-4ee2-9e33-291ff555e059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:04.444173 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:04.513527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:04.661769 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d93fa8-46b9-4f72-b460-2fd27103344c None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:04.663255 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-97d93fa8-46b9-4f72-b460-2fd27103344c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:04.807537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d93fa8-46b9-4f72-b460-2fd27103344c None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:04.846622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:04.918596 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e788bfa-f09e-4c90-aa95-71919410104c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:04.919172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e788bfa-f09e-4c90-aa95-71919410104c service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:04.919454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e788bfa-f09e-4c90-aa95-71919410104c service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:04.919729 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e788bfa-f09e-4c90-aa95-71919410104c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:04.921361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-3e788bfa-f09e-4c90-aa95-71919410104c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:05.008381 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e788bfa-f09e-4c90-aa95-71919410104c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:05.009953 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e788bfa-f09e-4c90-aa95-71919410104c service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:05.027884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 706/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:05.904207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa65f4-6708-4d6f-9da9-1bf161c470c0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:05.904775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa65f4-6708-4d6f-9da9-1bf161c470c0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:05.904775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa65f4-6708-4d6f-9da9-1bf161c470c0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:05.906180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:05.911104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787cb04-b50b-46dc-9320-5db33ae08ac5 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:05.911529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787cb04-b50b-46dc-9320-5db33ae08ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:05.911650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787cb04-b50b-46dc-9320-5db33ae08ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:05.969067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:05.991205 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-d787cb04-b50b-46dc-9320-5db33ae08ac5 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:05.992412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d787cb04-b50b-46dc-9320-5db33ae08ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:06.087542 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:06.238733 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa65f4-6708-4d6f-9da9-1bf161c470c0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:06.240507 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0dfa65f4-6708-4d6f-9da9-1bf161c470c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:06.386650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa65f4-6708-4d6f-9da9-1bf161c470c0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:06.398517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:06.498746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3925b-c342-42b7-85ac-5b56b9d179da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:06.499334 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3925b-c342-42b7-85ac-5b56b9d179da service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:06.499615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3925b-c342-42b7-85ac-5b56b9d179da service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:06.499887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3925b-c342-42b7-85ac-5b56b9d179da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:06.501555 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9bf3925b-c342-42b7-85ac-5b56b9d179da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:06.589707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3925b-c342-42b7-85ac-5b56b9d179da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:06.591352 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3925b-c342-42b7-85ac-5b56b9d179da service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:06.609943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 715/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:07.462859 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c88a9-f114-4b5a-81b7-3ecd5e211233 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:07.463423 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c88a9-f114-4b5a-81b7-3ecd5e211233 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:07.463423 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c88a9-f114-4b5a-81b7-3ecd5e211233 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:07.464821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:07.470566 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcb65f-e47b-4ca1-a2cd-ad9919f84b14 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:07.470955 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcb65f-e47b-4ca1-a2cd-ad9919f84b14 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:07.471121 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcb65f-e47b-4ca1-a2cd-ad9919f84b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:07.491228 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:07.546692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5adcb65f-e47b-4ca1-a2cd-ad9919f84b14 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:07.548530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5adcb65f-e47b-4ca1-a2cd-ad9919f84b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:07.643079 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:07.791731 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c88a9-f114-4b5a-81b7-3ecd5e211233 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:07.793244 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-0a5c88a9-f114-4b5a-81b7-3ecd5e211233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:07.901586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:07.937692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c88a9-f114-4b5a-81b7-3ecd5e211233 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:08.048127 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a117b-fdfc-470c-a476-35a89a19c3bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:08.048710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a117b-fdfc-470c-a476-35a89a19c3bc service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:08.048990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a117b-fdfc-470c-a476-35a89a19c3bc service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:08.049263 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a117b-fdfc-470c-a476-35a89a19c3bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:08.051193 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-873a117b-fdfc-470c-a476-35a89a19c3bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:08.126277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:08.140213 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a117b-fdfc-470c-a476-35a89a19c3bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:08.141859 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a117b-fdfc-470c-a476-35a89a19c3bc service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:08.160098 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 709/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:09.021401 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0c6e5-02b2-4c0c-a6b7-a931553e9979 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:09.021943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0c6e5-02b2-4c0c-a6b7-a931553e9979 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:09.021943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0c6e5-02b2-4c0c-a6b7-a931553e9979 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:09.023365 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:09.028401 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5273f-2eca-4d37-9bbc-989e9c0c6c47 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:09.028853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5273f-2eca-4d37-9bbc-989e9c0c6c47 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:09.028969 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5273f-2eca-4d37-9bbc-989e9c0c6c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:09.105226 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-0ad5273f-2eca-4d37-9bbc-989e9c0c6c47 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:09.106463 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-0ad5273f-2eca-4d37-9bbc-989e9c0c6c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:09.202880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:09.351810 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0c6e5-02b2-4c0c-a6b7-a931553e9979 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:09.353578 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6fe0c6e5-02b2-4c0c-a6b7-a931553e9979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:09.437387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:09.499761 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0c6e5-02b2-4c0c-a6b7-a931553e9979 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:09.611393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2dbd8-5108-4282-95f6-acce57ce147f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:09.611975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2dbd8-5108-4282-95f6-acce57ce147f service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:09.612258 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2dbd8-5108-4282-95f6-acce57ce147f service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:09.612531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2dbd8-5108-4282-95f6-acce57ce147f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:09.614200 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bfe2dbd8-5108-4282-95f6-acce57ce147f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:09.660834 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:09.701079 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2dbd8-5108-4282-95f6-acce57ce147f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:09.702697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2dbd8-5108-4282-95f6-acce57ce147f service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:09.720482 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 718/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:10.525700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e631ff-8a5e-499f-8f58-b65fbc753166 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:10.526208 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e631ff-8a5e-499f-8f58-b65fbc753166 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:10.526316 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e631ff-8a5e-499f-8f58-b65fbc753166 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:10.527657 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:10.532473 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a72e51-bdfd-4d31-80db-3f6714bbe21d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:10.532931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a72e51-bdfd-4d31-80db-3f6714bbe21d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:10.533083 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a72e51-bdfd-4d31-80db-3f6714bbe21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:10.607761 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-60a72e51-bdfd-4d31-80db-3f6714bbe21d None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:10.608893 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-60a72e51-bdfd-4d31-80db-3f6714bbe21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:10.703394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:10.853953 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e631ff-8a5e-499f-8f58-b65fbc753166 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:10.855526 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-55e631ff-8a5e-499f-8f58-b65fbc753166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:10.904720 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:10.998765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e631ff-8a5e-499f-8f58-b65fbc753166 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:11.108868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ccc01-77cd-4421-9479-7f81c5f4704b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:11.109508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ccc01-77cd-4421-9479-7f81c5f4704b service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:11.109784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ccc01-77cd-4421-9479-7f81c5f4704b service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:11.110084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ccc01-77cd-4421-9479-7f81c5f4704b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:11.112337 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d27ccc01-77cd-4421-9479-7f81c5f4704b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:11.119069 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:11.199740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ccc01-77cd-4421-9479-7f81c5f4704b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:11.201272 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ccc01-77cd-4421-9479-7f81c5f4704b service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:11.219097 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 712/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:12.018059 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c5dee-ba04-4dad-81d4-441fc98e0003 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:12.018602 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c5dee-ba04-4dad-81d4-441fc98e0003 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:12.018727 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c5dee-ba04-4dad-81d4-441fc98e0003 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:12.020066 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:08:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:12.025028 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41b966-264f-4e7f-8594-90d63b9ca91f None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:12.025428 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41b966-264f-4e7f-8594-90d63b9ca91f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:12.025578 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41b966-264f-4e7f-8594-90d63b9ca91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:12.106696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-dd41b966-264f-4e7f-8594-90d63b9ca91f None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:12.108036 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-dd41b966-264f-4e7f-8594-90d63b9ca91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:12.185502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:12.216658 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:12.366915 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c5dee-ba04-4dad-81d4-441fc98e0003 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:12.368417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2b9c5dee-ba04-4dad-81d4-441fc98e0003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:12.386561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:12.514288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c5dee-ba04-4dad-81d4-441fc98e0003 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:12.598547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:12.626464 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676ad55-96f5-4a86-88e6-b50f31e64627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:12.627116 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676ad55-96f5-4a86-88e6-b50f31e64627 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:12.627398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676ad55-96f5-4a86-88e6-b50f31e64627 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:12.627672 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676ad55-96f5-4a86-88e6-b50f31e64627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:12.629336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6676ad55-96f5-4a86-88e6-b50f31e64627 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:12.715593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676ad55-96f5-4a86-88e6-b50f31e64627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:12.717184 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676ad55-96f5-4a86-88e6-b50f31e64627 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:12.735163 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 721/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:13.538845 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c89d2a-6567-4525-b7fa-7efd248da998 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:13.539391 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c89d2a-6567-4525-b7fa-7efd248da998 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:13.539391 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c89d2a-6567-4525-b7fa-7efd248da998 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:13.540776 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:13.545618 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c7d9f-eaaa-487b-be77-6e9708e2fd1d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:13.546024 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c7d9f-eaaa-487b-be77-6e9708e2fd1d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:13.546208 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c7d9f-eaaa-487b-be77-6e9708e2fd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:13.620392 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4d3c7d9f-eaaa-487b-be77-6e9708e2fd1d None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:13.621594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4d3c7d9f-eaaa-487b-be77-6e9708e2fd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:13.662329 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:13.717431 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:13.866904 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c89d2a-6567-4525-b7fa-7efd248da998 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:13.868445 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c3c89d2a-6567-4525-b7fa-7efd248da998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:14.012146 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c89d2a-6567-4525-b7fa-7efd248da998 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:14.065406 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:14.123669 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a005c38-fa61-4fbb-8c34-a621db68d55d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:14.124312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a005c38-fa61-4fbb-8c34-a621db68d55d service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:14.124590 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a005c38-fa61-4fbb-8c34-a621db68d55d service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:14.124861 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a005c38-fa61-4fbb-8c34-a621db68d55d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:14.126515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-3a005c38-fa61-4fbb-8c34-a621db68d55d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:14.212341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a005c38-fa61-4fbb-8c34-a621db68d55d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:14.213942 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a005c38-fa61-4fbb-8c34-a621db68d55d service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:14.232145 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 715/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:15.035495 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2afd53-4294-4b72-9426-b1ed9fde88e6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:15.036067 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2afd53-4294-4b72-9426-b1ed9fde88e6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:15.036067 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2afd53-4294-4b72-9426-b1ed9fde88e6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:15.037441 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:15.042506 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3ebc7-6ecd-4a5d-9dc8-68ad6161dbed None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:15.042889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3ebc7-6ecd-4a5d-9dc8-68ad6161dbed None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:15.043063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3ebc7-6ecd-4a5d-9dc8-68ad6161dbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:15.119015 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-b9d3ebc7-6ecd-4a5d-9dc8-68ad6161dbed None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:15.120208 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b9d3ebc7-6ecd-4a5d-9dc8-68ad6161dbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:15.122217 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:15.214508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:15.362629 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2afd53-4294-4b72-9426-b1ed9fde88e6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:15.364121 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0e2afd53-4294-4b72-9426-b1ed9fde88e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:15.509731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2afd53-4294-4b72-9426-b1ed9fde88e6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:15.539280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:15.626478 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd547a6e-cc14-4ea4-8e64-aaf19ddfd31a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:15.627054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd547a6e-cc14-4ea4-8e64-aaf19ddfd31a service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:15.627338 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd547a6e-cc14-4ea4-8e64-aaf19ddfd31a service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:15.627614 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd547a6e-cc14-4ea4-8e64-aaf19ddfd31a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:15.629251 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bd547a6e-cc14-4ea4-8e64-aaf19ddfd31a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:15.715826 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd547a6e-cc14-4ea4-8e64-aaf19ddfd31a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:15.717416 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd547a6e-cc14-4ea4-8e64-aaf19ddfd31a service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:15.735426 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 724/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:17.637484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acb53b-4006-483e-9da0-d09786da094e None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:17.638041 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acb53b-4006-483e-9da0-d09786da094e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:17.638161 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acb53b-4006-483e-9da0-d09786da094e None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:17.639468 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:17.645205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99522fd-58ad-4d22-821f-34acd8581a5f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:17.645586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99522fd-58ad-4d22-821f-34acd8581a5f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:17.645751 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99522fd-58ad-4d22-821f-34acd8581a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:17.686546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:17.712361 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b99522fd-58ad-4d22-821f-34acd8581a5f None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:17.713583 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b99522fd-58ad-4d22-821f-34acd8581a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:17.810229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:17.848988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acb53b-4006-483e-9da0-d09786da094e None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:17.850553 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-e0acb53b-4006-483e-9da0-d09786da094e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:17.955697 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acb53b-4006-483e-9da0-d09786da094e None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:17.986996 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:18.028141 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e9d9d-9f0d-4036-9b8a-4241ff3d7fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:18.028787 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e9d9d-9f0d-4036-9b8a-4241ff3d7fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:18.029069 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e9d9d-9f0d-4036-9b8a-4241ff3d7fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:18.029344 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e9d9d-9f0d-4036-9b8a-4241ff3d7fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:18.031018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-e96e9d9d-9f0d-4036-9b8a-4241ff3d7fb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:18.142882 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e9d9d-9f0d-4036-9b8a-4241ff3d7fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:18.144309 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e9d9d-9f0d-4036-9b8a-4241ff3d7fb8 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:18.162561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 718/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:20.285964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7a578-e987-492c-a01c-f4a44986aa1a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:20.286564 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7a578-e987-492c-a01c-f4a44986aa1a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:20.286564 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7a578-e987-492c-a01c-f4a44986aa1a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:20.287936 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:20.293330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316d2d7-5753-46ac-ae0b-3d88b2240036 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:20.293768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316d2d7-5753-46ac-ae0b-3d88b2240036 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:20.293912 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316d2d7-5753-46ac-ae0b-3d88b2240036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:20.358897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-8316d2d7-5753-46ac-ae0b-3d88b2240036 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:20.360111 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-8316d2d7-5753-46ac-ae0b-3d88b2240036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:20.373321 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:20.457646 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:20.495804 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7a578-e987-492c-a01c-f4a44986aa1a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:20.497300 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-76c7a578-e987-492c-a01c-f4a44986aa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:20.598943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7a578-e987-492c-a01c-f4a44986aa1a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:20.610582 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:20.675072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088856a4-3502-434a-8c27-e047ea9020fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:20.676285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088856a4-3502-434a-8c27-e047ea9020fa service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:20.676561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088856a4-3502-434a-8c27-e047ea9020fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:20.676830 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088856a4-3502-434a-8c27-e047ea9020fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:20.678492 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-088856a4-3502-434a-8c27-e047ea9020fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:20.785340 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088856a4-3502-434a-8c27-e047ea9020fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:20.786803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088856a4-3502-434a-8c27-e047ea9020fa service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:20.808822 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 727/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:23.085403 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0fb60-7f92-4377-9cde-fbfed29a0ad4 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:23.085965 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0fb60-7f92-4377-9cde-fbfed29a0ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:23.085965 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0fb60-7f92-4377-9cde-fbfed29a0ad4 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:23.087374 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:23.092628 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651672e-6843-45e8-a2c3-e866e1d54998 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:23.093040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651672e-6843-45e8-a2c3-e866e1d54998 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:23.093186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651672e-6843-45e8-a2c3-e866e1d54998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:23.140988 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:23.159290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1651672e-6843-45e8-a2c3-e866e1d54998 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:23.160489 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1651672e-6843-45e8-a2c3-e866e1d54998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:23.254848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:23.293191 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0fb60-7f92-4377-9cde-fbfed29a0ad4 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:23.294758 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-9cb0fb60-7f92-4377-9cde-fbfed29a0ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:23.396765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0fb60-7f92-4377-9cde-fbfed29a0ad4 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:23.436289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:23.471795 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99151ee6-ca0f-49bf-89ea-052595bf1a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:23.472528 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99151ee6-ca0f-49bf-89ea-052595bf1a2a service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:23.472842 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99151ee6-ca0f-49bf-89ea-052595bf1a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:23.473455 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99151ee6-ca0f-49bf-89ea-052595bf1a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:23.474831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-99151ee6-ca0f-49bf-89ea-052595bf1a2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:23.582688 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99151ee6-ca0f-49bf-89ea-052595bf1a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:23.584115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99151ee6-ca0f-49bf-89ea-052595bf1a2a service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:23.602832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 721/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:25.707371 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf7d6c-f714-41e5-934f-2960605080f9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:25.707927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf7d6c-f714-41e5-934f-2960605080f9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:25.707927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf7d6c-f714-41e5-934f-2960605080f9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:25.709291 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:25.714528 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f1c6e-2d24-498a-a062-56c3227ab236 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:25.714933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f1c6e-2d24-498a-a062-56c3227ab236 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:25.715113 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f1c6e-2d24-498a-a062-56c3227ab236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:25.779737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-227f1c6e-2d24-498a-a062-56c3227ab236 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:25.780858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-227f1c6e-2d24-498a-a062-56c3227ab236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:25.801286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:25.876120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:25.914379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf7d6c-f714-41e5-934f-2960605080f9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:25.915936 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bacf7d6c-f714-41e5-934f-2960605080f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:26.019091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf7d6c-f714-41e5-934f-2960605080f9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:26.038156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:26.091809 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e1be3-1afd-426d-9ec0-a4b1abcf1728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:26.092458 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e1be3-1afd-426d-9ec0-a4b1abcf1728 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:26.092742 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e1be3-1afd-426d-9ec0-a4b1abcf1728 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:26.093018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e1be3-1afd-426d-9ec0-a4b1abcf1728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:26.094697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e10e1be3-1afd-426d-9ec0-a4b1abcf1728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:26.205040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e1be3-1afd-426d-9ec0-a4b1abcf1728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:26.206518 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e1be3-1afd-426d-9ec0-a4b1abcf1728 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:26.224412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 730/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:28.228257 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349c1c0-549c-4325-b2be-6e240db68c42 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:28.228815 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349c1c0-549c-4325-b2be-6e240db68c42 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:28.228958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349c1c0-549c-4325-b2be-6e240db68c42 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:28.230595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:08:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:28.236046 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f756666-1f94-4986-bf42-5dff07c790c3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:28.236462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f756666-1f94-4986-bf42-5dff07c790c3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:28.236596 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f756666-1f94-4986-bf42-5dff07c790c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:28.299364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:28.302827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6f756666-1f94-4986-bf42-5dff07c790c3 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:28.304413 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6f756666-1f94-4986-bf42-5dff07c790c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:28.401750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:08:28.439275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349c1c0-549c-4325-b2be-6e240db68c42 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:28.440789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-3349c1c0-549c-4325-b2be-6e240db68c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:28.541929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349c1c0-549c-4325-b2be-6e240db68c42 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:28.589607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:28.613662 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae6da5-30ef-45e6-80a1-af1fd7b96472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:28.614328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae6da5-30ef-45e6-80a1-af1fd7b96472 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:28.614610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae6da5-30ef-45e6-80a1-af1fd7b96472 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:28.614886 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae6da5-30ef-45e6-80a1-af1fd7b96472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:28.616495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6fae6da5-30ef-45e6-80a1-af1fd7b96472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:28.723321 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae6da5-30ef-45e6-80a1-af1fd7b96472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:28.724737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae6da5-30ef-45e6-80a1-af1fd7b96472 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:28.743736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 724/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:30.761395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6b0ce-b537-403e-8dde-152f39a77ece None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:30.761920 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6b0ce-b537-403e-8dde-152f39a77ece None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:30.761920 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6b0ce-b537-403e-8dde-152f39a77ece None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:30.763428 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:30.768595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79db529-6109-46eb-8185-a1145a2b8aac None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:30.768999 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79db529-6109-46eb-8185-a1145a2b8aac None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:30.769149 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79db529-6109-46eb-8185-a1145a2b8aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:30.833949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-b79db529-6109-46eb-8185-a1145a2b8aac None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:30.835186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b79db529-6109-46eb-8185-a1145a2b8aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:30.864273 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:30.931168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:30.968889 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6b0ce-b537-403e-8dde-152f39a77ece None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:30.971379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c8a6b0ce-b537-403e-8dde-152f39a77ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:31.071882 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6b0ce-b537-403e-8dde-152f39a77ece None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:31.100459 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:31.145951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46c373-59ea-4cd3-be2e-721ee778ea9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:31.146660 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46c373-59ea-4cd3-be2e-721ee778ea9e service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:31.146970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46c373-59ea-4cd3-be2e-721ee778ea9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:31.147273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46c373-59ea-4cd3-be2e-721ee778ea9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:31.148935 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fd46c373-59ea-4cd3-be2e-721ee778ea9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:31.257789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46c373-59ea-4cd3-be2e-721ee778ea9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:31.259269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46c373-59ea-4cd3-be2e-721ee778ea9e service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:31.277680 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 733/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:33.302957 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782623ae-2c4d-4dc0-b79a-e1df1a4ed418 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:33.303529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782623ae-2c4d-4dc0-b79a-e1df1a4ed418 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:33.303633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782623ae-2c4d-4dc0-b79a-e1df1a4ed418 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:33.305016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:33.310200 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc0589-56cd-4e38-94c4-bc2cc88bc527 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:33.310627 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc0589-56cd-4e38-94c4-bc2cc88bc527 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:33.310742 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc0589-56cd-4e38-94c4-bc2cc88bc527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:33.374315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d3dc0589-56cd-4e38-94c4-bc2cc88bc527 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:33.375429 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d3dc0589-56cd-4e38-94c4-bc2cc88bc527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:33.383411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:33.470961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:33.507157 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782623ae-2c4d-4dc0-b79a-e1df1a4ed418 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:33.508695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-782623ae-2c4d-4dc0-b79a-e1df1a4ed418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:33.612829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782623ae-2c4d-4dc0-b79a-e1df1a4ed418 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:33.666917 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:33.685400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22dc8e-c37f-4334-9c26-7ec60de1c6ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:33.686082 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22dc8e-c37f-4334-9c26-7ec60de1c6ac service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:33.686366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22dc8e-c37f-4334-9c26-7ec60de1c6ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:33.686641 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22dc8e-c37f-4334-9c26-7ec60de1c6ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:33.688265 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ac22dc8e-c37f-4334-9c26-7ec60de1c6ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:33.795395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22dc8e-c37f-4334-9c26-7ec60de1c6ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:33.796819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22dc8e-c37f-4334-9c26-7ec60de1c6ac service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:33.815579 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 727/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:35.833668 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386dd1c9-b2aa-4335-8f14-dce9a398f0d7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:35.834292 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386dd1c9-b2aa-4335-8f14-dce9a398f0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:35.834398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386dd1c9-b2aa-4335-8f14-dce9a398f0d7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:35.835741 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:35.840979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42281d-af3a-49ad-8d62-9a0322692912 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:35.841409 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42281d-af3a-49ad-8d62-9a0322692912 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:35.841531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42281d-af3a-49ad-8d62-9a0322692912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:35.907135 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-ea42281d-af3a-49ad-8d62-9a0322692912 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:35.908328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ea42281d-af3a-49ad-8d62-9a0322692912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:35.945392 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:36.003054 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:36.040319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386dd1c9-b2aa-4335-8f14-dce9a398f0d7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:36.041846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-386dd1c9-b2aa-4335-8f14-dce9a398f0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:36.144285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386dd1c9-b2aa-4335-8f14-dce9a398f0d7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:36.180751 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:36.216656 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe735f49-5879-4d02-b7e3-0e7aac5aa286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:36.217301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe735f49-5879-4d02-b7e3-0e7aac5aa286 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:36.217579 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe735f49-5879-4d02-b7e3-0e7aac5aa286 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:36.217846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe735f49-5879-4d02-b7e3-0e7aac5aa286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:36.219485 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fe735f49-5879-4d02-b7e3-0e7aac5aa286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:36.325969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe735f49-5879-4d02-b7e3-0e7aac5aa286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:36.327456 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe735f49-5879-4d02-b7e3-0e7aac5aa286 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:36.346931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 736/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:38.401632 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0277e2-d7ac-467f-b10a-41df468bbe6e None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:38.402230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0277e2-d7ac-467f-b10a-41df468bbe6e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:38.402230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0277e2-d7ac-467f-b10a-41df468bbe6e None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:38.403612 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:38.408796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cbd4f-cecd-4609-a14e-085b6f2fa95e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:38.409788 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cbd4f-cecd-4609-a14e-085b6f2fa95e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:38.409986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cbd4f-cecd-4609-a14e-085b6f2fa95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:38.475529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e71cbd4f-cecd-4609-a14e-085b6f2fa95e None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:38.476753 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e71cbd4f-cecd-4609-a14e-085b6f2fa95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:38.494308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:38.571315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:38.608010 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0277e2-d7ac-467f-b10a-41df468bbe6e None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:38.609544 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-1b0277e2-d7ac-467f-b10a-41df468bbe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:38.713116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0277e2-d7ac-467f-b10a-41df468bbe6e None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:38.777872 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:38.785574 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d12129-6c7c-49ab-b373-a3f6dd09f1b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:38.786245 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d12129-6c7c-49ab-b373-a3f6dd09f1b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:38.786529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d12129-6c7c-49ab-b373-a3f6dd09f1b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:38.786803 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d12129-6c7c-49ab-b373-a3f6dd09f1b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:38.788418 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-44d12129-6c7c-49ab-b373-a3f6dd09f1b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:38.894703 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d12129-6c7c-49ab-b373-a3f6dd09f1b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:38.896058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d12129-6c7c-49ab-b373-a3f6dd09f1b6 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:38.914466 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 730/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:41.020650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c687ed4-ab3c-416f-9f52-faf01f32fcec None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:41.021228 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c687ed4-ab3c-416f-9f52-faf01f32fcec None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:41.021228 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c687ed4-ab3c-416f-9f52-faf01f32fcec None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:41.022632 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:08:41.028125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613f3b0-1964-4c1b-bf1a-a0d24dd413d2 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:41.028538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613f3b0-1964-4c1b-bf1a-a0d24dd413d2 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:41.028706 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613f3b0-1964-4c1b-bf1a-a0d24dd413d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:41.094812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-a613f3b0-1964-4c1b-bf1a-a0d24dd413d2 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:08:41.096019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a613f3b0-1964-4c1b-bf1a-a0d24dd413d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:41.146046 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:41.195679 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:08:41.232170 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c687ed4-ab3c-416f-9f52-faf01f32fcec None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:08:41.233757 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5c687ed4-ab3c-416f-9f52-faf01f32fcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:41.334315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c687ed4-ab3c-416f-9f52-faf01f32fcec None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:08:41.381089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:41.407063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18152382-4bb6-4d2e-8121-07d9fc1df8ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:08:41.407732 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18152382-4bb6-4d2e-8121-07d9fc1df8ea service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:08:41.407995 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18152382-4bb6-4d2e-8121-07d9fc1df8ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:08:41.408272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18152382-4bb6-4d2e-8121-07d9fc1df8ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:08:41.410567 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-18152382-4bb6-4d2e-8121-07d9fc1df8ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:08:41.517355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18152382-4bb6-4d2e-8121-07d9fc1df8ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:08:41.519340 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18152382-4bb6-4d2e-8121-07d9fc1df8ea service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:08:41.538013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 739/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:08:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:08:51.193453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=22 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:08:51.535704 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=66 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:09:00.879780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa449c-78a4-4d73-b9b8-c7ffb21bae3e None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:00.880311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa449c-78a4-4d73-b9b8-c7ffb21bae3e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:00.880311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa449c-78a4-4d73-b9b8-c7ffb21bae3e None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:00.881742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 732/1471] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:09:00.887063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9176f6-eac2-4ee6-851b-219c67c6bbd1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:00.887477 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9176f6-eac2-4ee6-851b-219c67c6bbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:00.887646 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9176f6-eac2-4ee6-851b-219c67c6bbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:00.953528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-af9176f6-eac2-4ee6-851b-219c67c6bbd1 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:09:00.954684 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-af9176f6-eac2-4ee6-851b-219c67c6bbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:01.050204 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 740/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:09:01.132787 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c97bf-da85-4a60-9e2c-03c3cf1558fc None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:01.133075 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c97bf-da85-4a60-9e2c-03c3cf1558fc None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:01.133353 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c97bf-da85-4a60-9e2c-03c3cf1558fc None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:01.134755 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 733/1473] 10.222.0.48 () {54 vars in 966 bytes} [Mon Jul 25 12:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:09:01.139692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e0b4a-1a75-4f2e-80c1-224ad69301dc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:01.139985 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e0b4a-1a75-4f2e-80c1-224ad69301dc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:01.140264 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e0b4a-1a75-4f2e-80c1-224ad69301dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:01.216276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1e7e0b4a-1a75-4f2e-80c1-224ad69301dc None None] MFA Rules not processed for user `cd52ff8138094d64bce9de60c819ab4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:09:01.217393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1e7e0b4a-1a75-4f2e-80c1-224ad69301dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:01.237810 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:09:01.292451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 741/1474] 10.222.0.48 () {58 vars in 1063 bytes} [Mon Jul 25 12:09:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:09:01.299994 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c97bf-da85-4a60-9e2c-03c3cf1558fc None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:09:01.301751 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-bd9c97bf-da85-4a60-9e2c-03c3cf1558fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:01.403739 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c97bf-da85-4a60-9e2c-03c3cf1558fc None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:09:01.476620 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525ddab-3bc1-46d7-8034-069b1eb99347 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52ff8138094d64bce9de60c819ab4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:09:01.477264 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525ddab-3bc1-46d7-8034-069b1eb99347 service glance] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:01.477543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525ddab-3bc1-46d7-8034-069b1eb99347 service glance] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:01.477815 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525ddab-3bc1-46d7-8034-069b1eb99347 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:01.479470 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-f525ddab-3bc1-46d7-8034-069b1eb99347 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:01.531864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:09:01.585659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525ddab-3bc1-46d7-8034-069b1eb99347 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:09:01.587111 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525ddab-3bc1-46d7-8034-069b1eb99347 service glance] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:09:01.605082 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 734/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:09:03.661679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a938e0-3035-448a-a5c4-e6ae9eb9ff8f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:03.662238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a938e0-3035-448a-a5c4-e6ae9eb9ff8f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:03.662238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a938e0-3035-448a-a5c4-e6ae9eb9ff8f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:03.663676 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 742/1476] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:09:03.668860 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0df9e6-444f-438d-af26-d7fd23f4b129 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:03.669236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0df9e6-444f-438d-af26-d7fd23f4b129 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:03.669408 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0df9e6-444f-438d-af26-d7fd23f4b129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:03.734117 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-6a0df9e6-444f-438d-af26-d7fd23f4b129 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:09:03.735325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6a0df9e6-444f-438d-af26-d7fd23f4b129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:03.830152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 735/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:09:03.853035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a938e0-3035-448a-a5c4-e6ae9eb9ff8f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:09:03.854576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d5a938e0-3035-448a-a5c4-e6ae9eb9ff8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:03.976856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a938e0-3035-448a-a5c4-e6ae9eb9ff8f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:09:04.024861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:09:04.070144 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7cfbe-766d-4b0b-9383-b8f1de12feb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:09:04.070797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7cfbe-766d-4b0b-9383-b8f1de12feb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:04.071074 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7cfbe-766d-4b0b-9383-b8f1de12feb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:04.071342 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7cfbe-766d-4b0b-9383-b8f1de12feb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:04.072054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7cfbe-766d-4b0b-9383-b8f1de12feb5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:09:04.073747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-56d7cfbe-766d-4b0b-9383-b8f1de12feb5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:09:04.073747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 25 12:09:04.073747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: Jul 25 12:09:04.074895 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7cfbe-766d-4b0b-9383-b8f1de12feb5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:09:04.093011 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 743/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Mon Jul 25 12:09:03 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:09:06.087293 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a159580-b5f8-4caf-9f96-802b83334d6e None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:06.087861 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a159580-b5f8-4caf-9f96-802b83334d6e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:06.087861 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a159580-b5f8-4caf-9f96-802b83334d6e None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:06.089222 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 736/1479] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:09:06.094538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320da39-eb80-4b0c-be47-6bdac3b0c358 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:06.094988 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320da39-eb80-4b0c-be47-6bdac3b0c358 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:06.095097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320da39-eb80-4b0c-be47-6bdac3b0c358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:06.159135 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6320da39-eb80-4b0c-be47-6bdac3b0c358 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:09:06.160321 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6320da39-eb80-4b0c-be47-6bdac3b0c358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:06.255309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 744/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:09:06.296879 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a159580-b5f8-4caf-9f96-802b83334d6e None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:09:06.298489 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-4a159580-b5f8-4caf-9f96-802b83334d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:06.308775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:09:06.443834 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a159580-b5f8-4caf-9f96-802b83334d6e None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:09:06.522775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:09:06.556137 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef658993-e314-491d-92e3-05087e629241 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:09:06.556775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef658993-e314-491d-92e3-05087e629241 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:06.557052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef658993-e314-491d-92e3-05087e629241 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:06.557319 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef658993-e314-491d-92e3-05087e629241 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:06.558959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ef658993-e314-491d-92e3-05087e629241 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:06.644345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef658993-e314-491d-92e3-05087e629241 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:09:06.645843 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef658993-e314-491d-92e3-05087e629241 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:09:06.663868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 737/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:09:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:09:08.805743 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618026e-ea98-4d17-a110-60ee4d7ba945 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:08.806371 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618026e-ea98-4d17-a110-60ee4d7ba945 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:08.806371 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618026e-ea98-4d17-a110-60ee4d7ba945 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:08.807701 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 745/1482] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:09:08.813185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c97540-5f67-448f-947b-183ada72d4a7 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:08.813588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c97540-5f67-448f-947b-183ada72d4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:08.813735 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c97540-5f67-448f-947b-183ada72d4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:08.878721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-71c97540-5f67-448f-947b-183ada72d4a7 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:09:08.879913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-71c97540-5f67-448f-947b-183ada72d4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:08.924177 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:09:08.973756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 738/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:09:09.009886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618026e-ea98-4d17-a110-60ee4d7ba945 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:09:09.011412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b618026e-ea98-4d17-a110-60ee4d7ba945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:09.037947 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:09:09.114303 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618026e-ea98-4d17-a110-60ee4d7ba945 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:09:09.185854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3682c-37e6-4bde-a528-bcb54e726840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:09:09.186527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3682c-37e6-4bde-a528-bcb54e726840 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:09.186809 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3682c-37e6-4bde-a528-bcb54e726840 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:09.187082 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3682c-37e6-4bde-a528-bcb54e726840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:09.188710 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fab3682c-37e6-4bde-a528-bcb54e726840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:09.261573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:09:09.295475 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3682c-37e6-4bde-a528-bcb54e726840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:09:09.296911 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3682c-37e6-4bde-a528-bcb54e726840 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:09:09.317532 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 746/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:09:11.336465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f685c51-4f28-4385-8af6-ff469ebb8012 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:11.337039 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f685c51-4f28-4385-8af6-ff469ebb8012 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:11.337039 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f685c51-4f28-4385-8af6-ff469ebb8012 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:11.338468 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 739/1485] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:09:11.343512 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d89c5-a9b0-4566-856f-94767968fb4f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:11.343947 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d89c5-a9b0-4566-856f-94767968fb4f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:11.344069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d89c5-a9b0-4566-856f-94767968fb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:11.411144 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-362d89c5-a9b0-4566-856f-94767968fb4f None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:09:11.412344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-362d89c5-a9b0-4566-856f-94767968fb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:11.505917 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 747/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:09:11.544307 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f685c51-4f28-4385-8af6-ff469ebb8012 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:09:11.545886 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5f685c51-4f28-4385-8af6-ff469ebb8012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:11.648362 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f685c51-4f28-4385-8af6-ff469ebb8012 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:09:11.719903 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:09:11.722379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227884b-d053-4862-92ca-51c01e62b7df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:09:11.723206 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227884b-d053-4862-92ca-51c01e62b7df service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:11.723771 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227884b-d053-4862-92ca-51c01e62b7df service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:11.724208 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227884b-d053-4862-92ca-51c01e62b7df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:11.725908 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6227884b-d053-4862-92ca-51c01e62b7df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:11.832900 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227884b-d053-4862-92ca-51c01e62b7df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:09:11.834401 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227884b-d053-4862-92ca-51c01e62b7df service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:09:11.852607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 740/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:09:13.910050 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38602c2d-8b60-4edf-a825-411637a90056 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:13.910605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38602c2d-8b60-4edf-a825-411637a90056 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:13.910605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38602c2d-8b60-4edf-a825-411637a90056 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:13.911903 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 748/1488] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:09:13.917038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fdfc8-7137-4a38-b092-ed4724ce2f8e None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:13.917522 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fdfc8-7137-4a38-b092-ed4724ce2f8e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:13.917626 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fdfc8-7137-4a38-b092-ed4724ce2f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:13.981594 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-892fdfc8-7137-4a38-b092-ed4724ce2f8e None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:09:13.982799 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-892fdfc8-7137-4a38-b092-ed4724ce2f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:14.033806 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:09:14.077248 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 741/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:09:14.117629 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38602c2d-8b60-4edf-a825-411637a90056 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:09:14.119169 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-38602c2d-8b60-4edf-a825-411637a90056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:14.155109 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:09:14.223407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38602c2d-8b60-4edf-a825-411637a90056 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:09:14.295475 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862e1eb-24da-4e3b-b689-ee3fec0e5544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:09:14.296121 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862e1eb-24da-4e3b-b689-ee3fec0e5544 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:14.296400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862e1eb-24da-4e3b-b689-ee3fec0e5544 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:14.296669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862e1eb-24da-4e3b-b689-ee3fec0e5544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:14.298430 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2862e1eb-24da-4e3b-b689-ee3fec0e5544 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:14.376827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:09:14.406184 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862e1eb-24da-4e3b-b689-ee3fec0e5544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:09:14.407614 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862e1eb-24da-4e3b-b689-ee3fec0e5544 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:09:14.426038 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 749/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:09:16.591881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b27b8-8bd9-44dd-92bc-4982ff8f0a73 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:16.592409 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b27b8-8bd9-44dd-92bc-4982ff8f0a73 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:16.592409 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b27b8-8bd9-44dd-92bc-4982ff8f0a73 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:16.593819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 742/1491] 10.222.0.48 () {54 vars in 926 bytes} [Mon Jul 25 12:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:09:16.599288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72aa9b-2f3d-4b6f-8ca6-791c7727c2f7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:16.599702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72aa9b-2f3d-4b6f-8ca6-791c7727c2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:16.599803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72aa9b-2f3d-4b6f-8ca6-791c7727c2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:16.665478 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ff72aa9b-2f3d-4b6f-8ca6-791c7727c2f7 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:09:16.666774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ff72aa9b-2f3d-4b6f-8ca6-791c7727c2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:16.762318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 750/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Mon Jul 25 12:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:09:16.802433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b27b8-8bd9-44dd-92bc-4982ff8f0a73 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:09:16.803956 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-218b27b8-8bd9-44dd-92bc-4982ff8f0a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:16.903712 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b27b8-8bd9-44dd-92bc-4982ff8f0a73 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:09:16.975209 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dca79-8a57-4659-ab6b-e518eda765fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:09:16.975841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dca79-8a57-4659-ab6b-e518eda765fd service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:09:16.976119 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dca79-8a57-4659-ab6b-e518eda765fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:09:16.976390 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dca79-8a57-4659-ab6b-e518eda765fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:09:16.977984 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-677dca79-8a57-4659-ab6b-e518eda765fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:09:16.986816 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:09:17.090135 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677dca79-8a57-4659-ab6b-e518eda765fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:09:17.091559 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677dca79-8a57-4659-ab6b-e518eda765fd service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:09:17.110070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 743/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:09:26.760414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=82 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:09:27.107882 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=50 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:10:50.173540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52062c2c-7d06-40ff-ae68-40ca32af2bfa None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:10:50.174092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52062c2c-7d06-40ff-ae68-40ca32af2bfa None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:10:50.174092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52062c2c-7d06-40ff-ae68-40ca32af2bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:10:50.248392 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-52062c2c-7d06-40ff-ae68-40ca32af2bfa None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:10:50.249596 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-52062c2c-7d06-40ff-ae68-40ca32af2bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:10:50.343742 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 751/1494] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:10:50.352356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68643d2-f1b0-4591-9312-48fdf1bd501c None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:10:50.352841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68643d2-f1b0-4591-9312-48fdf1bd501c None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:10:50.353001 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68643d2-f1b0-4591-9312-48fdf1bd501c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:10:50.427012 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-b68643d2-f1b0-4591-9312-48fdf1bd501c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:10:50.428156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b68643d2-f1b0-4591-9312-48fdf1bd501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:10:50.523235 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 744/1495] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:10:50.527835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52062c2c-7d06-40ff-ae68-40ca32af2bfa None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:10:50.529037 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-52062c2c-7d06-40ff-ae68-40ca32af2bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:10:50.540203 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52062c2c-7d06-40ff-ae68-40ca32af2bfa None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:10:50.600068 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:10:50.633201 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470fe91-804c-4dd4-816c-d38494b73aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:10:50.633863 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470fe91-804c-4dd4-816c-d38494b73aba admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:10:50.634180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470fe91-804c-4dd4-816c-d38494b73aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:10:50.634457 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470fe91-804c-4dd4-816c-d38494b73aba admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:10:50.635849 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470fe91-804c-4dd4-816c-d38494b73aba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:10:50.635849 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470fe91-804c-4dd4-816c-d38494b73aba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:10:50.636506 dv-cinder-797608-61-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-2470fe91-804c-4dd4-816c-d38494b73aba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:10:50.636506 dv-cinder-797608-61-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 25 12:10:50.636506 dv-cinder-797608-61-smb devstack@keystone.service[80316]: Jul 25 12:10:50.637390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470fe91-804c-4dd4-816c-d38494b73aba admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:10:50.657387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 752/1496] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:10:50.658698 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68643d2-f1b0-4591-9312-48fdf1bd501c None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:10:50.667946 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68643d2-f1b0-4591-9312-48fdf1bd501c None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:10:50.728519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:10:50.761563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37222eec-dad6-4a6a-8c81-086f608d613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:10:50.762253 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37222eec-dad6-4a6a-8c81-086f608d613a admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:10:50.762537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37222eec-dad6-4a6a-8c81-086f608d613a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:10:50.762810 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37222eec-dad6-4a6a-8c81-086f608d613a admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:10:50.763494 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37222eec-dad6-4a6a-8c81-086f608d613a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:10:50.765207 dv-cinder-797608-61-smb devstack@keystone.service[80317]: WARNING py.warnings [None req-37222eec-dad6-4a6a-8c81-086f608d613a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:10:50.765207 dv-cinder-797608-61-smb devstack@keystone.service[80317]: warnings.warn(msg) Jul 25 12:10:50.765207 dv-cinder-797608-61-smb devstack@keystone.service[80317]: Jul 25 12:10:50.766420 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37222eec-dad6-4a6a-8c81-086f608d613a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:10:50.822592 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 745/1497] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:10:50 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:10:50.827301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470fe91-804c-4dd4-816c-d38494b73aba admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:10:50.828815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2470fe91-804c-4dd4-816c-d38494b73aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:10:50.860717 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470fe91-804c-4dd4-816c-d38494b73aba admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:10:50.953762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ad031-9155-4b7b-8890-118f1c17eade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:10:50.954450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ad031-9155-4b7b-8890-118f1c17eade admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:10:50.954726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ad031-9155-4b7b-8890-118f1c17eade admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:10:50.954996 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ad031-9155-4b7b-8890-118f1c17eade admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:10:50.955671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ad031-9155-4b7b-8890-118f1c17eade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:10:50.956677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-b13ad031-9155-4b7b-8890-118f1c17eade admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:10:50.956677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 25 12:10:50.956677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: Jul 25 12:10:50.957875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ad031-9155-4b7b-8890-118f1c17eade admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:10:50.998719 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 753/1498] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:10:50 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:10:51.003014 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37222eec-dad6-4a6a-8c81-086f608d613a admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:10:51.005209 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-37222eec-dad6-4a6a-8c81-086f608d613a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:10:51.065880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37222eec-dad6-4a6a-8c81-086f608d613a admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:10:51.148583 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:10:51.162511 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612f636-1344-47b4-879a-3bc86e9ca8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:10:51.163201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612f636-1344-47b4-879a-3bc86e9ca8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:10:51.163481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612f636-1344-47b4-879a-3bc86e9ca8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:10:51.163751 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612f636-1344-47b4-879a-3bc86e9ca8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:10:51.164493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612f636-1344-47b4-879a-3bc86e9ca8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:10:51.165524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: WARNING py.warnings [None req-3612f636-1344-47b4-879a-3bc86e9ca8e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:10:51.165524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: warnings.warn(msg) Jul 25 12:10:51.165524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: Jul 25 12:10:51.166568 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612f636-1344-47b4-879a-3bc86e9ca8e3 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:10:51.181368 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 746/1499] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:10:51.185717 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ad031-9155-4b7b-8890-118f1c17eade admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:10:51.187292 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b13ad031-9155-4b7b-8890-118f1c17eade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:10:51.199949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ad031-9155-4b7b-8890-118f1c17eade admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:10:51.228249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:10:51.299491 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9f564-1297-4f13-87f6-1b5485ebe472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:10:51.300083 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9f564-1297-4f13-87f6-1b5485ebe472 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:10:51.300362 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9f564-1297-4f13-87f6-1b5485ebe472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:10:51.300637 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9f564-1297-4f13-87f6-1b5485ebe472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:10:51.301938 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9f564-1297-4f13-87f6-1b5485ebe472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:10:51.302977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-25a9f564-1297-4f13-87f6-1b5485ebe472 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:10:51.302977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 25 12:10:51.302977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: Jul 25 12:10:51.304115 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9f564-1297-4f13-87f6-1b5485ebe472 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:10:51.316125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 754/1500] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:10:51.320451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612f636-1344-47b4-879a-3bc86e9ca8e3 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:10:51.322017 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-3612f636-1344-47b4-879a-3bc86e9ca8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:10:51.354498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612f636-1344-47b4-879a-3bc86e9ca8e3 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:10:51.446388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b050fd7-47a9-441a-a5c9-b69dc30b8c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:10:51.447271 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b050fd7-47a9-441a-a5c9-b69dc30b8c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:10:51.447551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b050fd7-47a9-441a-a5c9-b69dc30b8c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:10:51.447824 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b050fd7-47a9-441a-a5c9-b69dc30b8c7c admin admin] PATH_INFO: `/v3/projects/0b7d586009444943980e0b334938a599/users/7497cf9131984bd684b5589cdea81799/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:10:51.469920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b050fd7-47a9-441a-a5c9-b69dc30b8c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7d586009444943980e0b334938a599, user_id=7497cf9131984bd684b5589cdea81799, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:10:51.470938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: WARNING py.warnings [None req-2b050fd7-47a9-441a-a5c9-b69dc30b8c7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:10:51.470938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: warnings.warn(msg) Jul 25 12:10:51.470938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: Jul 25 12:10:51.473362 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b050fd7-47a9-441a-a5c9-b69dc30b8c7c admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:10:51.498139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 747/1501] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:10:51 2022] PUT /identity/v3/projects/0b7d586009444943980e0b334938a599/users/7497cf9131984bd684b5589cdea81799/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:10:51.510099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45db4-3f68-40ac-9bb7-e006edca40cd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:10:51.510393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45db4-3f68-40ac-9bb7-e006edca40cd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:10:51.510697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45db4-3f68-40ac-9bb7-e006edca40cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:10:51.566997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b7a45db4-3f68-40ac-9bb7-e006edca40cd None None] MFA Rules not processed for user `7497cf9131984bd684b5589cdea81799`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:10:51.568115 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b7a45db4-3f68-40ac-9bb7-e006edca40cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:10:51.643263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 755/1502] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:10:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:10:51.656829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27c9b5-cf5f-4c95-815c-d0e43e7e7a14 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:10:51.657118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27c9b5-cf5f-4c95-815c-d0e43e7e7a14 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:10:51.657398 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27c9b5-cf5f-4c95-815c-d0e43e7e7a14 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:10:51.658803 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 748/1503] 10.222.0.48 () {54 vars in 964 bytes} [Mon Jul 25 12:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:10:51.664110 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889ef0f-9c4f-474f-9284-9534cf2f8ccc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:10:51.664392 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889ef0f-9c4f-474f-9284-9534cf2f8ccc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:10:51.664662 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889ef0f-9c4f-474f-9284-9534cf2f8ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:10:51.695021 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:10:51.740367 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2889ef0f-9c4f-474f-9284-9534cf2f8ccc None None] MFA Rules not processed for user `f014af35de5c47ab86ec02ebed360678`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:10:51.741578 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2889ef0f-9c4f-474f-9284-9534cf2f8ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:10:51.815566 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 756/1504] 10.222.0.48 () {58 vars in 1061 bytes} [Mon Jul 25 12:10:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:10:51.823504 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27c9b5-cf5f-4c95-815c-d0e43e7e7a14 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:10:51.824954 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-cf27c9b5-cf5f-4c95-815c-d0e43e7e7a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:10:51.875002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:10:51.929410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27c9b5-cf5f-4c95-815c-d0e43e7e7a14 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:10:52.000513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0b520-b02f-4411-9b70-2cb8197320ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:10:52.001137 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0b520-b02f-4411-9b70-2cb8197320ed service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:10:52.001419 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0b520-b02f-4411-9b70-2cb8197320ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:10:52.001700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0b520-b02f-4411-9b70-2cb8197320ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:10:52.003348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-fdd0b520-b02f-4411-9b70-2cb8197320ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:10:52.101078 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0b520-b02f-4411-9b70-2cb8197320ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:10:52.102464 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0b520-b02f-4411-9b70-2cb8197320ed service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:10:52.105945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:10:52.120997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 749/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:10:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:10:52.166696 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbebe99-91b5-416d-9a35-598bb2be96d0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:10:52.166991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbebe99-91b5-416d-9a35-598bb2be96d0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:10:52.167264 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbebe99-91b5-416d-9a35-598bb2be96d0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:10:52.168562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 757/1506] 10.222.0.48 () {52 vars in 830 bytes} [Mon Jul 25 12:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:10:52.172114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0b520-b02f-4411-9b70-2cb8197320ed service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:10:52.173325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-fdd0b520-b02f-4411-9b70-2cb8197320ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:10:52.271290 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0b520-b02f-4411-9b70-2cb8197320ed service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:10:52.363070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12173ad3-2635-47fc-8dbf-5de6e78e6b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:10:52.364364 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12173ad3-2635-47fc-8dbf-5de6e78e6b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:10:52.364645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12173ad3-2635-47fc-8dbf-5de6e78e6b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:10:52.364919 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12173ad3-2635-47fc-8dbf-5de6e78e6b43 admin admin] PATH_INFO: `/v3/users/7497cf9131984bd684b5589cdea81799` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:10:52.377134 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12173ad3-2635-47fc-8dbf-5de6e78e6b43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7497cf9131984bd684b5589cdea81799)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:10:52.378188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: WARNING py.warnings [None req-12173ad3-2635-47fc-8dbf-5de6e78e6b43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:10:52.378188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: warnings.warn(msg) Jul 25 12:10:52.378188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: Jul 25 12:10:52.380015 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12173ad3-2635-47fc-8dbf-5de6e78e6b43 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:10:52.389673 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:10:52.443558 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-12173ad3-2635-47fc-8dbf-5de6e78e6b43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7497cf9131984bd684b5589cdea81799'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:10:52.444044 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-12173ad3-2635-47fc-8dbf-5de6e78e6b43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7497cf9131984bd684b5589cdea81799'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:10:52.444574 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-12173ad3-2635-47fc-8dbf-5de6e78e6b43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7497cf9131984bd684b5589cdea81799'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:10:52.462533 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-12173ad3-2635-47fc-8dbf-5de6e78e6b43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7497cf9131984bd684b5589cdea81799'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:10:52.474701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-12173ad3-2635-47fc-8dbf-5de6e78e6b43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7497cf9131984bd684b5589cdea81799'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:10:52.489089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 750/1507] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:10:52 2022] DELETE /identity/v3/users/7497cf9131984bd684b5589cdea81799 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:10:52.493522 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b40dad-f907-4fda-9623-75fda692746a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:10:52.493980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b40dad-f907-4fda-9623-75fda692746a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:10:52.494129 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b40dad-f907-4fda-9623-75fda692746a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:10:52.548808 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-77b40dad-f907-4fda-9623-75fda692746a None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:10:52.550017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-77b40dad-f907-4fda-9623-75fda692746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:10:52.623833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:10:52.637864 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 758/1508] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:10:52.648237 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12173ad3-2635-47fc-8dbf-5de6e78e6b43 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:10:52.649459 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-12173ad3-2635-47fc-8dbf-5de6e78e6b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:10:52.747899 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12173ad3-2635-47fc-8dbf-5de6e78e6b43 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:10:52.804161 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:10:52.825146 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a2c4f-c4f0-4f1e-a002-7e1dd166256f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:10:52.825793 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a2c4f-c4f0-4f1e-a002-7e1dd166256f service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:10:52.826267 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a2c4f-c4f0-4f1e-a002-7e1dd166256f service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:10:52.826547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a2c4f-c4f0-4f1e-a002-7e1dd166256f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:10:52.828213 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-117a2c4f-c4f0-4f1e-a002-7e1dd166256f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:10:52.933935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a2c4f-c4f0-4f1e-a002-7e1dd166256f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:10:52.935324 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a2c4f-c4f0-4f1e-a002-7e1dd166256f service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:10:52.953286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 751/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:10:53.297075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b40dad-f907-4fda-9623-75fda692746a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:10:53.298350 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-77b40dad-f907-4fda-9623-75fda692746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:10:53.309965 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b40dad-f907-4fda-9623-75fda692746a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:10:53.407547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe81c3d-ad51-49b4-b88d-8d98ba1a9cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:10:53.408396 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe81c3d-ad51-49b4-b88d-8d98ba1a9cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:10:53.408675 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe81c3d-ad51-49b4-b88d-8d98ba1a9cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:10:53.408941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe81c3d-ad51-49b4-b88d-8d98ba1a9cd6 admin admin] PATH_INFO: `/v3/projects/0b7d586009444943980e0b334938a599` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:10:53.419274 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe81c3d-ad51-49b4-b88d-8d98ba1a9cd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b7d586009444943980e0b334938a599)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:10:53.420303 dv-cinder-797608-61-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-bbe81c3d-ad51-49b4-b88d-8d98ba1a9cd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:10:53.420303 dv-cinder-797608-61-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 25 12:10:53.420303 dv-cinder-797608-61-smb devstack@keystone.service[80316]: Jul 25 12:10:53.421487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe81c3d-ad51-49b4-b88d-8d98ba1a9cd6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:10:53.478847 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bbe81c3d-ad51-49b4-b88d-8d98ba1a9cd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b7d586009444943980e0b334938a599', 'request_id': 'req-bbe81c3d-ad51-49b4-b88d-8d98ba1a9cd6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:10:53.485112 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bbe81c3d-ad51-49b4-b88d-8d98ba1a9cd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b7d586009444943980e0b334938a599', 'request_id': 'req-bbe81c3d-ad51-49b4-b88d-8d98ba1a9cd6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:10:53.500732 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bbe81c3d-ad51-49b4-b88d-8d98ba1a9cd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b7d586009444943980e0b334938a599', 'request_id': 'req-bbe81c3d-ad51-49b4-b88d-8d98ba1a9cd6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:10:53.528022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bbe81c3d-ad51-49b4-b88d-8d98ba1a9cd6 admin admin] The token cache is being invalidate because project 0b7d586009444943980e0b334938a599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:10:53.528317 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bbe81c3d-ad51-49b4-b88d-8d98ba1a9cd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:10:53.528828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bbe81c3d-ad51-49b4-b88d-8d98ba1a9cd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:10:53.530233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 759/1510] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:10:53 2022] DELETE /identity/v3/projects/0b7d586009444943980e0b334938a599 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:11:02.951030 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=62 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:11:03.525991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:12:40.998373 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e7826-6dfc-4dd3-baab-a2ccf6988823 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:40.998971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e7826-6dfc-4dd3-baab-a2ccf6988823 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:40.998971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e7826-6dfc-4dd3-baab-a2ccf6988823 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:41.000399 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:12:41.005786 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732f71a-0493-4669-a5d2-d055fb2fc0b4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:41.006242 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732f71a-0493-4669-a5d2-d055fb2fc0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:41.006369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732f71a-0493-4669-a5d2-d055fb2fc0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:41.087098 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5732f71a-0493-4669-a5d2-d055fb2fc0b4 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:12:41.088291 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5732f71a-0493-4669-a5d2-d055fb2fc0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:12:41.190044 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:12:41.345433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e7826-6dfc-4dd3-baab-a2ccf6988823 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:12:41.347526 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-016e7826-6dfc-4dd3-baab-a2ccf6988823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:12:41.464343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e7826-6dfc-4dd3-baab-a2ccf6988823 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:12:41.470035 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57cc68-407a-4cc6-9d8e-390d6cccf0f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:12:41.470614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57cc68-407a-4cc6-9d8e-390d6cccf0f4 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:41.470895 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57cc68-407a-4cc6-9d8e-390d6cccf0f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:41.471175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57cc68-407a-4cc6-9d8e-390d6cccf0f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:41.479931 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57cc68-407a-4cc6-9d8e-390d6cccf0f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:12:41.481507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57cc68-407a-4cc6-9d8e-390d6cccf0f4 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:12:41.491492 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 753/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:12:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:12:42.325912 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0682f37-767b-4140-939f-1fe09be51bca None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:42.326484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0682f37-767b-4140-939f-1fe09be51bca None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:42.326484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0682f37-767b-4140-939f-1fe09be51bca None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:42.327939 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:12:42.333502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d71ff-59e5-432e-bb5c-44f6bd52a090 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:42.333951 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d71ff-59e5-432e-bb5c-44f6bd52a090 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:42.334085 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d71ff-59e5-432e-bb5c-44f6bd52a090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:42.352985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-5b6d71ff-59e5-432e-bb5c-44f6bd52a090 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:12:42.354210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5b6d71ff-59e5-432e-bb5c-44f6bd52a090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:12:42.362648 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:12:42.515824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0682f37-767b-4140-939f-1fe09be51bca None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:12:42.530649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0682f37-767b-4140-939f-1fe09be51bca None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:12:42.536206 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120aa05a-ce1b-4072-a994-7a1cd595ce1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:12:42.536845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120aa05a-ce1b-4072-a994-7a1cd595ce1c service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:42.537122 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120aa05a-ce1b-4072-a994-7a1cd595ce1c service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:42.537396 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120aa05a-ce1b-4072-a994-7a1cd595ce1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:42.545551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120aa05a-ce1b-4072-a994-7a1cd595ce1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:12:42.547162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120aa05a-ce1b-4072-a994-7a1cd595ce1c service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:12:42.557180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 762/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:12:42.914863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250e6fd-eb6b-43d4-8268-3f61dddc9780 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:42.915081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250e6fd-eb6b-43d4-8268-3f61dddc9780 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:42.915330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250e6fd-eb6b-43d4-8268-3f61dddc9780 None None] PATH_INFO: `/v3` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:42.916654 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 755/1517] 10.222.0.27 () {54 vars in 925 bytes} [Mon Jul 25 12:12:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:12:42.949096 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992e66d-2000-4c13-b1ed-a9dd3770cd4a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:42.949385 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992e66d-2000-4c13-b1ed-a9dd3770cd4a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:42.949683 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992e66d-2000-4c13-b1ed-a9dd3770cd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:43.007786 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e992e66d-2000-4c13-b1ed-a9dd3770cd4a None None] MFA Rules not processed for user `40f748b0f6b1433c87012793f0dda307`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:12:43.008987 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e992e66d-2000-4c13-b1ed-a9dd3770cd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:12:43.025334 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:12:43.080181 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 763/1518] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Jul 25 12:12:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:12:46.904242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95baf93-5b7c-4f65-95bc-50e29da411d4 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:46.904787 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95baf93-5b7c-4f65-95bc-50e29da411d4 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:46.904787 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95baf93-5b7c-4f65-95bc-50e29da411d4 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:46.906168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 756/1519] 10.222.0.48 () {54 vars in 961 bytes} [Mon Jul 25 12:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:12:46.911570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3a894-7917-49ec-8101-cf4402001916 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:46.911997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3a894-7917-49ec-8101-cf4402001916 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:46.912117 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3a894-7917-49ec-8101-cf4402001916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:46.932213 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a8b3a894-7917-49ec-8101-cf4402001916 None None] MFA Rules not processed for user `40f748b0f6b1433c87012793f0dda307`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:12:46.933396 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a8b3a894-7917-49ec-8101-cf4402001916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:12:46.941753 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 764/1520] 10.222.0.48 () {58 vars in 1058 bytes} [Mon Jul 25 12:12:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:12:46.948877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95baf93-5b7c-4f65-95bc-50e29da411d4 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:12:46.961786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95baf93-5b7c-4f65-95bc-50e29da411d4 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:12:46.966672 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea4940-9c95-4c27-ada0-c2573c4e32f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f748b0f6b1433c87012793f0dda307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:12:46.967233 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea4940-9c95-4c27-ada0-c2573c4e32f7 service placement] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:46.967513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea4940-9c95-4c27-ada0-c2573c4e32f7 service placement] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:46.967784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea4940-9c95-4c27-ada0-c2573c4e32f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:46.976398 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea4940-9c95-4c27-ada0-c2573c4e32f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:12:46.977949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea4940-9c95-4c27-ada0-c2573c4e32f7 service placement] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:12:46.987277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 757/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:12:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:12:53.777956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a682d8a-6a58-4452-a638-94fdda5d23b3 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:53.778531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a682d8a-6a58-4452-a638-94fdda5d23b3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:53.778635 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a682d8a-6a58-4452-a638-94fdda5d23b3 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:53.779974 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:12:53.786393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0a7f1-3463-4cbb-9d93-7882a8fa0cfc None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:53.786819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0a7f1-3463-4cbb-9d93-7882a8fa0cfc None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:53.786950 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0a7f1-3463-4cbb-9d93-7882a8fa0cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:53.807141 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-c4c0a7f1-3463-4cbb-9d93-7882a8fa0cfc None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:12:53.808339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c4c0a7f1-3463-4cbb-9d93-7882a8fa0cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:12:53.816155 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:12:53.969751 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a682d8a-6a58-4452-a638-94fdda5d23b3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:12:53.984456 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a682d8a-6a58-4452-a638-94fdda5d23b3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:12:53.989797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf674ac-985e-4a46-97a2-b2fce5822daf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:12:53.990467 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf674ac-985e-4a46-97a2-b2fce5822daf service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:53.990743 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf674ac-985e-4a46-97a2-b2fce5822daf service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:53.991015 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf674ac-985e-4a46-97a2-b2fce5822daf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:53.998919 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf674ac-985e-4a46-97a2-b2fce5822daf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:12:54.000502 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf674ac-985e-4a46-97a2-b2fce5822daf service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:12:54.009598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 766/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:12:54.823759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead0c9e-e5a2-45a0-ba94-c0cc944cfed5 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:54.824322 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead0c9e-e5a2-45a0-ba94-c0cc944cfed5 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:54.824322 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead0c9e-e5a2-45a0-ba94-c0cc944cfed5 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:54.825686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:12:54.830540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8d4c7-d6b1-4345-8983-7c0dae0c99d8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:54.830947 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8d4c7-d6b1-4345-8983-7c0dae0c99d8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:54.831085 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8d4c7-d6b1-4345-8983-7c0dae0c99d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:54.849764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f9f8d4c7-d6b1-4345-8983-7c0dae0c99d8 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:12:54.850968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f9f8d4c7-d6b1-4345-8983-7c0dae0c99d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:12:54.858671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:12:55.008430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead0c9e-e5a2-45a0-ba94-c0cc944cfed5 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:12:55.022755 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead0c9e-e5a2-45a0-ba94-c0cc944cfed5 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:12:55.028167 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdb774-45bc-48ab-a585-7d6226f05854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:12:55.028798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdb774-45bc-48ab-a585-7d6226f05854 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:55.029080 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdb774-45bc-48ab-a585-7d6226f05854 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:55.029358 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdb774-45bc-48ab-a585-7d6226f05854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:55.037400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdb774-45bc-48ab-a585-7d6226f05854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:12:55.039030 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdb774-45bc-48ab-a585-7d6226f05854 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:12:55.048353 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 760/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:12:59.011630 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc9b1d-ed8a-4725-90b5-b75d8f184434 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:59.012182 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc9b1d-ed8a-4725-90b5-b75d8f184434 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:59.012182 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc9b1d-ed8a-4725-90b5-b75d8f184434 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:59.013579 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:12:59.018813 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17d2b3-2218-4352-a718-36e60fa22a7f None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:59.019243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17d2b3-2218-4352-a718-36e60fa22a7f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:59.019354 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17d2b3-2218-4352-a718-36e60fa22a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:59.038235 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-6c17d2b3-2218-4352-a718-36e60fa22a7f None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:12:59.039423 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6c17d2b3-2218-4352-a718-36e60fa22a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:12:59.047179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:12:59.120678 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc9b1d-ed8a-4725-90b5-b75d8f184434 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:12:59.122433 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c6bc9b1d-ed8a-4725-90b5-b75d8f184434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:12:59.199502 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc9b1d-ed8a-4725-90b5-b75d8f184434 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:12:59.202996 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdffa15-013a-4bdd-8db8-a836f87fcd7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:12:59.203626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdffa15-013a-4bdd-8db8-a836f87fcd7c service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:12:59.203904 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdffa15-013a-4bdd-8db8-a836f87fcd7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:12:59.204174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdffa15-013a-4bdd-8db8-a836f87fcd7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:12:59.213322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdffa15-013a-4bdd-8db8-a836f87fcd7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:12:59.214803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdffa15-013a-4bdd-8db8-a836f87fcd7c service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:12:59.224538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 769/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:13:01.191563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb833e-76ff-4960-9826-8837652e718e None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:13:01.192768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb833e-76ff-4960-9826-8837652e718e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:13:01.192768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb833e-76ff-4960-9826-8837652e718e None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:13:01.194051 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:13:01.199371 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd38d8-2c84-4e2f-8afa-84798c415853 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:13:01.199762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd38d8-2c84-4e2f-8afa-84798c415853 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:13:01.199943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd38d8-2c84-4e2f-8afa-84798c415853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:13:01.219737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-97cd38d8-2c84-4e2f-8afa-84798c415853 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:13:01.220912 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-97cd38d8-2c84-4e2f-8afa-84798c415853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:13:01.228995 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:13:01.265316 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb833e-76ff-4960-9826-8837652e718e None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:13:01.267021 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-0cfb833e-76ff-4960-9826-8837652e718e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:13:01.279833 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb833e-76ff-4960-9826-8837652e718e None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:13:01.283311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5c9f0-0907-4fcd-9e68-163c17d6078a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:13:01.283936 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5c9f0-0907-4fcd-9e68-163c17d6078a service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:13:01.284216 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5c9f0-0907-4fcd-9e68-163c17d6078a service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:13:01.284490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5c9f0-0907-4fcd-9e68-163c17d6078a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:13:01.295495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5c9f0-0907-4fcd-9e68-163c17d6078a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:13:01.296936 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5c9f0-0907-4fcd-9e68-163c17d6078a service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:13:01.307162 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 763/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:13:04.868047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a4843-8806-4a4a-a96b-da69e8dc6170 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:13:04.868607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a4843-8806-4a4a-a96b-da69e8dc6170 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:13:04.868607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a4843-8806-4a4a-a96b-da69e8dc6170 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:13:04.869957 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:13:04.875161 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1632cc-d63f-4a50-a898-2548dd19050b None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:13:04.875620 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1632cc-d63f-4a50-a898-2548dd19050b None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:13:04.875722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1632cc-d63f-4a50-a898-2548dd19050b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:13:04.883343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=81 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:13:04.896603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-cb1632cc-d63f-4a50-a898-2548dd19050b None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:13:04.897799 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-cb1632cc-d63f-4a50-a898-2548dd19050b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:13:04.905585 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:13:05.204271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a4843-8806-4a4a-a96b-da69e8dc6170 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:13:05.206031 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3d1a4843-8806-4a4a-a96b-da69e8dc6170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:13:05.269402 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:13:05.283447 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a4843-8806-4a4a-a96b-da69e8dc6170 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:13:05.287040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e301f7e-0446-4789-90a8-bd35d4707325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:13:05.287671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e301f7e-0446-4789-90a8-bd35d4707325 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:13:05.287948 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e301f7e-0446-4789-90a8-bd35d4707325 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:13:05.288219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e301f7e-0446-4789-90a8-bd35d4707325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:13:05.297283 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e301f7e-0446-4789-90a8-bd35d4707325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:13:05.298761 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e301f7e-0446-4789-90a8-bd35d4707325 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:13:05.308421 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 772/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:13:07.295398 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d046c4-0c3e-4c77-ab85-b04611fa7932 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:13:07.295979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d046c4-0c3e-4c77-ab85-b04611fa7932 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:13:07.295979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d046c4-0c3e-4c77-ab85-b04611fa7932 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:13:07.297363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:13:07.303127 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84269308-2a8b-4724-a9b9-ed736cb06e55 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:13:07.303543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84269308-2a8b-4724-a9b9-ed736cb06e55 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:13:07.303683 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84269308-2a8b-4724-a9b9-ed736cb06e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:13:07.323656 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-84269308-2a8b-4724-a9b9-ed736cb06e55 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:13:07.324841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-84269308-2a8b-4724-a9b9-ed736cb06e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:13:07.332555 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:13:07.630573 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d046c4-0c3e-4c77-ab85-b04611fa7932 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:13:07.632291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-e5d046c4-0c3e-4c77-ab85-b04611fa7932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:13:07.645132 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d046c4-0c3e-4c77-ab85-b04611fa7932 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:13:07.648668 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbee46e-2053-4b07-acd9-9f60ec1ea31d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:13:07.649299 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbee46e-2053-4b07-acd9-9f60ec1ea31d service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:13:07.649580 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbee46e-2053-4b07-acd9-9f60ec1ea31d service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:13:07.649852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbee46e-2053-4b07-acd9-9f60ec1ea31d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:13:07.658895 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbee46e-2053-4b07-acd9-9f60ec1ea31d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:13:07.660311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbee46e-2053-4b07-acd9-9f60ec1ea31d service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:13:07.670245 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 766/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:13:17.319002 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=11 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:13:17.666073 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=8 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:42.573386 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d91e81-af40-4e94-a23f-95287ec12a52 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:42.574048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d91e81-af40-4e94-a23f-95287ec12a52 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:42.574048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d91e81-af40-4e94-a23f-95287ec12a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:42.605312 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-78d91e81-af40-4e94-a23f-95287ec12a52 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:42.610877 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-78d91e81-af40-4e94-a23f-95287ec12a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:42.622790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 774/1540] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:14:42.631910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166f937-cb00-403d-8485-281a090dff14 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:42.632942 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166f937-cb00-403d-8485-281a090dff14 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:42.633596 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166f937-cb00-403d-8485-281a090dff14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:42.661257 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-f166f937-cb00-403d-8485-281a090dff14 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:42.662918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-f166f937-cb00-403d-8485-281a090dff14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:42.672105 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 767/1541] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:42.677279 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d91e81-af40-4e94-a23f-95287ec12a52 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:42.692938 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d91e81-af40-4e94-a23f-95287ec12a52 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:42.702721 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad8295-7f39-4574-b5f4-00475287e719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:42.703584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad8295-7f39-4574-b5f4-00475287e719 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:42.703874 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad8295-7f39-4574-b5f4-00475287e719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:42.704143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad8295-7f39-4574-b5f4-00475287e719 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:42.704888 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad8295-7f39-4574-b5f4-00475287e719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:14:42.705193 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad8295-7f39-4574-b5f4-00475287e719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:42.706884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad8295-7f39-4574-b5f4-00475287e719 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:42.728518 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 775/1542] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:14:42.736943 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166f937-cb00-403d-8485-281a090dff14 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:42.751582 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166f937-cb00-403d-8485-281a090dff14 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:42.757059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01545833-39f9-4d23-bd44-11ed1175e8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:42.758173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01545833-39f9-4d23-bd44-11ed1175e8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:42.758732 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01545833-39f9-4d23-bd44-11ed1175e8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:42.759247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01545833-39f9-4d23-bd44-11ed1175e8c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:42.760151 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01545833-39f9-4d23-bd44-11ed1175e8c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:42.762315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01545833-39f9-4d23-bd44-11ed1175e8c6 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:42.815382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 768/1543] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:14:42 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:42.819451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad8295-7f39-4574-b5f4-00475287e719 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:42.835852 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad8295-7f39-4574-b5f4-00475287e719 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:42.879385 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb00534-8100-4178-ad27-4b30cdeaf42a None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:42.880035 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb00534-8100-4178-ad27-4b30cdeaf42a None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:42.880651 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb00534-8100-4178-ad27-4b30cdeaf42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:42.906709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-1fb00534-8100-4178-ad27-4b30cdeaf42a None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:42.908318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-1fb00534-8100-4178-ad27-4b30cdeaf42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:42.934170 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35747a46-8876-4a96-83dc-f0023f6ebc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:42.934738 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35747a46-8876-4a96-83dc-f0023f6ebc2d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:42.935024 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35747a46-8876-4a96-83dc-f0023f6ebc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:42.935301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35747a46-8876-4a96-83dc-f0023f6ebc2d admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:42.936012 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35747a46-8876-4a96-83dc-f0023f6ebc2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:42.937953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35747a46-8876-4a96-83dc-f0023f6ebc2d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:42.984889 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 776/1544] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:14:42 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:42.986172 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e1aac-0c0c-47fe-8225-7ccb89e77c53 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:42.986457 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e1aac-0c0c-47fe-8225-7ccb89e77c53 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:42.986731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e1aac-0c0c-47fe-8225-7ccb89e77c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.020047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e05e1aac-0c0c-47fe-8225-7ccb89e77c53 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:43.021554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e05e1aac-0c0c-47fe-8225-7ccb89e77c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:43.027932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 769/1545] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:14:43.028987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb00534-8100-4178-ad27-4b30cdeaf42a None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.036905 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 777/1546] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:43.038294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d3a2c-3140-47ed-a801-a1103d765a7a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.038581 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d3a2c-3140-47ed-a801-a1103d765a7a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.038855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d3a2c-3140-47ed-a801-a1103d765a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.040340 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb00534-8100-4178-ad27-4b30cdeaf42a None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.054145 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c03837-2885-4ab3-9ce6-603416cd7b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.054833 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c03837-2885-4ab3-9ce6-603416cd7b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.055153 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c03837-2885-4ab3-9ce6-603416cd7b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.056024 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c03837-2885-4ab3-9ce6-603416cd7b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.056764 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c03837-2885-4ab3-9ce6-603416cd7b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.058691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c03837-2885-4ab3-9ce6-603416cd7b6c admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.073105 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fc3d3a2c-3140-47ed-a801-a1103d765a7a None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:43.074329 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fc3d3a2c-3140-47ed-a801-a1103d765a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:43.076517 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 770/1547] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:43.078205 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772da6c-f7c7-4e27-8aa5-56129fd86797 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.078737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772da6c-f7c7-4e27-8aa5-56129fd86797 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.079241 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772da6c-f7c7-4e27-8aa5-56129fd86797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.090342 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 778/1548] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:43.095124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d239aa-78a3-4026-bbf2-7efadb5d000c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.095410 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d239aa-78a3-4026-bbf2-7efadb5d000c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.095679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d239aa-78a3-4026-bbf2-7efadb5d000c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.122961 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-e772da6c-f7c7-4e27-8aa5-56129fd86797 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:43.124187 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-e772da6c-f7c7-4e27-8aa5-56129fd86797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:43.136855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-34d239aa-78a3-4026-bbf2-7efadb5d000c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:43.138618 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-34d239aa-78a3-4026-bbf2-7efadb5d000c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:43.144307 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 771/1549] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:43.145733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772da6c-f7c7-4e27-8aa5-56129fd86797 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.152423 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 779/1550] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:43.153536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d239aa-78a3-4026-bbf2-7efadb5d000c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.161298 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772da6c-f7c7-4e27-8aa5-56129fd86797 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.165531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d239aa-78a3-4026-bbf2-7efadb5d000c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.167133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760f064-8376-420d-a9fc-fdbdc0ae5d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.167803 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760f064-8376-420d-a9fc-fdbdc0ae5d8e admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.168085 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760f064-8376-420d-a9fc-fdbdc0ae5d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.168360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760f064-8376-420d-a9fc-fdbdc0ae5d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.169087 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760f064-8376-420d-a9fc-fdbdc0ae5d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.170621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd8aaa-5f77-4334-a004-8698ea948be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.170755 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760f064-8376-420d-a9fc-fdbdc0ae5d8e admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.171309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd8aaa-5f77-4334-a004-8698ea948be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.171590 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd8aaa-5f77-4334-a004-8698ea948be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.171860 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd8aaa-5f77-4334-a004-8698ea948be4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.173108 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd8aaa-5f77-4334-a004-8698ea948be4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:14:43.173415 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd8aaa-5f77-4334-a004-8698ea948be4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.175432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd8aaa-5f77-4334-a004-8698ea948be4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.185003 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 772/1551] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:43.187180 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70508321-092c-4613-b07e-f534f5ad9216 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.187708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70508321-092c-4613-b07e-f534f5ad9216 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.188225 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70508321-092c-4613-b07e-f534f5ad9216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.189397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 780/1552] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:14:43.190839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83df5fd-a707-4b86-9354-56e890f9f1bc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.191129 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83df5fd-a707-4b86-9354-56e890f9f1bc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.191403 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83df5fd-a707-4b86-9354-56e890f9f1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.209883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-70508321-092c-4613-b07e-f534f5ad9216 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:43.210508 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e83df5fd-a707-4b86-9354-56e890f9f1bc None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:43.211134 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-70508321-092c-4613-b07e-f534f5ad9216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:43.211691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e83df5fd-a707-4b86-9354-56e890f9f1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:43.219594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 781/1553] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:43.222091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83df5fd-a707-4b86-9354-56e890f9f1bc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.225519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 773/1554] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:43.227982 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94a815-6ae4-4c07-817f-1afb7fd255d0 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.228321 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94a815-6ae4-4c07-817f-1afb7fd255d0 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.228619 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94a815-6ae4-4c07-817f-1afb7fd255d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.231314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83df5fd-a707-4b86-9354-56e890f9f1bc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.235979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d661d01-97db-4480-86ad-ecb666b6dc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.236585 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d661d01-97db-4480-86ad-ecb666b6dc3a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.236873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d661d01-97db-4480-86ad-ecb666b6dc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.237154 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d661d01-97db-4480-86ad-ecb666b6dc3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.237909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d661d01-97db-4480-86ad-ecb666b6dc3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:14:43.238250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d661d01-97db-4480-86ad-ecb666b6dc3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.239855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d661d01-97db-4480-86ad-ecb666b6dc3a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.248740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-bf94a815-6ae4-4c07-817f-1afb7fd255d0 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:43.249941 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-bf94a815-6ae4-4c07-817f-1afb7fd255d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:43.252263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 782/1555] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:14:43.253484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd7ca8-d3b0-45f0-a5a9-4e04cbf97fa3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.253769 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd7ca8-d3b0-45f0-a5a9-4e04cbf97fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.254076 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd7ca8-d3b0-45f0-a5a9-4e04cbf97fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.258312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 774/1556] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:43.259094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94a815-6ae4-4c07-817f-1afb7fd255d0 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.268640 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94a815-6ae4-4c07-817f-1afb7fd255d0 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.273234 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1064b4f-9bc3-4f4e-9c72-33e5c311e57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.274169 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1064b4f-9bc3-4f4e-9c72-33e5c311e57c admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.274455 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1064b4f-9bc3-4f4e-9c72-33e5c311e57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.274731 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1064b4f-9bc3-4f4e-9c72-33e5c311e57c admin admin] PATH_INFO: `/v3/projects/5ba69184111e41228067740300c97d28/users/0dd62c26ee6a438495abdc3ca489b85e/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.275148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-36bd7ca8-d3b0-45f0-a5a9-4e04cbf97fa3 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:43.276354 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-36bd7ca8-d3b0-45f0-a5a9-4e04cbf97fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:43.284498 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 783/1557] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:43.285596 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0090ca-91ef-4ac1-8d00-ec40460d5ea9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.285891 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0090ca-91ef-4ac1-8d00-ec40460d5ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.286214 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0090ca-91ef-4ac1-8d00-ec40460d5ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.290962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1064b4f-9bc3-4f4e-9c72-33e5c311e57c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ba69184111e41228067740300c97d28, user_id=0dd62c26ee6a438495abdc3ca489b85e, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.293661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1064b4f-9bc3-4f4e-9c72-33e5c311e57c admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.306941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fb0090ca-91ef-4ac1-8d00-ec40460d5ea9 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:43.308410 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fb0090ca-91ef-4ac1-8d00-ec40460d5ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:43.308561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 775/1558] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:14:43 2022] PUT /identity/v3/projects/5ba69184111e41228067740300c97d28/users/0dd62c26ee6a438495abdc3ca489b85e/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:43.309273 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1064b4f-9bc3-4f4e-9c72-33e5c311e57c admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.365388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:43.368609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 784/1559] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:43.369920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1064b4f-9bc3-4f4e-9c72-33e5c311e57c admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.371698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7545f-9933-46d0-82a0-0626a561c559 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.371995 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7545f-9933-46d0-82a0-0626a561c559 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.372295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7545f-9933-46d0-82a0-0626a561c559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.376854 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a03d4-e8f0-4cb5-a535-c88837ad8f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.377508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a03d4-e8f0-4cb5-a535-c88837ad8f43 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.377786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a03d4-e8f0-4cb5-a535-c88837ad8f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.378092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a03d4-e8f0-4cb5-a535-c88837ad8f43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.378783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a03d4-e8f0-4cb5-a535-c88837ad8f43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.380674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a03d4-e8f0-4cb5-a535-c88837ad8f43 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.392527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-47b7545f-9933-46d0-82a0-0626a561c559 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:43.393732 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-47b7545f-9933-46d0-82a0-0626a561c559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:43.402773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 785/1560] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:43.407626 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 776/1561] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/projects => generated 355 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:43.407773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bff622-e881-4c03-b45c-4d833fa1a4a6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.407857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bff622-e881-4c03-b45c-4d833fa1a4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.408107 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bff622-e881-4c03-b45c-4d833fa1a4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.408442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a03d4-e8f0-4cb5-a535-c88837ad8f43 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.416960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:43.429559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-57bff622-e881-4c03-b45c-4d833fa1a4a6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:43.431362 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-57bff622-e881-4c03-b45c-4d833fa1a4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:43.473259 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a03d4-e8f0-4cb5-a535-c88837ad8f43 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.478616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042ba34-2d94-425c-8dbe-37e1413b21e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.479290 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042ba34-2d94-425c-8dbe-37e1413b21e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.479597 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042ba34-2d94-425c-8dbe-37e1413b21e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.480081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042ba34-2d94-425c-8dbe-37e1413b21e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.480827 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042ba34-2d94-425c-8dbe-37e1413b21e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.482861 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042ba34-2d94-425c-8dbe-37e1413b21e2 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.494896 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 786/1562] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:43.496136 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e697f-3950-45ea-9e33-a8b4c6b6782c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.496423 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e697f-3950-45ea-9e33-a8b4c6b6782c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.496699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e697f-3950-45ea-9e33-a8b4c6b6782c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.509800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 777/1563] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:43.510687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042ba34-2d94-425c-8dbe-37e1413b21e2 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.517524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-059e697f-3950-45ea-9e33-a8b4c6b6782c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:43.518979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-059e697f-3950-45ea-9e33-a8b4c6b6782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:43.581531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 787/1564] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:43.582477 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042ba34-2d94-425c-8dbe-37e1413b21e2 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.583096 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293147ba-0814-465e-9bab-14f6c51c8055 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.583589 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293147ba-0814-465e-9bab-14f6c51c8055 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.583873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293147ba-0814-465e-9bab-14f6c51c8055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.588314 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839094c-aee0-404d-839a-dc26f352f38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.589055 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839094c-aee0-404d-839a-dc26f352f38d admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.589412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839094c-aee0-404d-839a-dc26f352f38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.589763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839094c-aee0-404d-839a-dc26f352f38d admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.590603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839094c-aee0-404d-839a-dc26f352f38d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:14:43.591009 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839094c-aee0-404d-839a-dc26f352f38d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.592663 dv-cinder-797608-61-smb devstack@keystone.service[80317]: WARNING py.warnings [None req-3839094c-aee0-404d-839a-dc26f352f38d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:14:43.592663 dv-cinder-797608-61-smb devstack@keystone.service[80317]: warnings.warn(msg) Jul 25 12:14:43.592663 dv-cinder-797608-61-smb devstack@keystone.service[80317]: Jul 25 12:14:43.593704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839094c-aee0-404d-839a-dc26f352f38d admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.605431 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-293147ba-0814-465e-9bab-14f6c51c8055 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:43.606108 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 778/1565] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:14:43.606682 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-293147ba-0814-465e-9bab-14f6c51c8055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:43.607418 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff43e4b-df08-4fd5-bd40-2e086eec1c09 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.607715 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff43e4b-df08-4fd5-bd40-2e086eec1c09 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.607997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff43e4b-df08-4fd5-bd40-2e086eec1c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.619705 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 788/1566] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:43.620645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293147ba-0814-465e-9bab-14f6c51c8055 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.630589 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293147ba-0814-465e-9bab-14f6c51c8055 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.631561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-9ff43e4b-df08-4fd5-bd40-2e086eec1c09 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:43.632787 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-9ff43e4b-df08-4fd5-bd40-2e086eec1c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:43.635224 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb4e65-f2e9-4aed-9d70-49c4b612e9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.635882 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb4e65-f2e9-4aed-9d70-49c4b612e9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.636167 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb4e65-f2e9-4aed-9d70-49c4b612e9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.636442 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb4e65-f2e9-4aed-9d70-49c4b612e9f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.637165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb4e65-f2e9-4aed-9d70-49c4b612e9f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:14:43.637483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb4e65-f2e9-4aed-9d70-49c4b612e9f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.639095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb4e65-f2e9-4aed-9d70-49c4b612e9f1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.640875 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 779/1567] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:43.641692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff43e4b-df08-4fd5-bd40-2e086eec1c09 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.651767 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 789/1568] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:14:43.652699 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff43e4b-df08-4fd5-bd40-2e086eec1c09 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.652943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb4e65-f2e9-4aed-9d70-49c4b612e9f1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.658016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422779d-b97f-4f90-888b-72a0462b18b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.658772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422779d-b97f-4f90-888b-72a0462b18b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.659062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422779d-b97f-4f90-888b-72a0462b18b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.659341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422779d-b97f-4f90-888b-72a0462b18b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.660034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422779d-b97f-4f90-888b-72a0462b18b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.661044 dv-cinder-797608-61-smb devstack@keystone.service[80317]: WARNING py.warnings [None req-3422779d-b97f-4f90-888b-72a0462b18b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:14:43.661044 dv-cinder-797608-61-smb devstack@keystone.service[80317]: warnings.warn(msg) Jul 25 12:14:43.661044 dv-cinder-797608-61-smb devstack@keystone.service[80317]: Jul 25 12:14:43.662270 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422779d-b97f-4f90-888b-72a0462b18b8 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.663382 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb4e65-f2e9-4aed-9d70-49c4b612e9f1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.668764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687db85-e7f4-4528-bde6-8a1a2abb0be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.669431 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687db85-e7f4-4528-bde6-8a1a2abb0be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.669712 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687db85-e7f4-4528-bde6-8a1a2abb0be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.669986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687db85-e7f4-4528-bde6-8a1a2abb0be8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.670731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687db85-e7f4-4528-bde6-8a1a2abb0be8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:14:43.671044 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687db85-e7f4-4528-bde6-8a1a2abb0be8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.672648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687db85-e7f4-4528-bde6-8a1a2abb0be8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.685986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 780/1569] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/users => generated 278 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:43.686307 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 790/1570] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:14:43.687100 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687db85-e7f4-4528-bde6-8a1a2abb0be8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.690938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422779d-b97f-4f90-888b-72a0462b18b8 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.696772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687db85-e7f4-4528-bde6-8a1a2abb0be8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.701563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca198f3d-405a-42e1-b1b0-a9ab1aba1fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.702185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422779d-b97f-4f90-888b-72a0462b18b8 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.702302 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca198f3d-405a-42e1-b1b0-a9ab1aba1fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.702594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca198f3d-405a-42e1-b1b0-a9ab1aba1fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.702872 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca198f3d-405a-42e1-b1b0-a9ab1aba1fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.703584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca198f3d-405a-42e1-b1b0-a9ab1aba1fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.705509 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca198f3d-405a-42e1-b1b0-a9ab1aba1fd1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.706827 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a19df-d70b-4dd8-ab7f-4eb49fa48820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.707471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a19df-d70b-4dd8-ab7f-4eb49fa48820 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.707808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a19df-d70b-4dd8-ab7f-4eb49fa48820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.708088 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a19df-d70b-4dd8-ab7f-4eb49fa48820 admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.708814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a19df-d70b-4dd8-ab7f-4eb49fa48820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:14:43.709118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a19df-d70b-4dd8-ab7f-4eb49fa48820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.710729 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a19df-d70b-4dd8-ab7f-4eb49fa48820 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.723554 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 781/1571] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:14:43.724450 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a19df-d70b-4dd8-ab7f-4eb49fa48820 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.728711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 791/1572] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:43.729638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca198f3d-405a-42e1-b1b0-a9ab1aba1fd1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.741052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a19df-d70b-4dd8-ab7f-4eb49fa48820 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.745742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77cee7-a207-4d99-993e-1edd488d4391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.746359 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77cee7-a207-4d99-993e-1edd488d4391 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.746644 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77cee7-a207-4d99-993e-1edd488d4391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.746917 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77cee7-a207-4d99-993e-1edd488d4391 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.747601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77cee7-a207-4d99-993e-1edd488d4391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.749484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77cee7-a207-4d99-993e-1edd488d4391 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.777470 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 782/1573] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:43.778170 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77cee7-a207-4d99-993e-1edd488d4391 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.782498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:43.787336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca198f3d-405a-42e1-b1b0-a9ab1aba1fd1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.796114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:43.840207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e3ba2-0906-4e30-bc55-6c669c5105a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.840999 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e3ba2-0906-4e30-bc55-6c669c5105a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.841286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e3ba2-0906-4e30-bc55-6c669c5105a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.841560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e3ba2-0906-4e30-bc55-6c669c5105a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.846323 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77cee7-a207-4d99-993e-1edd488d4391 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.850567 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e3ba2-0906-4e30-bc55-6c669c5105a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.851077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49a066-e43f-42eb-b0c8-1879da358d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.851741 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49a066-e43f-42eb-b0c8-1879da358d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.852017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e3ba2-0906-4e30-bc55-6c669c5105a3 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.852236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49a066-e43f-42eb-b0c8-1879da358d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.852491 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49a066-e43f-42eb-b0c8-1879da358d01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.853222 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49a066-e43f-42eb-b0c8-1879da358d01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:14:43.853529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49a066-e43f-42eb-b0c8-1879da358d01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.855185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49a066-e43f-42eb-b0c8-1879da358d01 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.861396 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 792/1574] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:14:43.862191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e3ba2-0906-4e30-bc55-6c669c5105a3 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.867003 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 783/1575] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:14:43.867710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49a066-e43f-42eb-b0c8-1879da358d01 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.877735 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49a066-e43f-42eb-b0c8-1879da358d01 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.878231 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e3ba2-0906-4e30-bc55-6c669c5105a3 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.882524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd2776-aac7-41fb-b948-195816c0699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.882960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969583fe-5749-4a58-9614-0ce37292b70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.883186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd2776-aac7-41fb-b948-195816c0699a admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.884018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd2776-aac7-41fb-b948-195816c0699a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.884145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969583fe-5749-4a58-9614-0ce37292b70e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.884306 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd2776-aac7-41fb-b948-195816c0699a admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.884416 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969583fe-5749-4a58-9614-0ce37292b70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.884669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969583fe-5749-4a58-9614-0ce37292b70e admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.885045 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd2776-aac7-41fb-b948-195816c0699a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.885345 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969583fe-5749-4a58-9614-0ce37292b70e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.886456 dv-cinder-797608-61-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-969583fe-5749-4a58-9614-0ce37292b70e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:14:43.886456 dv-cinder-797608-61-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 25 12:14:43.886456 dv-cinder-797608-61-smb devstack@keystone.service[80316]: Jul 25 12:14:43.886819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd2776-aac7-41fb-b948-195816c0699a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.887556 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969583fe-5749-4a58-9614-0ce37292b70e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.902399 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 784/1576] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:43.902399 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd2776-aac7-41fb-b948-195816c0699a admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.910236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd2776-aac7-41fb-b948-195816c0699a admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:43.915521 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24256410-9c7d-4b2a-9d0a-00aaafebc5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:43.916186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24256410-9c7d-4b2a-9d0a-00aaafebc5ac admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:43.916473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24256410-9c7d-4b2a-9d0a-00aaafebc5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:43.916753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24256410-9c7d-4b2a-9d0a-00aaafebc5ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:43.917507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24256410-9c7d-4b2a-9d0a-00aaafebc5ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:43.919379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24256410-9c7d-4b2a-9d0a-00aaafebc5ac admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:43.922616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 793/1577] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:43.923499 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969583fe-5749-4a58-9614-0ce37292b70e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.952801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 785/1578] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:43.957808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24256410-9c7d-4b2a-9d0a-00aaafebc5ac admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:43.999544 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969583fe-5749-4a58-9614-0ce37292b70e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.037237 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24256410-9c7d-4b2a-9d0a-00aaafebc5ac admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.043171 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf98d74-f483-458d-bf5e-03ef853e3dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.043941 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf98d74-f483-458d-bf5e-03ef853e3dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.044260 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf98d74-f483-458d-bf5e-03ef853e3dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.044628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf98d74-f483-458d-bf5e-03ef853e3dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.045441 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf98d74-f483-458d-bf5e-03ef853e3dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.047299 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf98d74-f483-458d-bf5e-03ef853e3dd5 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.061508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 786/1579] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:44.061508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf98d74-f483-458d-bf5e-03ef853e3dd5 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.067639 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d220e8-1ba5-4b1f-b64a-2e5c7135f336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.068322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d220e8-1ba5-4b1f-b64a-2e5c7135f336 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.068606 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d220e8-1ba5-4b1f-b64a-2e5c7135f336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.068880 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d220e8-1ba5-4b1f-b64a-2e5c7135f336 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.069811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d220e8-1ba5-4b1f-b64a-2e5c7135f336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.071540 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf98d74-f483-458d-bf5e-03ef853e3dd5 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.072615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d220e8-1ba5-4b1f-b64a-2e5c7135f336 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.078448 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84774d5-b33b-40a3-99d7-48027c6fd78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.079831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84774d5-b33b-40a3-99d7-48027c6fd78e admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.079831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84774d5-b33b-40a3-99d7-48027c6fd78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.079831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84774d5-b33b-40a3-99d7-48027c6fd78e admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.080510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84774d5-b33b-40a3-99d7-48027c6fd78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.082428 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84774d5-b33b-40a3-99d7-48027c6fd78e admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.106440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 794/1580] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:14:43 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:44.107378 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d220e8-1ba5-4b1f-b64a-2e5c7135f336 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.109001 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 787/1581] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:14:44 2022] POST /identity/v3/users => generated 288 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:44.110211 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84774d5-b33b-40a3-99d7-48027c6fd78e admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.122977 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84774d5-b33b-40a3-99d7-48027c6fd78e admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.140464 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:44.168720 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:44.183212 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d220e8-1ba5-4b1f-b64a-2e5c7135f336 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.188607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f40d7a-fa4d-446e-a4e0-980c8dfa4fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.189344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f40d7a-fa4d-446e-a4e0-980c8dfa4fce admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.189651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f40d7a-fa4d-446e-a4e0-980c8dfa4fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.189938 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f40d7a-fa4d-446e-a4e0-980c8dfa4fce admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.190220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fd004-b9a3-4c8f-a02a-8f5bfa867152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.190719 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f40d7a-fa4d-446e-a4e0-980c8dfa4fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.190945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd004-b9a3-4c8f-a02a-8f5bfa867152 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.191289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd004-b9a3-4c8f-a02a-8f5bfa867152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.191584 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd004-b9a3-4c8f-a02a-8f5bfa867152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.192614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fd004-b9a3-4c8f-a02a-8f5bfa867152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.192807 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f40d7a-fa4d-446e-a4e0-980c8dfa4fce admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.194495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fd004-b9a3-4c8f-a02a-8f5bfa867152 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.224393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 788/1582] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:44.225240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fd004-b9a3-4c8f-a02a-8f5bfa867152 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.228973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 795/1583] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:14:44 2022] POST /identity/v3/projects => generated 405 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:44.230036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f40d7a-fa4d-446e-a4e0-980c8dfa4fce admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.242207 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fd004-b9a3-4c8f-a02a-8f5bfa867152 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.303454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f40d7a-fa4d-446e-a4e0-980c8dfa4fce admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.308965 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34e58a-68ba-4b43-aa2c-27eb1211ea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.309635 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34e58a-68ba-4b43-aa2c-27eb1211ea4b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.309919 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34e58a-68ba-4b43-aa2c-27eb1211ea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.310260 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34e58a-68ba-4b43-aa2c-27eb1211ea4b admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.310949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34e58a-68ba-4b43-aa2c-27eb1211ea4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.313022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34e58a-68ba-4b43-aa2c-27eb1211ea4b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.318070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346565ef-d155-45f9-99ec-b17905f175f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.321752 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346565ef-d155-45f9-99ec-b17905f175f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.322365 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346565ef-d155-45f9-99ec-b17905f175f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.322792 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346565ef-d155-45f9-99ec-b17905f175f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.323643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346565ef-d155-45f9-99ec-b17905f175f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.326160 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346565ef-d155-45f9-99ec-b17905f175f2 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.340678 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 796/1584] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:14:44 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:44.340678 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34e58a-68ba-4b43-aa2c-27eb1211ea4b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.352840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34e58a-68ba-4b43-aa2c-27eb1211ea4b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.357637 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd44f4-275d-47b8-8368-7faeeabca11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.357922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 789/1585] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:14:44 2022] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:44.361093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd44f4-275d-47b8-8368-7faeeabca11b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.361093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd44f4-275d-47b8-8368-7faeeabca11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.361093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd44f4-275d-47b8-8368-7faeeabca11b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.361093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd44f4-275d-47b8-8368-7faeeabca11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.361715 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd44f4-275d-47b8-8368-7faeeabca11b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.362518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346565ef-d155-45f9-99ec-b17905f175f2 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.377175 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 797/1586] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:44.377175 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd44f4-275d-47b8-8368-7faeeabca11b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.377466 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346565ef-d155-45f9-99ec-b17905f175f2 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.382520 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c442088-7aba-4c20-a2a9-3132d649250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.384746 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c442088-7aba-4c20-a2a9-3132d649250a admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.384746 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c442088-7aba-4c20-a2a9-3132d649250a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.385324 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c442088-7aba-4c20-a2a9-3132d649250a admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.385542 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd44f4-275d-47b8-8368-7faeeabca11b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.386282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c442088-7aba-4c20-a2a9-3132d649250a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.388342 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c442088-7aba-4c20-a2a9-3132d649250a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.392212 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cb695-8f34-42a5-8535-673f961b3a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.392954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cb695-8f34-42a5-8535-673f961b3a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.393302 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cb695-8f34-42a5-8535-673f961b3a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.393644 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cb695-8f34-42a5-8535-673f961b3a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.394775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cb695-8f34-42a5-8535-673f961b3a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.396177 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cb695-8f34-42a5-8535-673f961b3a8a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.408207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 798/1587] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:44.411923 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cb695-8f34-42a5-8535-673f961b3a8a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.417007 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 790/1588] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:14:44 2022] POST /identity/v3/users => generated 290 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:44.417007 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c442088-7aba-4c20-a2a9-3132d649250a admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.422819 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cb695-8f34-42a5-8535-673f961b3a8a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.427236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c442088-7aba-4c20-a2a9-3132d649250a admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.427681 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be013fd7-bf4f-47dd-b2d6-61131658ce7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.428557 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be013fd7-bf4f-47dd-b2d6-61131658ce7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.428863 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be013fd7-bf4f-47dd-b2d6-61131658ce7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.429096 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be013fd7-bf4f-47dd-b2d6-61131658ce7c admin admin] PATH_INFO: `/v3/projects/bb9f5ff552f849f7992a1ace61cc4baf/users/f79ab19da8a04b4d9f8ff840661581c4/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.433001 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6f818-8e15-4677-a92b-fc486fc44973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.433755 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6f818-8e15-4677-a92b-fc486fc44973 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.434132 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6f818-8e15-4677-a92b-fc486fc44973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.434516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6f818-8e15-4677-a92b-fc486fc44973 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.435327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6f818-8e15-4677-a92b-fc486fc44973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.437352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6f818-8e15-4677-a92b-fc486fc44973 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.445686 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be013fd7-bf4f-47dd-b2d6-61131658ce7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb9f5ff552f849f7992a1ace61cc4baf, user_id=f79ab19da8a04b4d9f8ff840661581c4, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.446910 dv-cinder-797608-61-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-be013fd7-bf4f-47dd-b2d6-61131658ce7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:14:44.446910 dv-cinder-797608-61-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 25 12:14:44.446910 dv-cinder-797608-61-smb devstack@keystone.service[80316]: Jul 25 12:14:44.448852 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be013fd7-bf4f-47dd-b2d6-61131658ce7c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.467186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 799/1589] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:14:44 2022] PUT /identity/v3/projects/bb9f5ff552f849f7992a1ace61cc4baf/users/f79ab19da8a04b4d9f8ff840661581c4/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:44.467186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be013fd7-bf4f-47dd-b2d6-61131658ce7c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.473517 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 791/1590] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:14:44 2022] POST /identity/v3/users => generated 303 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:44.474669 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6f818-8e15-4677-a92b-fc486fc44973 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.490662 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6f818-8e15-4677-a92b-fc486fc44973 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.534602 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:44.543962 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be013fd7-bf4f-47dd-b2d6-61131658ce7c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.551292 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317df27-d127-4b00-9917-0405948cd087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.551962 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317df27-d127-4b00-9917-0405948cd087 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.552241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317df27-d127-4b00-9917-0405948cd087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.552513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317df27-d127-4b00-9917-0405948cd087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.553242 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317df27-d127-4b00-9917-0405948cd087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.561977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317df27-d127-4b00-9917-0405948cd087 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.566987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b657b-1bdd-4572-8771-fc5af6fe5f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.567701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b657b-1bdd-4572-8771-fc5af6fe5f8d admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.567988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b657b-1bdd-4572-8771-fc5af6fe5f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.568618 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b657b-1bdd-4572-8771-fc5af6fe5f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.569304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b657b-1bdd-4572-8771-fc5af6fe5f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.571579 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b657b-1bdd-4572-8771-fc5af6fe5f8d admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.574264 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 800/1591] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:44.575083 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317df27-d127-4b00-9917-0405948cd087 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.583009 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 792/1592] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:44.583778 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b657b-1bdd-4572-8771-fc5af6fe5f8d admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.585462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317df27-d127-4b00-9917-0405948cd087 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.591007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46480b-165d-4a1f-ab40-ce3db885e206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.591884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46480b-165d-4a1f-ab40-ce3db885e206 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.592166 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46480b-165d-4a1f-ab40-ce3db885e206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.592440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46480b-165d-4a1f-ab40-ce3db885e206 admin admin] PATH_INFO: `/v3/projects/99b5171d70c049029b3318fd7f2c1f7c/users/3e254a86245a4a739ce9c61a3498feab/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.595640 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b657b-1bdd-4572-8771-fc5af6fe5f8d admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.600780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c5bbd-576c-49f3-9218-1f451704bdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.601449 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c5bbd-576c-49f3-9218-1f451704bdaa admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.601873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c5bbd-576c-49f3-9218-1f451704bdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.602628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c5bbd-576c-49f3-9218-1f451704bdaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.602937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c5bbd-576c-49f3-9218-1f451704bdaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.604528 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c5bbd-576c-49f3-9218-1f451704bdaa admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.608374 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46480b-165d-4a1f-ab40-ce3db885e206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b5171d70c049029b3318fd7f2c1f7c, user_id=3e254a86245a4a739ce9c61a3498feab, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.611164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46480b-165d-4a1f-ab40-ce3db885e206 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.615290 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 793/1593] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:44.616050 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c5bbd-576c-49f3-9218-1f451704bdaa admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.627026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c5bbd-576c-49f3-9218-1f451704bdaa admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.637089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 801/1594] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:14:44 2022] PUT /identity/v3/projects/99b5171d70c049029b3318fd7f2c1f7c/users/3e254a86245a4a739ce9c61a3498feab/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:44.637089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fe221-1b4d-4858-94c6-1392c462d263 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.637089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fe221-1b4d-4858-94c6-1392c462d263 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.637089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fe221-1b4d-4858-94c6-1392c462d263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.652379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:44.664685 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bb3fe221-1b4d-4858-94c6-1392c462d263 None None] MFA Rules not processed for user `f79ab19da8a04b4d9f8ff840661581c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:44.665981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bb3fe221-1b4d-4858-94c6-1392c462d263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:44.705087 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6347cc-6ec5-4c74-a565-20c3dee4d573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.705970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6347cc-6ec5-4c74-a565-20c3dee4d573 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.706367 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6347cc-6ec5-4c74-a565-20c3dee4d573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.706719 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6347cc-6ec5-4c74-a565-20c3dee4d573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.707462 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6347cc-6ec5-4c74-a565-20c3dee4d573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.709214 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6347cc-6ec5-4c74-a565-20c3dee4d573 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.720305 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 794/1595] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:44.721147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6347cc-6ec5-4c74-a565-20c3dee4d573 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.732668 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6347cc-6ec5-4c74-a565-20c3dee4d573 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.738726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff095f-0d98-465d-835e-017d3f154dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.739438 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff095f-0d98-465d-835e-017d3f154dda admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.740330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff095f-0d98-465d-835e-017d3f154dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.740500 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff095f-0d98-465d-835e-017d3f154dda admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.741191 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff095f-0d98-465d-835e-017d3f154dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.751322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 802/1596] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:44 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:44.752498 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fe221-1b4d-4858-94c6-1392c462d263 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.756980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff095f-0d98-465d-835e-017d3f154dda admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.765592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fe221-1b4d-4858-94c6-1392c462d263 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.770062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 795/1597] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:44.771111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67b9b6-4569-4e04-9d59-923ae34b07e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.771380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff095f-0d98-465d-835e-017d3f154dda admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.771954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67b9b6-4569-4e04-9d59-923ae34b07e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.772216 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67b9b6-4569-4e04-9d59-923ae34b07e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.772832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67b9b6-4569-4e04-9d59-923ae34b07e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.773642 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67b9b6-4569-4e04-9d59-923ae34b07e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.775922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67b9b6-4569-4e04-9d59-923ae34b07e4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.784338 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff095f-0d98-465d-835e-017d3f154dda admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.789574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 803/1598] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:44.790077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010d695-08f9-45ab-8dbb-df32a4a78378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.790978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010d695-08f9-45ab-8dbb-df32a4a78378 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.791453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010d695-08f9-45ab-8dbb-df32a4a78378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.791913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010d695-08f9-45ab-8dbb-df32a4a78378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.793174 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010d695-08f9-45ab-8dbb-df32a4a78378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.793842 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67b9b6-4569-4e04-9d59-923ae34b07e4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.795579 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010d695-08f9-45ab-8dbb-df32a4a78378 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.805200 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67b9b6-4569-4e04-9d59-923ae34b07e4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.814215 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 796/1599] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:44.816154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7ff30-a037-46bd-95cd-b2038459cdd2 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.816553 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7ff30-a037-46bd-95cd-b2038459cdd2 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.816956 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7ff30-a037-46bd-95cd-b2038459cdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.817684 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3d382-e005-4071-84b0-7203752c071c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.821424 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3d382-e005-4071-84b0-7203752c071c admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.821926 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3d382-e005-4071-84b0-7203752c071c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.822356 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3d382-e005-4071-84b0-7203752c071c admin admin] PATH_INFO: `/v3/projects/2a70ec04c37d4e228c14fbc6106dedfc/users/170f479a814646e0b8822c1133cc9be4/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.847987 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3d382-e005-4071-84b0-7203752c071c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a70ec04c37d4e228c14fbc6106dedfc, user_id=170f479a814646e0b8822c1133cc9be4, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.851071 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3d382-e005-4071-84b0-7203752c071c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.871839 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-3fd7ff30-a037-46bd-95cd-b2038459cdd2 None None] MFA Rules not processed for user `3e254a86245a4a739ce9c61a3498feab`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:44.873221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-3fd7ff30-a037-46bd-95cd-b2038459cdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:44.887865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 804/1600] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:14:44 2022] PUT /identity/v3/projects/2a70ec04c37d4e228c14fbc6106dedfc/users/170f479a814646e0b8822c1133cc9be4/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:44.888865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3d382-e005-4071-84b0-7203752c071c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.966836 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3d382-e005-4071-84b0-7203752c071c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:44.976244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419cc97-cc43-427a-879f-af622e6b28b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:44.976462 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 797/1601] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:44.976553 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419cc97-cc43-427a-879f-af622e6b28b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:44.976553 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419cc97-cc43-427a-879f-af622e6b28b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:44.976704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7ff30-a037-46bd-95cd-b2038459cdd2 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:44.976790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419cc97-cc43-427a-879f-af622e6b28b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:44.976790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419cc97-cc43-427a-879f-af622e6b28b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:44.976790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419cc97-cc43-427a-879f-af622e6b28b9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:44.988318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 805/1602] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:44.989562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419cc97-cc43-427a-879f-af622e6b28b9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:45.005371 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419cc97-cc43-427a-879f-af622e6b28b9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:45.009649 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7ff30-a037-46bd-95cd-b2038459cdd2 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:45.011968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca60d80-1c09-48d8-9e2f-cb989a021f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:45.012638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca60d80-1c09-48d8-9e2f-cb989a021f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:45.013191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca60d80-1c09-48d8-9e2f-cb989a021f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:45.013632 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca60d80-1c09-48d8-9e2f-cb989a021f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:45.014783 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca60d80-1c09-48d8-9e2f-cb989a021f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:45.016467 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca60d80-1c09-48d8-9e2f-cb989a021f32 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:45.028216 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58c669-8d62-4005-b3c6-84804804996d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:45.028798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58c669-8d62-4005-b3c6-84804804996d admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:45.029080 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58c669-8d62-4005-b3c6-84804804996d admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:45.029356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58c669-8d62-4005-b3c6-84804804996d admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:45.030077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58c669-8d62-4005-b3c6-84804804996d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:45.030902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 806/1603] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:45.031792 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca60d80-1c09-48d8-9e2f-cb989a021f32 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:45.035238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58c669-8d62-4005-b3c6-84804804996d admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:45.039034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:45.043411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca60d80-1c09-48d8-9e2f-cb989a021f32 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:45.050218 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8a695-f754-4d38-b5da-ad17e9afb603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:45.051908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8a695-f754-4d38-b5da-ad17e9afb603 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:45.052477 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8a695-f754-4d38-b5da-ad17e9afb603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:45.053127 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8a695-f754-4d38-b5da-ad17e9afb603 admin admin] PATH_INFO: `/v3/projects/fabfb17a597c40e1a8987d79c40be118/users/8e0fa1b05a614a7d866c207c8fc9201b/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:45.070445 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 798/1604] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:14:44 2022] POST /identity/v3/projects => generated 353 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:45.072192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58c669-8d62-4005-b3c6-84804804996d admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:45.078543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8a695-f754-4d38-b5da-ad17e9afb603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabfb17a597c40e1a8987d79c40be118, user_id=8e0fa1b05a614a7d866c207c8fc9201b, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:45.081755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8a695-f754-4d38-b5da-ad17e9afb603 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:45.106591 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 807/1605] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:14:45 2022] PUT /identity/v3/projects/fabfb17a597c40e1a8987d79c40be118/users/8e0fa1b05a614a7d866c207c8fc9201b/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:45.108251 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11efd82-0867-472b-8ae0-d7f77c1d1240 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:45.108740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11efd82-0867-472b-8ae0-d7f77c1d1240 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:45.109173 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11efd82-0867-472b-8ae0-d7f77c1d1240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:45.132790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a11efd82-0867-472b-8ae0-d7f77c1d1240 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:45.135431 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a11efd82-0867-472b-8ae0-d7f77c1d1240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:45.173421 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58c669-8d62-4005-b3c6-84804804996d admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:45.178901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:45.244269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 808/1606] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:45.245441 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11efd82-0867-472b-8ae0-d7f77c1d1240 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:45.276203 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11efd82-0867-472b-8ae0-d7f77c1d1240 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:45.283785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0983d-6da7-4a05-b74c-c188aaad20c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:45.284563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336190f-59ad-4ad0-b0f6-9032b8626888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:45.285138 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0983d-6da7-4a05-b74c-c188aaad20c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:45.285603 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0983d-6da7-4a05-b74c-c188aaad20c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:45.285744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336190f-59ad-4ad0-b0f6-9032b8626888 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:45.286173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336190f-59ad-4ad0-b0f6-9032b8626888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:45.286395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0983d-6da7-4a05-b74c-c188aaad20c6 admin admin] PATH_INFO: `/v3/projects/08eeaa8ec30b4f5eb2f8ced0796eec04/users/6d58bfe99dfd4c79b7eabae6e1f5c536/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:45.286586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336190f-59ad-4ad0-b0f6-9032b8626888 admin admin] PATH_INFO: `/v3/projects/1c45bb4903a64ad08ec8aa4ad9bf9a0a/users/47ce23ee5ec843ea8a62655d4611a92f/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:45.307513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336190f-59ad-4ad0-b0f6-9032b8626888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c45bb4903a64ad08ec8aa4ad9bf9a0a, user_id=47ce23ee5ec843ea8a62655d4611a92f, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:45.311068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336190f-59ad-4ad0-b0f6-9032b8626888 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:45.337063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0983d-6da7-4a05-b74c-c188aaad20c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08eeaa8ec30b4f5eb2f8ced0796eec04, user_id=6d58bfe99dfd4c79b7eabae6e1f5c536, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:45.339221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 799/1607] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:14:45 2022] PUT /identity/v3/projects/1c45bb4903a64ad08ec8aa4ad9bf9a0a/users/47ce23ee5ec843ea8a62655d4611a92f/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:45.340897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0c542-a7ce-45db-bd52-30f39e9cf56f None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:45.341183 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0c542-a7ce-45db-bd52-30f39e9cf56f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:45.341457 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0c542-a7ce-45db-bd52-30f39e9cf56f None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:45.342844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0983d-6da7-4a05-b74c-c188aaad20c6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:45.350378 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 800/1608] 10.222.0.48 () {54 vars in 962 bytes} [Mon Jul 25 12:14:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:14:45.351424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0c542-a7ce-45db-bd52-30f39e9cf56f None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:45.374088 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 809/1609] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:14:45 2022] PUT /identity/v3/projects/08eeaa8ec30b4f5eb2f8ced0796eec04/users/6d58bfe99dfd4c79b7eabae6e1f5c536/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:45.374974 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0983d-6da7-4a05-b74c-c188aaad20c6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:45.469604 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0c542-a7ce-45db-bd52-30f39e9cf56f None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:45.475039 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab2b35-da9f-4442-a1dd-e89683383dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:45.475949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab2b35-da9f-4442-a1dd-e89683383dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:45.476232 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab2b35-da9f-4442-a1dd-e89683383dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:45.476507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab2b35-da9f-4442-a1dd-e89683383dc4 admin admin] PATH_INFO: `/v3/projects/f144cb098e0f4e44a4b89dcd3a3299e6/users/75f6f185a2514cf08cbc8b4f0deb310e/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:45.478045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0983d-6da7-4a05-b74c-c188aaad20c6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:45.484944 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08302ead-9c0d-467c-96b2-a0c5430ea4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:45.485840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08302ead-9c0d-467c-96b2-a0c5430ea4ee admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:45.486317 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08302ead-9c0d-467c-96b2-a0c5430ea4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:45.486705 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08302ead-9c0d-467c-96b2-a0c5430ea4ee admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:45.487536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08302ead-9c0d-467c-96b2-a0c5430ea4ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:45.490034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08302ead-9c0d-467c-96b2-a0c5430ea4ee admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:45.499025 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab2b35-da9f-4442-a1dd-e89683383dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f144cb098e0f4e44a4b89dcd3a3299e6, user_id=75f6f185a2514cf08cbc8b4f0deb310e, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:45.503502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab2b35-da9f-4442-a1dd-e89683383dc4 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:45.522984 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 810/1610] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:14:45 2022] POST /identity/v3/users => generated 283 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:45.522984 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d2356-1cc8-49cd-b85d-7ca92ab46ba3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:45.522984 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d2356-1cc8-49cd-b85d-7ca92ab46ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:45.522984 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d2356-1cc8-49cd-b85d-7ca92ab46ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:45.528151 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 801/1611] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:14:45 2022] PUT /identity/v3/projects/f144cb098e0f4e44a4b89dcd3a3299e6/users/75f6f185a2514cf08cbc8b4f0deb310e/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:45.529210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab2b35-da9f-4442-a1dd-e89683383dc4 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:45.547015 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6c6d2356-1cc8-49cd-b85d-7ca92ab46ba3 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:45.548306 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6c6d2356-1cc8-49cd-b85d-7ca92ab46ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:45.597975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:45.622773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 811/1612] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:45.624371 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216a6d3-c2c0-4d9a-935e-9231ecdb37b8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:45.624894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216a6d3-c2c0-4d9a-935e-9231ecdb37b8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:45.625253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216a6d3-c2c0-4d9a-935e-9231ecdb37b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:45.636831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab2b35-da9f-4442-a1dd-e89683383dc4 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:45.641691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9bae53-6c87-484d-b546-488e1746fc0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:45.642593 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bae53-6c87-484d-b546-488e1746fc0b service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:45.643235 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bae53-6c87-484d-b546-488e1746fc0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:45.643235 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bae53-6c87-484d-b546-488e1746fc0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:45.657179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9bae53-6c87-484d-b546-488e1746fc0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:45.657179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9bae53-6c87-484d-b546-488e1746fc0b service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:45.669076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 802/1613] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:14:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:14:45.670762 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5a67f-6610-479f-8dcb-bdc0ee6881d2 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:45.671248 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5a67f-6610-479f-8dcb-bdc0ee6881d2 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:45.671601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5a67f-6610-479f-8dcb-bdc0ee6881d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:45.678679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6216a6d3-c2c0-4d9a-935e-9231ecdb37b8 None None] MFA Rules not processed for user `47ce23ee5ec843ea8a62655d4611a92f`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:45.679966 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6216a6d3-c2c0-4d9a-935e-9231ecdb37b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:45.712657 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:45.740083 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-10c5a67f-6610-479f-8dcb-bdc0ee6881d2 None None] MFA Rules not processed for user `6d9db26891a04b0bb7e655c21feeffdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:45.741819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-10c5a67f-6610-479f-8dcb-bdc0ee6881d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:45.794449 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 812/1614] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:45.794449 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeda948-e36c-4edc-acd1-dede8bd1f749 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:45.794449 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeda948-e36c-4edc-acd1-dede8bd1f749 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:45.794449 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeda948-e36c-4edc-acd1-dede8bd1f749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:45.833876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4eeda948-e36c-4edc-acd1-dede8bd1f749 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:45.840458 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4eeda948-e36c-4edc-acd1-dede8bd1f749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:45.858274 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 813/1615] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:45.863074 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeda948-e36c-4edc-acd1-dede8bd1f749 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:45.867768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 803/1616] 10.222.0.48 () {58 vars in 1059 bytes} [Mon Jul 25 12:14:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:45.874796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeda948-e36c-4edc-acd1-dede8bd1f749 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:45.876551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5edda-a6ef-49f7-9d76-6ac4c324abb1 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:45.876724 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5edda-a6ef-49f7-9d76-6ac4c324abb1 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:45.876979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5edda-a6ef-49f7-9d76-6ac4c324abb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:45.880252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff03624-5147-4cfc-bc3d-7f258a5d2edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:45.881020 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff03624-5147-4cfc-bc3d-7f258a5d2edd admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:45.881369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff03624-5147-4cfc-bc3d-7f258a5d2edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:45.881716 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff03624-5147-4cfc-bc3d-7f258a5d2edd admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:45.882660 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff03624-5147-4cfc-bc3d-7f258a5d2edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:45.949479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff03624-5147-4cfc-bc3d-7f258a5d2edd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:45.949479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 814/1617] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:45.949479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff03624-5147-4cfc-bc3d-7f258a5d2edd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:45.949479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff03624-5147-4cfc-bc3d-7f258a5d2edd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:45.958406 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-15d5edda-a6ef-49f7-9d76-6ac4c324abb1 None None] MFA Rules not processed for user `75f6f185a2514cf08cbc8b4f0deb310e`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:45.958406 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-15d5edda-a6ef-49f7-9d76-6ac4c324abb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:45.959085 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc829f-a0e8-4b37-84a1-33c5ce8ffb4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:45.959085 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc829f-a0e8-4b37-84a1-33c5ce8ffb4b service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:45.959085 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc829f-a0e8-4b37-84a1-33c5ce8ffb4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:45.959085 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc829f-a0e8-4b37-84a1-33c5ce8ffb4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:45.959431 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc829f-a0e8-4b37-84a1-33c5ce8ffb4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:45.959431 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc829f-a0e8-4b37-84a1-33c5ce8ffb4b service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:45.975123 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 815/1618] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:14:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:14:45.976039 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc829f-a0e8-4b37-84a1-33c5ce8ffb4b service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:45.991609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc829f-a0e8-4b37-84a1-33c5ce8ffb4b service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:46.005913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d98581-c0fe-41d8-83e5-fc13703c61ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:46.006818 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d98581-c0fe-41d8-83e5-fc13703c61ad admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:46.007242 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d98581-c0fe-41d8-83e5-fc13703c61ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:46.007647 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d98581-c0fe-41d8-83e5-fc13703c61ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:46.008563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d98581-c0fe-41d8-83e5-fc13703c61ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:46.011438 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d98581-c0fe-41d8-83e5-fc13703c61ad admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:46.034308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 804/1619] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:46.035509 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5edda-a6ef-49f7-9d76-6ac4c324abb1 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:46.057412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5edda-a6ef-49f7-9d76-6ac4c324abb1 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:46.073504 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 816/1620] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:14:45 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:46.074768 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d98581-c0fe-41d8-83e5-fc13703c61ad admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:46.085057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646f15e-03c8-4206-82ca-e63e709c9c50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:46.087459 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646f15e-03c8-4206-82ca-e63e709c9c50 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:46.088023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646f15e-03c8-4206-82ca-e63e709c9c50 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:46.088283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646f15e-03c8-4206-82ca-e63e709c9c50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:46.159930 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646f15e-03c8-4206-82ca-e63e709c9c50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:46.161559 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646f15e-03c8-4206-82ca-e63e709c9c50 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:46.172211 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 805/1621] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:14:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:14:46.186552 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d98581-c0fe-41d8-83e5-fc13703c61ad admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:46.188194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646f15e-03c8-4206-82ca-e63e709c9c50 service nova] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:46.193953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c70ad-e9f9-4969-8793-417f24ae7cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:46.195152 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c70ad-e9f9-4969-8793-417f24ae7cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:46.195438 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c70ad-e9f9-4969-8793-417f24ae7cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:46.195718 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c70ad-e9f9-4969-8793-417f24ae7cc3 admin admin] PATH_INFO: `/v3/projects/af9ea293befa420f975f55e2001f4f6d/users/61a2fc04c4e344c697b31588d226485b/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:46.225354 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646f15e-03c8-4206-82ca-e63e709c9c50 service nova] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:46.225504 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c70ad-e9f9-4969-8793-417f24ae7cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af9ea293befa420f975f55e2001f4f6d, user_id=61a2fc04c4e344c697b31588d226485b, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:46.229096 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c70ad-e9f9-4969-8793-417f24ae7cc3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:46.255769 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 817/1622] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:14:46 2022] PUT /identity/v3/projects/af9ea293befa420f975f55e2001f4f6d/users/61a2fc04c4e344c697b31588d226485b/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:46.260594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c70ad-e9f9-4969-8793-417f24ae7cc3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:46.266753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:46.276318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:46.346927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70add6ce-facc-4022-b2e0-b5748746f322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:46.347602 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70add6ce-facc-4022-b2e0-b5748746f322 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:46.347885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70add6ce-facc-4022-b2e0-b5748746f322 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:46.348163 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70add6ce-facc-4022-b2e0-b5748746f322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:46.386870 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70add6ce-facc-4022-b2e0-b5748746f322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:46.389468 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70add6ce-facc-4022-b2e0-b5748746f322 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:46.389756 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c70ad-e9f9-4969-8793-417f24ae7cc3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:46.403828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf1959-9686-4594-a8f8-ead78e35a1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:46.406198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf1959-9686-4594-a8f8-ead78e35a1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:46.406492 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf1959-9686-4594-a8f8-ead78e35a1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:46.406771 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf1959-9686-4594-a8f8-ead78e35a1b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:46.409724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf1959-9686-4594-a8f8-ead78e35a1b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:46.419066 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf1959-9686-4594-a8f8-ead78e35a1b0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:46.427378 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 806/1623] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:14:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:14:46.428476 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70add6ce-facc-4022-b2e0-b5748746f322 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:46.455775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70add6ce-facc-4022-b2e0-b5748746f322 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:46.468350 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee64baf-5962-41d0-814a-f8e661e82157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:46.469153 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee64baf-5962-41d0-814a-f8e661e82157 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:46.469436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee64baf-5962-41d0-814a-f8e661e82157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:46.469849 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee64baf-5962-41d0-814a-f8e661e82157 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:46.470615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee64baf-5962-41d0-814a-f8e661e82157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:46.473200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee64baf-5962-41d0-814a-f8e661e82157 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:46.488119 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 818/1624] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:14:46 2022] POST /identity/v3/projects => generated 405 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:46.489232 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf1959-9686-4594-a8f8-ead78e35a1b0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:46.556710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 807/1625] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:14:46 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:46.561677 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee64baf-5962-41d0-814a-f8e661e82157 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:46.597449 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee64baf-5962-41d0-814a-f8e661e82157 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:46.739494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf1959-9686-4594-a8f8-ead78e35a1b0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:46.751916 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7fa33-7ef4-4fad-874f-f82c0f44d24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:46.752616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7fa33-7ef4-4fad-874f-f82c0f44d24a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:46.752899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7fa33-7ef4-4fad-874f-f82c0f44d24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:46.753176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7fa33-7ef4-4fad-874f-f82c0f44d24a admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:46.753918 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7fa33-7ef4-4fad-874f-f82c0f44d24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:46.759888 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7fa33-7ef4-4fad-874f-f82c0f44d24a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:46.789106 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 819/1626] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:46.791546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e18100-f03e-4800-8aa4-a40b47f5242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:46.792262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e18100-f03e-4800-8aa4-a40b47f5242b admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:46.792532 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e18100-f03e-4800-8aa4-a40b47f5242b admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:46.792808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e18100-f03e-4800-8aa4-a40b47f5242b admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:46.793513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e18100-f03e-4800-8aa4-a40b47f5242b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:46.795523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e18100-f03e-4800-8aa4-a40b47f5242b admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:46.798096 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7fa33-7ef4-4fad-874f-f82c0f44d24a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:46.816789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7fa33-7ef4-4fad-874f-f82c0f44d24a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:46.822945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e072a3-3123-4dda-9be3-12755de12eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:46.824584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e072a3-3123-4dda-9be3-12755de12eca admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:46.824887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e072a3-3123-4dda-9be3-12755de12eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:46.825166 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e072a3-3123-4dda-9be3-12755de12eca admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:46.825961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e072a3-3123-4dda-9be3-12755de12eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:46.827663 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e072a3-3123-4dda-9be3-12755de12eca admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:46.844262 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 820/1627] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:46.846610 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd617b2-6106-40e2-829d-3d97317cb0e7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:46.846960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd617b2-6106-40e2-829d-3d97317cb0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:46.847518 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd617b2-6106-40e2-829d-3d97317cb0e7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:46.849846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 821/1628] 10.222.0.48 () {54 vars in 912 bytes} [Mon Jul 25 12:14:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:14:46.850777 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd617b2-6106-40e2-829d-3d97317cb0e7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:46.867186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 808/1629] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:14:46 2022] POST /identity/v3/users => generated 309 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:46.867186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e18100-f03e-4800-8aa4-a40b47f5242b admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:46.867504 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd617b2-6106-40e2-829d-3d97317cb0e7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:46.874115 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab84b8-3444-439a-b82c-ba9cd9e11bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:46.875084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab84b8-3444-439a-b82c-ba9cd9e11bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:46.875376 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab84b8-3444-439a-b82c-ba9cd9e11bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:46.875657 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab84b8-3444-439a-b82c-ba9cd9e11bd7 admin admin] PATH_INFO: `/v3/projects/af9ea293befa420f975f55e2001f4f6d/users/61a2fc04c4e344c697b31588d226485b/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:46.879454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab84b8-3444-439a-b82c-ba9cd9e11bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af9ea293befa420f975f55e2001f4f6d, user_id=61a2fc04c4e344c697b31588d226485b, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:46.884761 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab84b8-3444-439a-b82c-ba9cd9e11bd7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:46.888870 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e18100-f03e-4800-8aa4-a40b47f5242b admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:46.898051 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbf631-266f-4c59-bb25-4396f262633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:46.900288 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbf631-266f-4c59-bb25-4396f262633a admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:46.900681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbf631-266f-4c59-bb25-4396f262633a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:46.900970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbf631-266f-4c59-bb25-4396f262633a admin admin] PATH_INFO: `/v3/projects/a783e9317e544fe0aa658e92d113af03/users/09ee6b0e839a4185aac0af1309ab07eb/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:46.920732 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 822/1630] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:14:46 2022] PUT /identity/v3/projects/af9ea293befa420f975f55e2001f4f6d/users/61a2fc04c4e344c697b31588d226485b/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:46.922353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f09d80-7cb7-498f-84fb-320ad28edddd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:46.922647 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f09d80-7cb7-498f-84fb-320ad28edddd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:46.922927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f09d80-7cb7-498f-84fb-320ad28edddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:46.936372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbf631-266f-4c59-bb25-4396f262633a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a783e9317e544fe0aa658e92d113af03, user_id=09ee6b0e839a4185aac0af1309ab07eb, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:46.940658 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbf631-266f-4c59-bb25-4396f262633a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:46.953742 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-85f09d80-7cb7-498f-84fb-320ad28edddd None None] MFA Rules not processed for user `6d9db26891a04b0bb7e655c21feeffdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:46.956121 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-85f09d80-7cb7-498f-84fb-320ad28edddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:46.976071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 809/1631] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:14:46 2022] PUT /identity/v3/projects/a783e9317e544fe0aa658e92d113af03/users/09ee6b0e839a4185aac0af1309ab07eb/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:46.978521 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbf631-266f-4c59-bb25-4396f262633a admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:47.064149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:47.093039 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 823/1632] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 12:14:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:47.097159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fb4ec-c708-4451-8e72-a123738d0a74 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:47.099160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fb4ec-c708-4451-8e72-a123738d0a74 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:47.099623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fb4ec-c708-4451-8e72-a123738d0a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:47.103838 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbf631-266f-4c59-bb25-4396f262633a admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:47.109950 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2bd04-b2a3-4654-9f2a-bbee683122e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:47.111977 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2bd04-b2a3-4654-9f2a-bbee683122e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:47.112613 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2bd04-b2a3-4654-9f2a-bbee683122e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:47.113222 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2bd04-b2a3-4654-9f2a-bbee683122e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:47.114208 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2bd04-b2a3-4654-9f2a-bbee683122e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:47.117580 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2bd04-b2a3-4654-9f2a-bbee683122e7 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:47.142247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 810/1633] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:47.143567 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2bd04-b2a3-4654-9f2a-bbee683122e7 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:47.170439 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2bd04-b2a3-4654-9f2a-bbee683122e7 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:47.174324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-387fb4ec-c708-4451-8e72-a123738d0a74 None None] MFA Rules not processed for user `61a2fc04c4e344c697b31588d226485b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:47.175574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-387fb4ec-c708-4451-8e72-a123738d0a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:47.175698 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a620c3-560b-4675-9ac4-9accaf833694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:47.176643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a620c3-560b-4675-9ac4-9accaf833694 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:47.177085 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a620c3-560b-4675-9ac4-9accaf833694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:47.177436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a620c3-560b-4675-9ac4-9accaf833694 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:47.178310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a620c3-560b-4675-9ac4-9accaf833694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:47.179979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a620c3-560b-4675-9ac4-9accaf833694 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:47.184122 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:47.199805 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 811/1634] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:47.200929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a620c3-560b-4675-9ac4-9accaf833694 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:47.298978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a620c3-560b-4675-9ac4-9accaf833694 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:47.305298 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57f3c3-6735-4e7e-91d5-0c28d1a32dab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:47.306158 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57f3c3-6735-4e7e-91d5-0c28d1a32dab service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:47.306546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57f3c3-6735-4e7e-91d5-0c28d1a32dab service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:47.307324 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57f3c3-6735-4e7e-91d5-0c28d1a32dab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:47.341942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 824/1635] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:47 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:47.342970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fb4ec-c708-4451-8e72-a123738d0a74 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:47.373468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fb4ec-c708-4451-8e72-a123738d0a74 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:47.387977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5753d-05ba-4b53-99d9-ced87b5d6c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:47.391475 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5753d-05ba-4b53-99d9-ced87b5d6c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:47.391644 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5753d-05ba-4b53-99d9-ced87b5d6c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:47.391923 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5753d-05ba-4b53-99d9-ced87b5d6c17 admin admin] PATH_INFO: `/v3/projects/9b57381ae42b4a21b4f7cb77ec4f6c0a/users/7fa2b29622344de2b00d4c4ba93786c7/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:47.458952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5753d-05ba-4b53-99d9-ced87b5d6c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b57381ae42b4a21b4f7cb77ec4f6c0a, user_id=7fa2b29622344de2b00d4c4ba93786c7, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:47.473022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5753d-05ba-4b53-99d9-ced87b5d6c17 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:47.489422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57f3c3-6735-4e7e-91d5-0c28d1a32dab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:47.493470 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57f3c3-6735-4e7e-91d5-0c28d1a32dab service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:47.500487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 825/1636] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:14:47 2022] PUT /identity/v3/projects/9b57381ae42b4a21b4f7cb77ec4f6c0a/users/7fa2b29622344de2b00d4c4ba93786c7/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:47.501615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5753d-05ba-4b53-99d9-ced87b5d6c17 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:47.522301 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 812/1637] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:14:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:14:47.524066 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57f3c3-6735-4e7e-91d5-0c28d1a32dab service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:47.545472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57f3c3-6735-4e7e-91d5-0c28d1a32dab service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:47.609331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5753d-05ba-4b53-99d9-ced87b5d6c17 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:47.622855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87013873-2bcd-4a20-bc9c-b9f52d1ba35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:47.625241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87013873-2bcd-4a20-bc9c-b9f52d1ba35e admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:47.625534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87013873-2bcd-4a20-bc9c-b9f52d1ba35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:47.630235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87013873-2bcd-4a20-bc9c-b9f52d1ba35e admin admin] PATH_INFO: `/v3/projects/a783e9317e544fe0aa658e92d113af03/users/09ee6b0e839a4185aac0af1309ab07eb/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:47.637707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87013873-2bcd-4a20-bc9c-b9f52d1ba35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a783e9317e544fe0aa658e92d113af03, user_id=09ee6b0e839a4185aac0af1309ab07eb, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:47.649904 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87013873-2bcd-4a20-bc9c-b9f52d1ba35e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:47.674718 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57958ae1-0b0f-4872-9528-76b9239ff9a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:47.677608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57958ae1-0b0f-4872-9528-76b9239ff9a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:47.677903 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57958ae1-0b0f-4872-9528-76b9239ff9a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:47.679656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57958ae1-0b0f-4872-9528-76b9239ff9a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:47.685354 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 826/1638] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:14:47 2022] PUT /identity/v3/projects/a783e9317e544fe0aa658e92d113af03/users/09ee6b0e839a4185aac0af1309ab07eb/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:47.689294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87013873-2bcd-4a20-bc9c-b9f52d1ba35e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:47.860061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:47.866090 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:47.888603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57958ae1-0b0f-4872-9528-76b9239ff9a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:47.890106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57958ae1-0b0f-4872-9528-76b9239ff9a9 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:47.895599 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87013873-2bcd-4a20-bc9c-b9f52d1ba35e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:47.910341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba567d8-7b55-4a31-8273-20310161b74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:47.911078 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba567d8-7b55-4a31-8273-20310161b74c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:47.911341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba567d8-7b55-4a31-8273-20310161b74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:47.911554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba567d8-7b55-4a31-8273-20310161b74c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:47.912373 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba567d8-7b55-4a31-8273-20310161b74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:47.914199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba567d8-7b55-4a31-8273-20310161b74c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:47.923775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 813/1639] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:14:47 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:14:47.928600 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a4c42-9dc0-4b7e-859f-5db523d2f36d None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:47.929516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a4c42-9dc0-4b7e-859f-5db523d2f36d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:47.934930 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a4c42-9dc0-4b7e-859f-5db523d2f36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:47.935576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 827/1640] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:47.936733 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba567d8-7b55-4a31-8273-20310161b74c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:47.947937 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba567d8-7b55-4a31-8273-20310161b74c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:47.953597 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d6368-d457-4350-ab19-6460b3261dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:47.954828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d6368-d457-4350-ab19-6460b3261dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:47.955291 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d6368-d457-4350-ab19-6460b3261dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:47.955900 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d6368-d457-4350-ab19-6460b3261dd9 admin admin] PATH_INFO: `/v3/projects/9b57381ae42b4a21b4f7cb77ec4f6c0a/users/7fa2b29622344de2b00d4c4ba93786c7/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:47.958238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d6368-d457-4350-ab19-6460b3261dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b57381ae42b4a21b4f7cb77ec4f6c0a, user_id=7fa2b29622344de2b00d4c4ba93786c7, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:47.961241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d6368-d457-4350-ab19-6460b3261dd9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:47.983465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 828/1641] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:14:47 2022] PUT /identity/v3/projects/9b57381ae42b4a21b4f7cb77ec4f6c0a/users/7fa2b29622344de2b00d4c4ba93786c7/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:47.994740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226dd8e-ebd7-4e98-bb1e-140bf9336c57 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:47.996236 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226dd8e-ebd7-4e98-bb1e-140bf9336c57 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:47.996873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226dd8e-ebd7-4e98-bb1e-140bf9336c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:48.015336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-c32a4c42-9dc0-4b7e-859f-5db523d2f36d None None] MFA Rules not processed for user `09ee6b0e839a4185aac0af1309ab07eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:48.018055 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c32a4c42-9dc0-4b7e-859f-5db523d2f36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:48.064153 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5226dd8e-ebd7-4e98-bb1e-140bf9336c57 None None] MFA Rules not processed for user `7fa2b29622344de2b00d4c4ba93786c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:48.065746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5226dd8e-ebd7-4e98-bb1e-140bf9336c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:48.181043 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 829/1642] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:47 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:48.182332 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226dd8e-ebd7-4e98-bb1e-140bf9336c57 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:48.233426 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 814/1643] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:48.258903 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226dd8e-ebd7-4e98-bb1e-140bf9336c57 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:48.264442 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc13a11-50bd-463f-a06f-90b33b8b3bc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:48.265106 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc13a11-50bd-463f-a06f-90b33b8b3bc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:48.265441 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc13a11-50bd-463f-a06f-90b33b8b3bc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:48.265720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc13a11-50bd-463f-a06f-90b33b8b3bc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:48.402795 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc13a11-50bd-463f-a06f-90b33b8b3bc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:48.405223 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc13a11-50bd-463f-a06f-90b33b8b3bc8 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:48.428231 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 830/1644] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:14:48 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:14:48.454441 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a4c42-9dc0-4b7e-859f-5db523d2f36d None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:48.472532 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a4c42-9dc0-4b7e-859f-5db523d2f36d None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:48.482453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52839f63-9c2a-4f02-9b7c-49962b9bd502 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:48.483137 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52839f63-9c2a-4f02-9b7c-49962b9bd502 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:48.483422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52839f63-9c2a-4f02-9b7c-49962b9bd502 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:48.483699 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52839f63-9c2a-4f02-9b7c-49962b9bd502 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:48.518850 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52839f63-9c2a-4f02-9b7c-49962b9bd502 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:48.528945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52839f63-9c2a-4f02-9b7c-49962b9bd502 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:48.568619 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 815/1645] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:14:48 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:14:48.917803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc13a11-50bd-463f-a06f-90b33b8b3bc8 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:48.935496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc13a11-50bd-463f-a06f-90b33b8b3bc8 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:48.949886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909861a-ff15-40d3-b7f0-e3bf523fee62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:48.952963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909861a-ff15-40d3-b7f0-e3bf523fee62 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:48.955646 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909861a-ff15-40d3-b7f0-e3bf523fee62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:48.955945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909861a-ff15-40d3-b7f0-e3bf523fee62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:48.998611 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909861a-ff15-40d3-b7f0-e3bf523fee62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:49.009866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909861a-ff15-40d3-b7f0-e3bf523fee62 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:49.032144 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:49.048885 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 831/1646] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:14:48 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:14:49.306983 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52839f63-9c2a-4f02-9b7c-49962b9bd502 service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:49.318593 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52839f63-9c2a-4f02-9b7c-49962b9bd502 service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:49.327060 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641441d3-107c-44fd-a54f-6f055da33c25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:49.327667 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641441d3-107c-44fd-a54f-6f055da33c25 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:49.327989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641441d3-107c-44fd-a54f-6f055da33c25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:49.328268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641441d3-107c-44fd-a54f-6f055da33c25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:49.377850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909861a-ff15-40d3-b7f0-e3bf523fee62 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:49.559715 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641441d3-107c-44fd-a54f-6f055da33c25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:49.563465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641441d3-107c-44fd-a54f-6f055da33c25 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:49.585225 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 816/1647] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:14:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:14:49.636628 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909861a-ff15-40d3-b7f0-e3bf523fee62 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:49.658242 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46c2ed-6c80-4716-96bc-f49e294ef2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:49.661992 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46c2ed-6c80-4716-96bc-f49e294ef2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:49.662420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46c2ed-6c80-4716-96bc-f49e294ef2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:49.662807 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46c2ed-6c80-4716-96bc-f49e294ef2e9 admin admin] PATH_INFO: `/v3/users/75f6f185a2514cf08cbc8b4f0deb310e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:49.667576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46c2ed-6c80-4716-96bc-f49e294ef2e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f6f185a2514cf08cbc8b4f0deb310e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:49.668829 dv-cinder-797608-61-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-8c46c2ed-6c80-4716-96bc-f49e294ef2e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:14:49.668829 dv-cinder-797608-61-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 25 12:14:49.668829 dv-cinder-797608-61-smb devstack@keystone.service[80316]: Jul 25 12:14:49.670934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46c2ed-6c80-4716-96bc-f49e294ef2e9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:49.925970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8c46c2ed-6c80-4716-96bc-f49e294ef2e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f6f185a2514cf08cbc8b4f0deb310e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:49.927650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8c46c2ed-6c80-4716-96bc-f49e294ef2e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f6f185a2514cf08cbc8b4f0deb310e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:49.928415 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7e7b7-ce14-4e67-a522-37aadcf0b0bd None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:49.928886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8c46c2ed-6c80-4716-96bc-f49e294ef2e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f6f185a2514cf08cbc8b4f0deb310e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:49.929203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7e7b7-ce14-4e67-a522-37aadcf0b0bd None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:49.929663 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7e7b7-ce14-4e67-a522-37aadcf0b0bd None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:49.932088 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 817/1648] 10.222.0.48 () {54 vars in 962 bytes} [Mon Jul 25 12:14:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:14:49.943737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f0869-db19-4797-bec0-df1f7ad6a2ef None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:49.944025 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f0869-db19-4797-bec0-df1f7ad6a2ef None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:49.944300 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f0869-db19-4797-bec0-df1f7ad6a2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:49.997686 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8c46c2ed-6c80-4716-96bc-f49e294ef2e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f6f185a2514cf08cbc8b4f0deb310e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:50.016485 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8c46c2ed-6c80-4716-96bc-f49e294ef2e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f6f185a2514cf08cbc8b4f0deb310e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:50.017979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-5e2f0869-db19-4797-bec0-df1f7ad6a2ef None None] MFA Rules not processed for user `6d9db26891a04b0bb7e655c21feeffdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:50.019403 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5e2f0869-db19-4797-bec0-df1f7ad6a2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:50.075071 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 832/1649] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:14:49 2022] DELETE /identity/v3/users/75f6f185a2514cf08cbc8b4f0deb310e => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:14:50.080154 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0e532-f39d-449e-b83d-0066263e4f4c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:50.082191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0e532-f39d-449e-b83d-0066263e4f4c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:50.083139 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0e532-f39d-449e-b83d-0066263e4f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:50.152043 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-11c0e532-f39d-449e-b83d-0066263e4f4c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:50.153741 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-11c0e532-f39d-449e-b83d-0066263e4f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:50.217425 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:50.276244 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 818/1650] 10.222.0.48 () {58 vars in 1059 bytes} [Mon Jul 25 12:14:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 25 12:14:50.281865 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e3df8-1830-4614-8fc5-c60301324792 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:50.282319 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e3df8-1830-4614-8fc5-c60301324792 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:50.282707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e3df8-1830-4614-8fc5-c60301324792 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:50.284800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 819/1651] 10.222.0.48 () {54 vars in 912 bytes} [Mon Jul 25 12:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:14:50.293372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351eaa7-4d9b-4fc7-99ef-68a7f289e979 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:50.293960 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351eaa7-4d9b-4fc7-99ef-68a7f289e979 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:50.294794 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351eaa7-4d9b-4fc7-99ef-68a7f289e979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:50.349349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 833/1652] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:50.360221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-f351eaa7-4d9b-4fc7-99ef-68a7f289e979 None None] MFA Rules not processed for user `6d9db26891a04b0bb7e655c21feeffdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:50.363158 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-f351eaa7-4d9b-4fc7-99ef-68a7f289e979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:50.394483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0e532-f39d-449e-b83d-0066263e4f4c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:50.396014 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-11c0e532-f39d-449e-b83d-0066263e4f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:50.454677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:50.543522 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0e532-f39d-449e-b83d-0066263e4f4c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:50.556822 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae454a8-6442-41d5-8dc6-b6016eff3dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:50.557673 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae454a8-6442-41d5-8dc6-b6016eff3dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:50.558400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae454a8-6442-41d5-8dc6-b6016eff3dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:50.559580 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae454a8-6442-41d5-8dc6-b6016eff3dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:50.578769 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae454a8-6442-41d5-8dc6-b6016eff3dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:50.585314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae454a8-6442-41d5-8dc6-b6016eff3dd1 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:50.614707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 834/1653] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:14:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:14:50.616715 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 820/1654] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 12:14:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:14:50.633795 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae454a8-6442-41d5-8dc6-b6016eff3dd1 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:50.636665 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4ae454a8-6442-41d5-8dc6-b6016eff3dd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:50.795350 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae454a8-6442-41d5-8dc6-b6016eff3dd1 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:50.807387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00beda3b-f7f7-468d-98b0-277222fea4a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:50.808326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beda3b-f7f7-468d-98b0-277222fea4a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:50.808606 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beda3b-f7f7-468d-98b0-277222fea4a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:50.808877 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beda3b-f7f7-468d-98b0-277222fea4a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:50.834173 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00beda3b-f7f7-468d-98b0-277222fea4a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:50.837656 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00beda3b-f7f7-468d-98b0-277222fea4a5 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:50.866518 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 835/1655] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:14:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:14:51.905389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351eaa7-4d9b-4fc7-99ef-68a7f289e979 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:51.911873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-f351eaa7-4d9b-4fc7-99ef-68a7f289e979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:51.951158 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351eaa7-4d9b-4fc7-99ef-68a7f289e979 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:51.965732 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459f7a8-06cc-4f31-b3f8-2e31be13c5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:51.972271 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459f7a8-06cc-4f31-b3f8-2e31be13c5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:51.972793 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459f7a8-06cc-4f31-b3f8-2e31be13c5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:51.973201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459f7a8-06cc-4f31-b3f8-2e31be13c5e3 admin admin] PATH_INFO: `/v3/projects/f144cb098e0f4e44a4b89dcd3a3299e6` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:51.979006 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459f7a8-06cc-4f31-b3f8-2e31be13c5e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f144cb098e0f4e44a4b89dcd3a3299e6)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:51.980328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: WARNING py.warnings [None req-9459f7a8-06cc-4f31-b3f8-2e31be13c5e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:14:51.980328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: warnings.warn(msg) Jul 25 12:14:51.980328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: Jul 25 12:14:51.981888 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459f7a8-06cc-4f31-b3f8-2e31be13c5e3 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:52.107799 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9459f7a8-06cc-4f31-b3f8-2e31be13c5e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f144cb098e0f4e44a4b89dcd3a3299e6', 'request_id': 'req-9459f7a8-06cc-4f31-b3f8-2e31be13c5e3'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:52.129200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9459f7a8-06cc-4f31-b3f8-2e31be13c5e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f144cb098e0f4e44a4b89dcd3a3299e6', 'request_id': 'req-9459f7a8-06cc-4f31-b3f8-2e31be13c5e3'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:52.146914 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9459f7a8-06cc-4f31-b3f8-2e31be13c5e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f144cb098e0f4e44a4b89dcd3a3299e6', 'request_id': 'req-9459f7a8-06cc-4f31-b3f8-2e31be13c5e3'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:52.249817 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9459f7a8-06cc-4f31-b3f8-2e31be13c5e3 admin admin] The token cache is being invalidate because project f144cb098e0f4e44a4b89dcd3a3299e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:14:52.250967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9459f7a8-06cc-4f31-b3f8-2e31be13c5e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:52.252915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9459f7a8-06cc-4f31-b3f8-2e31be13c5e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:52.257350 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 821/1656] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:14:51 2022] DELETE /identity/v3/projects/f144cb098e0f4e44a4b89dcd3a3299e6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:52.261702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00beda3b-f7f7-468d-98b0-277222fea4a5 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:52.276902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00beda3b-f7f7-468d-98b0-277222fea4a5 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:52.468027 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6da194-fdc4-440c-8cae-52b31cb87727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:52.468936 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6da194-fdc4-440c-8cae-52b31cb87727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:52.469216 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6da194-fdc4-440c-8cae-52b31cb87727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:52.469485 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6da194-fdc4-440c-8cae-52b31cb87727 admin admin] PATH_INFO: `/v3/users/7fa2b29622344de2b00d4c4ba93786c7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:52.470830 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6da194-fdc4-440c-8cae-52b31cb87727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa2b29622344de2b00d4c4ba93786c7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:52.472819 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6da194-fdc4-440c-8cae-52b31cb87727 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:52.627561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9d6da194-fdc4-440c-8cae-52b31cb87727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa2b29622344de2b00d4c4ba93786c7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:52.628662 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9d6da194-fdc4-440c-8cae-52b31cb87727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa2b29622344de2b00d4c4ba93786c7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:52.636205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9d6da194-fdc4-440c-8cae-52b31cb87727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa2b29622344de2b00d4c4ba93786c7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:52.669264 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9d6da194-fdc4-440c-8cae-52b31cb87727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa2b29622344de2b00d4c4ba93786c7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:52.677268 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:52.693134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9d6da194-fdc4-440c-8cae-52b31cb87727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa2b29622344de2b00d4c4ba93786c7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:52.726136 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 836/1657] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:14:52 2022] DELETE /identity/v3/users/7fa2b29622344de2b00d4c4ba93786c7 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:53.780459 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bbb64-8acc-4c7d-9db4-61fc9f54db9d None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:53.780911 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bbb64-8acc-4c7d-9db4-61fc9f54db9d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:53.781053 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bbb64-8acc-4c7d-9db4-61fc9f54db9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:53.895823 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6da194-fdc4-440c-8cae-52b31cb87727 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:53.898061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-980bbb64-8acc-4c7d-9db4-61fc9f54db9d None None] MFA Rules not processed for user `0dd62c26ee6a438495abdc3ca489b85e`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:53.899800 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9d6da194-fdc4-440c-8cae-52b31cb87727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:53.906651 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-980bbb64-8acc-4c7d-9db4-61fc9f54db9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:54.070443 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:54.092971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 822/1658] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:54.107231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bbb64-8acc-4c7d-9db4-61fc9f54db9d None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:54.109193 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-980bbb64-8acc-4c7d-9db4-61fc9f54db9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:54.160127 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6da194-fdc4-440c-8cae-52b31cb87727 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:54.187532 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca651ce-03ce-4a42-bbeb-f0d361e2f6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:54.190514 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca651ce-03ce-4a42-bbeb-f0d361e2f6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:54.190946 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca651ce-03ce-4a42-bbeb-f0d361e2f6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:54.193310 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca651ce-03ce-4a42-bbeb-f0d361e2f6ba admin admin] PATH_INFO: `/v3/projects/9b57381ae42b4a21b4f7cb77ec4f6c0a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:54.197308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca651ce-03ce-4a42-bbeb-f0d361e2f6ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b57381ae42b4a21b4f7cb77ec4f6c0a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:54.203394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca651ce-03ce-4a42-bbeb-f0d361e2f6ba admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:54.306308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bbb64-8acc-4c7d-9db4-61fc9f54db9d None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:54.312989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6ca651ce-03ce-4a42-bbeb-f0d361e2f6ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b57381ae42b4a21b4f7cb77ec4f6c0a', 'request_id': 'req-6ca651ce-03ce-4a42-bbeb-f0d361e2f6ba'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:54.335328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6ca651ce-03ce-4a42-bbeb-f0d361e2f6ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b57381ae42b4a21b4f7cb77ec4f6c0a', 'request_id': 'req-6ca651ce-03ce-4a42-bbeb-f0d361e2f6ba'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:54.343417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6ca651ce-03ce-4a42-bbeb-f0d361e2f6ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b57381ae42b4a21b4f7cb77ec4f6c0a', 'request_id': 'req-6ca651ce-03ce-4a42-bbeb-f0d361e2f6ba'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:54.362288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6ca651ce-03ce-4a42-bbeb-f0d361e2f6ba admin admin] The token cache is being invalidate because project 9b57381ae42b4a21b4f7cb77ec4f6c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:14:54.374534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6ca651ce-03ce-4a42-bbeb-f0d361e2f6ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:54.375645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6ca651ce-03ce-4a42-bbeb-f0d361e2f6ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:54.380642 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 837/1659] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:14:53 2022] DELETE /identity/v3/projects/9b57381ae42b4a21b4f7cb77ec4f6c0a => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:54.385426 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cb72c-6042-4d9b-9e4f-306461855a89 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:54.385878 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cb72c-6042-4d9b-9e4f-306461855a89 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:54.386573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cb72c-6042-4d9b-9e4f-306461855a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:54.411222 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455ea61-019c-438a-952f-054c56d14b11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:54.411913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455ea61-019c-438a-952f-054c56d14b11 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:54.412192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455ea61-019c-438a-952f-054c56d14b11 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:54.412469 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455ea61-019c-438a-952f-054c56d14b11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:54.433634 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-449cb72c-6042-4d9b-9e4f-306461855a89 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:54.436629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-9455ea61-019c-438a-952f-054c56d14b11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:54.442217 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-449cb72c-6042-4d9b-9e4f-306461855a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:54.577409 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 838/1660] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:54.578278 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfb379-a261-48ee-96c7-f8a78663c922 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:54.578579 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfb379-a261-48ee-96c7-f8a78663c922 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:54.578863 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfb379-a261-48ee-96c7-f8a78663c922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:54.649882 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-73cfb379-a261-48ee-96c7-f8a78663c922 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:54.653445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-73cfb379-a261-48ee-96c7-f8a78663c922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:54.661861 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455ea61-019c-438a-952f-054c56d14b11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:54.663698 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455ea61-019c-438a-952f-054c56d14b11 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:54.675555 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 839/1661] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:54.684105 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfb379-a261-48ee-96c7-f8a78663c922 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:54.687574 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 823/1662] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:14:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:14:54.737876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfb379-a261-48ee-96c7-f8a78663c922 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:54.763238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd65d6-21fc-4c2b-9a17-a3b264e87def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:54.763952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd65d6-21fc-4c2b-9a17-a3b264e87def admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:54.764393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd65d6-21fc-4c2b-9a17-a3b264e87def admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:54.764660 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd65d6-21fc-4c2b-9a17-a3b264e87def admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:54.765468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd65d6-21fc-4c2b-9a17-a3b264e87def admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:14:54.765785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd65d6-21fc-4c2b-9a17-a3b264e87def admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:54.767861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd65d6-21fc-4c2b-9a17-a3b264e87def admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:54.774472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:54.807246 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 840/1663] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:14:54.813163 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455ea61-019c-438a-952f-054c56d14b11 service nova] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:54.828335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455ea61-019c-438a-952f-054c56d14b11 service nova] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:54.844518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b953d0-8632-41f0-9a33-f27d9cf744c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:54.845395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b953d0-8632-41f0-9a33-f27d9cf744c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:54.845470 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b953d0-8632-41f0-9a33-f27d9cf744c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:54.845743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b953d0-8632-41f0-9a33-f27d9cf744c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:54.846478 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b953d0-8632-41f0-9a33-f27d9cf744c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:54.850357 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b953d0-8632-41f0-9a33-f27d9cf744c0 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:54.932246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 824/1664] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:14:54 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:54.936592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd65d6-21fc-4c2b-9a17-a3b264e87def admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:54.948530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd65d6-21fc-4c2b-9a17-a3b264e87def admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:55.153157 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08162715-617e-4789-a03b-1eb81904bef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:55.157180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08162715-617e-4789-a03b-1eb81904bef1 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:55.157785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08162715-617e-4789-a03b-1eb81904bef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:55.158306 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08162715-617e-4789-a03b-1eb81904bef1 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:55.159247 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08162715-617e-4789-a03b-1eb81904bef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:55.161777 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08162715-617e-4789-a03b-1eb81904bef1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:55.263286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b953d0-8632-41f0-9a33-f27d9cf744c0 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:55.267989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 841/1665] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:14:54 2022] POST /identity/v3/users => generated 293 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:55.282659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b953d0-8632-41f0-9a33-f27d9cf744c0 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:55.295209 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb738d-9181-41a6-9f24-8c2e764698ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:55.297057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb738d-9181-41a6-9f24-8c2e764698ef admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:55.297348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb738d-9181-41a6-9f24-8c2e764698ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:55.297627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb738d-9181-41a6-9f24-8c2e764698ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:55.298413 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb738d-9181-41a6-9f24-8c2e764698ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:55.304175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb738d-9181-41a6-9f24-8c2e764698ef admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:55.311844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:55.334670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 825/1666] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:14:55.336115 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08162715-617e-4789-a03b-1eb81904bef1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:55.359228 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08162715-617e-4789-a03b-1eb81904bef1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:55.385301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064b8aa-57f2-4678-b188-b27df50ed863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:55.386022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064b8aa-57f2-4678-b188-b27df50ed863 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:55.386326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064b8aa-57f2-4678-b188-b27df50ed863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:55.386601 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064b8aa-57f2-4678-b188-b27df50ed863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:55.388030 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064b8aa-57f2-4678-b188-b27df50ed863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:55.389027 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064b8aa-57f2-4678-b188-b27df50ed863 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:55.453369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 842/1667] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:55.458385 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb738d-9181-41a6-9f24-8c2e764698ef admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:55.475218 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb738d-9181-41a6-9f24-8c2e764698ef admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:55.488334 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb06ef-63e0-49b0-9771-a6402c37edeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:55.490318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb06ef-63e0-49b0-9771-a6402c37edeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:55.490821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb06ef-63e0-49b0-9771-a6402c37edeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:55.491308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb06ef-63e0-49b0-9771-a6402c37edeb admin admin] PATH_INFO: `/v3/projects/417570024ad344e2ae25dbb8221159df/users/721fde12ae1343949f9062f0c73fd0ee/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:55.539892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb06ef-63e0-49b0-9771-a6402c37edeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=417570024ad344e2ae25dbb8221159df, user_id=721fde12ae1343949f9062f0c73fd0ee, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:55.546731 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb06ef-63e0-49b0-9771-a6402c37edeb admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:55.570242 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064b8aa-57f2-4678-b188-b27df50ed863 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:55.572847 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b064b8aa-57f2-4678-b188-b27df50ed863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:55.583188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 826/1668] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:14:55 2022] PUT /identity/v3/projects/417570024ad344e2ae25dbb8221159df/users/721fde12ae1343949f9062f0c73fd0ee/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:55.597722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058093bf-0d19-4e01-b2f2-de053a153e0d None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:55.598056 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058093bf-0d19-4e01-b2f2-de053a153e0d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:55.598350 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058093bf-0d19-4e01-b2f2-de053a153e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:55.604180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064b8aa-57f2-4678-b188-b27df50ed863 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:55.680992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-058093bf-0d19-4e01-b2f2-de053a153e0d None None] MFA Rules not processed for user `721fde12ae1343949f9062f0c73fd0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:55.682279 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-058093bf-0d19-4e01-b2f2-de053a153e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:55.746929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4a727-d504-4034-9bae-750c6c0fa3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:55.748061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4a727-d504-4034-9bae-750c6c0fa3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:55.748518 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4a727-d504-4034-9bae-750c6c0fa3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:55.748929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4a727-d504-4034-9bae-750c6c0fa3fa admin admin] PATH_INFO: `/v3/users/3e254a86245a4a739ce9c61a3498feab` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:55.750570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4a727-d504-4034-9bae-750c6c0fa3fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e254a86245a4a739ce9c61a3498feab)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:55.752694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4a727-d504-4034-9bae-750c6c0fa3fa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:55.856285 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 827/1669] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:55.861324 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058093bf-0d19-4e01-b2f2-de053a153e0d None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:55.900183 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-afe4a727-d504-4034-9bae-750c6c0fa3fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e254a86245a4a739ce9c61a3498feab'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:55.901943 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058093bf-0d19-4e01-b2f2-de053a153e0d None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:55.902456 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-afe4a727-d504-4034-9bae-750c6c0fa3fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e254a86245a4a739ce9c61a3498feab'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:55.903914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-afe4a727-d504-4034-9bae-750c6c0fa3fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e254a86245a4a739ce9c61a3498feab'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:55.915746 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d934e2f-94a6-4fd5-a53b-5c0da2d5e473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:55.916707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d934e2f-94a6-4fd5-a53b-5c0da2d5e473 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:55.919118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d934e2f-94a6-4fd5-a53b-5c0da2d5e473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:55.920004 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d934e2f-94a6-4fd5-a53b-5c0da2d5e473 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:55.922218 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d934e2f-94a6-4fd5-a53b-5c0da2d5e473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:55.927611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d934e2f-94a6-4fd5-a53b-5c0da2d5e473 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:55.936320 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-afe4a727-d504-4034-9bae-750c6c0fa3fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e254a86245a4a739ce9c61a3498feab'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:55.955463 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-afe4a727-d504-4034-9bae-750c6c0fa3fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e254a86245a4a739ce9c61a3498feab'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:55.965106 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:55.984856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 843/1670] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:14:55 2022] DELETE /identity/v3/users/3e254a86245a4a739ce9c61a3498feab => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:55.989535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87222b-0f22-4a50-a1c4-b5defa6eb6dc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:55.989888 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87222b-0f22-4a50-a1c4-b5defa6eb6dc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:55.990730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87222b-0f22-4a50-a1c4-b5defa6eb6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:56.010293 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 828/1671] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:14:55 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:56.012180 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d934e2f-94a6-4fd5-a53b-5c0da2d5e473 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:56.017339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-1d934e2f-94a6-4fd5-a53b-5c0da2d5e473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:56.048403 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bf87222b-0f22-4a50-a1c4-b5defa6eb6dc None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:56.052437 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bf87222b-0f22-4a50-a1c4-b5defa6eb6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:56.225910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d934e2f-94a6-4fd5-a53b-5c0da2d5e473 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:56.242295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792cb17-6962-4dbb-99d0-a8d8aae6a56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:56.245013 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792cb17-6962-4dbb-99d0-a8d8aae6a56f admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:56.245302 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792cb17-6962-4dbb-99d0-a8d8aae6a56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:56.248433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792cb17-6962-4dbb-99d0-a8d8aae6a56f admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:56.250343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792cb17-6962-4dbb-99d0-a8d8aae6a56f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:56.250913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 844/1672] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:14:56.252584 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792cb17-6962-4dbb-99d0-a8d8aae6a56f admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:56.280954 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 829/1673] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:14:56 2022] POST /identity/v3/users => generated 299 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:56.284671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87222b-0f22-4a50-a1c4-b5defa6eb6dc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:56.298797 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792cb17-6962-4dbb-99d0-a8d8aae6a56f admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:56.301970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-f792cb17-6962-4dbb-99d0-a8d8aae6a56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:56.303900 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87222b-0f22-4a50-a1c4-b5defa6eb6dc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:56.323235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cd010-1926-49d2-b4a9-05a13f77d140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:56.324023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cd010-1926-49d2-b4a9-05a13f77d140 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:56.325915 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cd010-1926-49d2-b4a9-05a13f77d140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:56.326915 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cd010-1926-49d2-b4a9-05a13f77d140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:56.328803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cd010-1926-49d2-b4a9-05a13f77d140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:56.334401 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cd010-1926-49d2-b4a9-05a13f77d140 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:56.368177 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 845/1674] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:14:56.374303 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cd010-1926-49d2-b4a9-05a13f77d140 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:56.416697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cd010-1926-49d2-b4a9-05a13f77d140 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:56.422287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:56.424341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851daa2-6c1c-4299-bff2-6736f4c721cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:56.425952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851daa2-6c1c-4299-bff2-6736f4c721cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:56.426634 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851daa2-6c1c-4299-bff2-6736f4c721cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:56.427142 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851daa2-6c1c-4299-bff2-6736f4c721cc admin admin] PATH_INFO: `/v3/projects/5fb1d27e5bd0455c95c8d3f255399aed/users/2cbb406fd2784c5c8c864a0a35bf5f3c/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:56.483298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851daa2-6c1c-4299-bff2-6736f4c721cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb1d27e5bd0455c95c8d3f255399aed, user_id=2cbb406fd2784c5c8c864a0a35bf5f3c, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:56.487861 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792cb17-6962-4dbb-99d0-a8d8aae6a56f admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:56.493532 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851daa2-6c1c-4299-bff2-6736f4c721cc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:56.513441 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f1c60-082f-4ae2-a52a-369142b897fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:56.514579 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f1c60-082f-4ae2-a52a-369142b897fe service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:56.514879 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f1c60-082f-4ae2-a52a-369142b897fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:56.515162 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f1c60-082f-4ae2-a52a-369142b897fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:56.520513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 846/1675] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:14:56 2022] PUT /identity/v3/projects/5fb1d27e5bd0455c95c8d3f255399aed/users/2cbb406fd2784c5c8c864a0a35bf5f3c/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:56.525498 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851daa2-6c1c-4299-bff2-6736f4c721cc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:56.544642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f1c60-082f-4ae2-a52a-369142b897fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:56.556976 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f1c60-082f-4ae2-a52a-369142b897fe service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:56.590654 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 830/1676] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:14:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:14:56.690837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851daa2-6c1c-4299-bff2-6736f4c721cc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:56.716765 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952b352-180e-432c-9b20-ebbc3d26c473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:56.717647 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952b352-180e-432c-9b20-ebbc3d26c473 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:56.718097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952b352-180e-432c-9b20-ebbc3d26c473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:56.718698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952b352-180e-432c-9b20-ebbc3d26c473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:56.719813 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952b352-180e-432c-9b20-ebbc3d26c473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:56.722293 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952b352-180e-432c-9b20-ebbc3d26c473 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:56.751524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 847/1677] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:14:56.753067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f1c60-082f-4ae2-a52a-369142b897fe service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:56.764541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f1c60-082f-4ae2-a52a-369142b897fe service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:56.803812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6b667-75a1-4ea8-b580-fc1608609e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:56.805812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6b667-75a1-4ea8-b580-fc1608609e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:56.806239 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6b667-75a1-4ea8-b580-fc1608609e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:56.806622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6b667-75a1-4ea8-b580-fc1608609e10 admin admin] PATH_INFO: `/v3/projects/5fb1d27e5bd0455c95c8d3f255399aed/users/2cbb406fd2784c5c8c864a0a35bf5f3c/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:56.820049 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6b667-75a1-4ea8-b580-fc1608609e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb1d27e5bd0455c95c8d3f255399aed, user_id=2cbb406fd2784c5c8c864a0a35bf5f3c, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:56.837231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6b667-75a1-4ea8-b580-fc1608609e10 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:56.866253 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 831/1678] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:14:56 2022] PUT /identity/v3/projects/5fb1d27e5bd0455c95c8d3f255399aed/users/2cbb406fd2784c5c8c864a0a35bf5f3c/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:56.876774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae654c6-d995-4a5d-ae69-5f4cd9d31339 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:56.877286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae654c6-d995-4a5d-ae69-5f4cd9d31339 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:56.877705 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae654c6-d995-4a5d-ae69-5f4cd9d31339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:56.986980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2ae654c6-d995-4a5d-ae69-5f4cd9d31339 None None] MFA Rules not processed for user `2cbb406fd2784c5c8c864a0a35bf5f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:56.989081 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2ae654c6-d995-4a5d-ae69-5f4cd9d31339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:57.119494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:57.199634 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 848/1679] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:14:57.211820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6b667-75a1-4ea8-b580-fc1608609e10 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:57.213687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d2f6b667-75a1-4ea8-b580-fc1608609e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:57.425108 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6b667-75a1-4ea8-b580-fc1608609e10 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:57.436430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb99c32-02a2-4667-9f8c-45878b02c3f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:57.437111 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb99c32-02a2-4667-9f8c-45878b02c3f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:57.437398 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb99c32-02a2-4667-9f8c-45878b02c3f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:57.437677 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb99c32-02a2-4667-9f8c-45878b02c3f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:57.457030 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb99c32-02a2-4667-9f8c-45878b02c3f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:57.458546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb99c32-02a2-4667-9f8c-45878b02c3f1 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:57.475982 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 832/1680] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:14:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:14:57.534555 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae654c6-d995-4a5d-ae69-5f4cd9d31339 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:57.685340 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae654c6-d995-4a5d-ae69-5f4cd9d31339 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:57.694214 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e15211-b884-49a9-ae55-6571b9ca7ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:57.695405 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e15211-b884-49a9-ae55-6571b9ca7ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:57.695693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e15211-b884-49a9-ae55-6571b9ca7ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:57.697738 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e15211-b884-49a9-ae55-6571b9ca7ea2 admin admin] PATH_INFO: `/v3/users/721fde12ae1343949f9062f0c73fd0ee` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:57.699473 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e15211-b884-49a9-ae55-6571b9ca7ea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=721fde12ae1343949f9062f0c73fd0ee)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:57.708981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e15211-b884-49a9-ae55-6571b9ca7ea2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:57.833143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a0e15211-b884-49a9-ae55-6571b9ca7ea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '721fde12ae1343949f9062f0c73fd0ee'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:57.834063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a0e15211-b884-49a9-ae55-6571b9ca7ea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '721fde12ae1343949f9062f0c73fd0ee'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:57.835452 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a0e15211-b884-49a9-ae55-6571b9ca7ea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '721fde12ae1343949f9062f0c73fd0ee'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:57.875426 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a0e15211-b884-49a9-ae55-6571b9ca7ea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '721fde12ae1343949f9062f0c73fd0ee'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:57.895749 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a0e15211-b884-49a9-ae55-6571b9ca7ea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '721fde12ae1343949f9062f0c73fd0ee'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:57.921143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 849/1681] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:14:57 2022] DELETE /identity/v3/users/721fde12ae1343949f9062f0c73fd0ee => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:57.926601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee818f32-d3d4-4931-9939-98bea3f13715 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:57.927023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee818f32-d3d4-4931-9939-98bea3f13715 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:57.927333 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee818f32-d3d4-4931-9939-98bea3f13715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:57.981273 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-ee818f32-d3d4-4931-9939-98bea3f13715 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:57.986460 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ee818f32-d3d4-4931-9939-98bea3f13715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:58.175103 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 833/1682] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:14:58.218194 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e15211-b884-49a9-ae55-6571b9ca7ea2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:58.220400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a0e15211-b884-49a9-ae55-6571b9ca7ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:58.340124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e15211-b884-49a9-ae55-6571b9ca7ea2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:58.349593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b23ec7-c5e2-450d-b27b-4074a163618b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:58.350432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b23ec7-c5e2-450d-b27b-4074a163618b service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:58.350719 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b23ec7-c5e2-450d-b27b-4074a163618b service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:58.351003 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b23ec7-c5e2-450d-b27b-4074a163618b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:58.370713 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b23ec7-c5e2-450d-b27b-4074a163618b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:58.373677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b23ec7-c5e2-450d-b27b-4074a163618b service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:58.395982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 850/1683] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:14:59.093168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee818f32-d3d4-4931-9939-98bea3f13715 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:59.095798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ee818f32-d3d4-4931-9939-98bea3f13715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:59.111774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee818f32-d3d4-4931-9939-98bea3f13715 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:59.122202 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751e8a3-90f4-4a4b-9b16-c32e0b56c1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:59.123926 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751e8a3-90f4-4a4b-9b16-c32e0b56c1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:59.124432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751e8a3-90f4-4a4b-9b16-c32e0b56c1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:59.124908 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751e8a3-90f4-4a4b-9b16-c32e0b56c1a7 admin admin] PATH_INFO: `/v3/projects/99b5171d70c049029b3318fd7f2c1f7c` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:59.127336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751e8a3-90f4-4a4b-9b16-c32e0b56c1a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b5171d70c049029b3318fd7f2c1f7c)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:59.130064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751e8a3-90f4-4a4b-9b16-c32e0b56c1a7 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:59.239846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e751e8a3-90f4-4a4b-9b16-c32e0b56c1a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b5171d70c049029b3318fd7f2c1f7c', 'request_id': 'req-e751e8a3-90f4-4a4b-9b16-c32e0b56c1a7'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:59.253234 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e751e8a3-90f4-4a4b-9b16-c32e0b56c1a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b5171d70c049029b3318fd7f2c1f7c', 'request_id': 'req-e751e8a3-90f4-4a4b-9b16-c32e0b56c1a7'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:59.266695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:59.274980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e751e8a3-90f4-4a4b-9b16-c32e0b56c1a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b5171d70c049029b3318fd7f2c1f7c', 'request_id': 'req-e751e8a3-90f4-4a4b-9b16-c32e0b56c1a7'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:59.314224 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e751e8a3-90f4-4a4b-9b16-c32e0b56c1a7 admin admin] The token cache is being invalidate because project 99b5171d70c049029b3318fd7f2c1f7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:14:59.314531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e751e8a3-90f4-4a4b-9b16-c32e0b56c1a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:59.315765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e751e8a3-90f4-4a4b-9b16-c32e0b56c1a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:14:59.323298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9238fb2-9392-40e1-b8eb-57d23ad1232d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:59.323812 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9238fb2-9392-40e1-b8eb-57d23ad1232d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:59.324246 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9238fb2-9392-40e1-b8eb-57d23ad1232d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:59.325398 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 834/1684] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:14:59 2022] DELETE /identity/v3/projects/99b5171d70c049029b3318fd7f2c1f7c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:14:59.334214 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:14:59.363948 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a9238fb2-9392-40e1-b8eb-57d23ad1232d None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:59.365204 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a9238fb2-9392-40e1-b8eb-57d23ad1232d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:59.478377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 851/1685] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:14:59.485713 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bc1f3-60b1-4a33-b00d-bcdbf9f0458e None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:59.486030 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bc1f3-60b1-4a33-b00d-bcdbf9f0458e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:59.486370 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bc1f3-60b1-4a33-b00d-bcdbf9f0458e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:59.519105 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-8f9bc1f3-60b1-4a33-b00d-bcdbf9f0458e None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:14:59.528689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-8f9bc1f3-60b1-4a33-b00d-bcdbf9f0458e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:14:59.547948 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 835/1686] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:14:59.552800 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9238fb2-9392-40e1-b8eb-57d23ad1232d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:59.566394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9238fb2-9392-40e1-b8eb-57d23ad1232d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:59.577355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23651899-d4a3-4091-806b-3bdc60ee57d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:59.578335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23651899-d4a3-4091-806b-3bdc60ee57d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:59.578700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23651899-d4a3-4091-806b-3bdc60ee57d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:59.579171 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23651899-d4a3-4091-806b-3bdc60ee57d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:59.580028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23651899-d4a3-4091-806b-3bdc60ee57d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:14:59.580389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23651899-d4a3-4091-806b-3bdc60ee57d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:59.584598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23651899-d4a3-4091-806b-3bdc60ee57d4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:59.610124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 852/1687] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:14:59.615303 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bc1f3-60b1-4a33-b00d-bcdbf9f0458e None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:59.632286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bc1f3-60b1-4a33-b00d-bcdbf9f0458e None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:59.641046 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6967ef-41d8-4f53-8d54-68710cb1fd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:59.641759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6967ef-41d8-4f53-8d54-68710cb1fd1f admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:59.642368 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6967ef-41d8-4f53-8d54-68710cb1fd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:59.646400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6967ef-41d8-4f53-8d54-68710cb1fd1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:59.647616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6967ef-41d8-4f53-8d54-68710cb1fd1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:59.650615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6967ef-41d8-4f53-8d54-68710cb1fd1f admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:59.727709 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23651899-d4a3-4091-806b-3bdc60ee57d4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:59.728664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 836/1688] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:14:59 2022] POST /identity/v3/projects => generated 391 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:59.748690 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23651899-d4a3-4091-806b-3bdc60ee57d4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:14:59.888104 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15235a8-d59a-4bf7-9c55-c29ae22909bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:14:59.889068 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15235a8-d59a-4bf7-9c55-c29ae22909bd admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:14:59.889068 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15235a8-d59a-4bf7-9c55-c29ae22909bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:14:59.889336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15235a8-d59a-4bf7-9c55-c29ae22909bd admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:14:59.890065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15235a8-d59a-4bf7-9c55-c29ae22909bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:14:59.892017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15235a8-d59a-4bf7-9c55-c29ae22909bd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:14:59.957269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 853/1689] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:14:59 2022] POST /identity/v3/users => generated 296 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:14:59.959506 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6967ef-41d8-4f53-8d54-68710cb1fd1f admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:14:59.978276 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6967ef-41d8-4f53-8d54-68710cb1fd1f admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:00.027549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d00e83-ba82-4bf2-973d-2bc23cb9fd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:00.031544 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d00e83-ba82-4bf2-973d-2bc23cb9fd87 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:00.031925 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d00e83-ba82-4bf2-973d-2bc23cb9fd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:00.032286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d00e83-ba82-4bf2-973d-2bc23cb9fd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:00.033879 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d00e83-ba82-4bf2-973d-2bc23cb9fd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:00.052779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d00e83-ba82-4bf2-973d-2bc23cb9fd87 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:00.069986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 837/1690] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:00.075717 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15235a8-d59a-4bf7-9c55-c29ae22909bd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:00.090836 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15235a8-d59a-4bf7-9c55-c29ae22909bd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:00.110651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be4c62-a055-4c50-a968-48e5b2e2b9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:00.111353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be4c62-a055-4c50-a968-48e5b2e2b9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:00.111634 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be4c62-a055-4c50-a968-48e5b2e2b9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:00.111908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be4c62-a055-4c50-a968-48e5b2e2b9f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:00.112649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be4c62-a055-4c50-a968-48e5b2e2b9f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:00.122084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be4c62-a055-4c50-a968-48e5b2e2b9f4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:00.161712 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 854/1691] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:15:00.166691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d00e83-ba82-4bf2-973d-2bc23cb9fd87 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:00.192311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d00e83-ba82-4bf2-973d-2bc23cb9fd87 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:00.216294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86728d-3fa8-4fa4-b7e0-2f30c316aa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:00.220357 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86728d-3fa8-4fa4-b7e0-2f30c316aa7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:00.220713 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86728d-3fa8-4fa4-b7e0-2f30c316aa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:00.221135 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86728d-3fa8-4fa4-b7e0-2f30c316aa7a admin admin] PATH_INFO: `/v3/projects/4ef08183f25d46c5864382200f7caa36/users/cbbc5558bed1435f9f7a7e4b493f248e/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:00.278180 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86728d-3fa8-4fa4-b7e0-2f30c316aa7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef08183f25d46c5864382200f7caa36, user_id=cbbc5558bed1435f9f7a7e4b493f248e, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:00.286618 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86728d-3fa8-4fa4-b7e0-2f30c316aa7a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:00.360655 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 838/1692] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:00 2022] PUT /identity/v3/projects/4ef08183f25d46c5864382200f7caa36/users/cbbc5558bed1435f9f7a7e4b493f248e/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:00.364381 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c770664-12b8-493b-8554-a6106f0dec1a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:00.365187 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c770664-12b8-493b-8554-a6106f0dec1a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:00.365650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c770664-12b8-493b-8554-a6106f0dec1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:00.481774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4c770664-12b8-493b-8554-a6106f0dec1a None None] MFA Rules not processed for user `cbbc5558bed1435f9f7a7e4b493f248e`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:00.485772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4c770664-12b8-493b-8554-a6106f0dec1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:00.735922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:00.759117 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 855/1693] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:00.764027 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86728d-3fa8-4fa4-b7e0-2f30c316aa7a admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:00.945762 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86728d-3fa8-4fa4-b7e0-2f30c316aa7a admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:00.956322 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a0a6d-8d28-4228-bb3e-99d5259e1511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:00.957010 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a0a6d-8d28-4228-bb3e-99d5259e1511 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:00.958867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a0a6d-8d28-4228-bb3e-99d5259e1511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:00.959166 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a0a6d-8d28-4228-bb3e-99d5259e1511 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:00.962254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a0a6d-8d28-4228-bb3e-99d5259e1511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:00.965372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a0a6d-8d28-4228-bb3e-99d5259e1511 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:01.012269 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 839/1694] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:00 2022] POST /identity/v3/projects => generated 393 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:01.012927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c770664-12b8-493b-8554-a6106f0dec1a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:01.030299 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c770664-12b8-493b-8554-a6106f0dec1a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:01.086824 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8f25f-c34a-4509-95ce-0482ea3a4f4c None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:01.087360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8f25f-c34a-4509-95ce-0482ea3a4f4c None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:01.087743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8f25f-c34a-4509-95ce-0482ea3a4f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:01.160391 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-9ce8f25f-c34a-4509-95ce-0482ea3a4f4c None None] MFA Rules not processed for user `170f479a814646e0b8822c1133cc9be4`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:01.163412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-9ce8f25f-c34a-4509-95ce-0482ea3a4f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:01.217170 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497a5dd-bdf9-4023-9950-829722c3cad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:01.218242 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497a5dd-bdf9-4023-9950-829722c3cad8 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:01.218612 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497a5dd-bdf9-4023-9950-829722c3cad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:01.218958 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497a5dd-bdf9-4023-9950-829722c3cad8 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:01.222114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497a5dd-bdf9-4023-9950-829722c3cad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:01.224981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497a5dd-bdf9-4023-9950-829722c3cad8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:01.281795 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 856/1695] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:01 2022] POST /identity/v3/users => generated 303 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:01.304860 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497a5dd-bdf9-4023-9950-829722c3cad8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:01.332815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497a5dd-bdf9-4023-9950-829722c3cad8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:01.345915 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dbaf3-e024-4c2b-8b70-799f02ea4fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:01.347499 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dbaf3-e024-4c2b-8b70-799f02ea4fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:01.347499 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dbaf3-e024-4c2b-8b70-799f02ea4fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:01.347753 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dbaf3-e024-4c2b-8b70-799f02ea4fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:01.350220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1dbaf3-e024-4c2b-8b70-799f02ea4fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:01.355254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:01.356869 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1dbaf3-e024-4c2b-8b70-799f02ea4fd2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:01.369104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 840/1696] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:01.372215 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2126a5-97e6-44a9-ad35-56827756c425 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:01.372777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2126a5-97e6-44a9-ad35-56827756c425 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:01.373474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2126a5-97e6-44a9-ad35-56827756c425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:01.410382 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 857/1697] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:01.411519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dbaf3-e024-4c2b-8b70-799f02ea4fd2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:01.412960 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-8f2126a5-97e6-44a9-ad35-56827756c425 None None] MFA Rules not processed for user `0dd62c26ee6a438495abdc3ca489b85e`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:01.414445 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-8f2126a5-97e6-44a9-ad35-56827756c425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:01.415844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fe1dbaf3-e024-4c2b-8b70-799f02ea4fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:01.535905 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 841/1698] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:01.535905 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2126a5-97e6-44a9-ad35-56827756c425 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:01.549073 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2126a5-97e6-44a9-ad35-56827756c425 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:01.554428 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfaecb6-cdd1-4575-936e-5a0b7b49112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:01.557011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaecb6-cdd1-4575-936e-5a0b7b49112a admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:01.557506 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaecb6-cdd1-4575-936e-5a0b7b49112a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:01.557761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaecb6-cdd1-4575-936e-5a0b7b49112a admin admin] PATH_INFO: `/v3/projects/b1463cbaedb3490cbaa15b2b5aa7526c/users/8dbdf5d915f54f628a34aa482e51c2a9/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:01.580388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfaecb6-cdd1-4575-936e-5a0b7b49112a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1463cbaedb3490cbaa15b2b5aa7526c, user_id=8dbdf5d915f54f628a34aa482e51c2a9, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:01.583769 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfaecb6-cdd1-4575-936e-5a0b7b49112a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:01.616498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 842/1699] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:01 2022] PUT /identity/v3/projects/b1463cbaedb3490cbaa15b2b5aa7526c/users/8dbdf5d915f54f628a34aa482e51c2a9/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:01.617434 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfaecb6-cdd1-4575-936e-5a0b7b49112a admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:01.622141 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-adfaecb6-cdd1-4575-936e-5a0b7b49112a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:01.666114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dbaf3-e024-4c2b-8b70-799f02ea4fd2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:01.785766 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1286df-c59a-41dd-9b7c-7588afc5de1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:01.786674 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1286df-c59a-41dd-9b7c-7588afc5de1b service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:01.786961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1286df-c59a-41dd-9b7c-7588afc5de1b service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:01.787241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1286df-c59a-41dd-9b7c-7588afc5de1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:01.796216 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfaecb6-cdd1-4575-936e-5a0b7b49112a admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:01.810366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1224cc2-264f-4295-aa17-1b8273c4a15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:01.813890 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1224cc2-264f-4295-aa17-1b8273c4a15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:01.814445 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1224cc2-264f-4295-aa17-1b8273c4a15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:01.816964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1224cc2-264f-4295-aa17-1b8273c4a15e admin admin] PATH_INFO: `/v3/projects/417570024ad344e2ae25dbb8221159df` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:01.819863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1224cc2-264f-4295-aa17-1b8273c4a15e admin admin] RBAC: Authorizing `identity:delete_project(project_id=417570024ad344e2ae25dbb8221159df)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:01.829160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:01.830288 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1224cc2-264f-4295-aa17-1b8273c4a15e admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:01.940416 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1286df-c59a-41dd-9b7c-7588afc5de1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:01.942669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1286df-c59a-41dd-9b7c-7588afc5de1b service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:01.968977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 858/1700] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:01.973109 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1286df-c59a-41dd-9b7c-7588afc5de1b service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:02.011440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1286df-c59a-41dd-9b7c-7588afc5de1b service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:02.035984 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a1224cc2-264f-4295-aa17-1b8273c4a15e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417570024ad344e2ae25dbb8221159df', 'request_id': 'req-a1224cc2-264f-4295-aa17-1b8273c4a15e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:02.072992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a1224cc2-264f-4295-aa17-1b8273c4a15e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417570024ad344e2ae25dbb8221159df', 'request_id': 'req-a1224cc2-264f-4295-aa17-1b8273c4a15e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:02.110055 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a1224cc2-264f-4295-aa17-1b8273c4a15e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417570024ad344e2ae25dbb8221159df', 'request_id': 'req-a1224cc2-264f-4295-aa17-1b8273c4a15e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:02.152074 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a1224cc2-264f-4295-aa17-1b8273c4a15e admin admin] The token cache is being invalidate because project 417570024ad344e2ae25dbb8221159df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:02.153804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a1224cc2-264f-4295-aa17-1b8273c4a15e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:02.156217 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a1224cc2-264f-4295-aa17-1b8273c4a15e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:02.177253 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 843/1701] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:01 2022] DELETE /identity/v3/projects/417570024ad344e2ae25dbb8221159df => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:02.189860 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1224cc2-264f-4295-aa17-1b8273c4a15e admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:02.193032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a1224cc2-264f-4295-aa17-1b8273c4a15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:02.198790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7030e-53a0-4d1f-ab91-9933718f3fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:02.200964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7030e-53a0-4d1f-ab91-9933718f3fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:02.201423 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7030e-53a0-4d1f-ab91-9933718f3fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:02.201782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7030e-53a0-4d1f-ab91-9933718f3fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:02.205293 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7030e-53a0-4d1f-ab91-9933718f3fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:02.207161 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7030e-53a0-4d1f-ab91-9933718f3fe5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:02.226979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 859/1702] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:02.228813 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7030e-53a0-4d1f-ab91-9933718f3fe5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:02.231370 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7fa7030e-53a0-4d1f-ab91-9933718f3fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:02.246423 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1224cc2-264f-4295-aa17-1b8273c4a15e admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:02.252120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7030e-53a0-4d1f-ab91-9933718f3fe5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:02.261272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb391927-8421-4529-8561-ab1807870b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:02.262712 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8fcdb-b229-4b9a-ad5a-f2010f6b254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:02.265023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb391927-8421-4529-8561-ab1807870b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:02.265314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb391927-8421-4529-8561-ab1807870b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:02.265593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb391927-8421-4529-8561-ab1807870b22 admin admin] PATH_INFO: `/v3/projects/b1463cbaedb3490cbaa15b2b5aa7526c/users/8dbdf5d915f54f628a34aa482e51c2a9/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:02.267421 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8fcdb-b229-4b9a-ad5a-f2010f6b254a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:02.267701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8fcdb-b229-4b9a-ad5a-f2010f6b254a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:02.268030 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8fcdb-b229-4b9a-ad5a-f2010f6b254a admin admin] PATH_INFO: `/v3/users/2cbb406fd2784c5c8c864a0a35bf5f3c` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:02.269827 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8fcdb-b229-4b9a-ad5a-f2010f6b254a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cbb406fd2784c5c8c864a0a35bf5f3c)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:02.278418 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb391927-8421-4529-8561-ab1807870b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1463cbaedb3490cbaa15b2b5aa7526c, user_id=8dbdf5d915f54f628a34aa482e51c2a9, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:02.287278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8fcdb-b229-4b9a-ad5a-f2010f6b254a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:02.290455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb391927-8421-4529-8561-ab1807870b22 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:02.301205 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:02.324514 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 860/1703] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:02 2022] PUT /identity/v3/projects/b1463cbaedb3490cbaa15b2b5aa7526c/users/8dbdf5d915f54f628a34aa482e51c2a9/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:02.337374 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986459e-bfc4-4f90-8cc8-1832b7c840ee None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:02.337658 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986459e-bfc4-4f90-8cc8-1832b7c840ee None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:02.337929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986459e-bfc4-4f90-8cc8-1832b7c840ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:02.388776 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1986459e-bfc4-4f90-8cc8-1832b7c840ee None None] MFA Rules not processed for user `8dbdf5d915f54f628a34aa482e51c2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:02.390377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1986459e-bfc4-4f90-8cc8-1832b7c840ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:02.417447 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a6a8fcdb-b229-4b9a-ad5a-f2010f6b254a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cbb406fd2784c5c8c864a0a35bf5f3c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:02.419326 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a6a8fcdb-b229-4b9a-ad5a-f2010f6b254a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cbb406fd2784c5c8c864a0a35bf5f3c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:02.420080 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a6a8fcdb-b229-4b9a-ad5a-f2010f6b254a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cbb406fd2784c5c8c864a0a35bf5f3c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:02.455699 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a6a8fcdb-b229-4b9a-ad5a-f2010f6b254a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cbb406fd2784c5c8c864a0a35bf5f3c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:02.475689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a6a8fcdb-b229-4b9a-ad5a-f2010f6b254a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cbb406fd2784c5c8c864a0a35bf5f3c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:02.528784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 844/1704] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:02 2022] DELETE /identity/v3/users/2cbb406fd2784c5c8c864a0a35bf5f3c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:02.609505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 861/1705] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:02.770862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8fcdb-b229-4b9a-ad5a-f2010f6b254a admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:02.772057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a6a8fcdb-b229-4b9a-ad5a-f2010f6b254a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:02.970683 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8fcdb-b229-4b9a-ad5a-f2010f6b254a admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:02.982227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5af82-968c-41be-b57c-17bd5cd1ead3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:02.983110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5af82-968c-41be-b57c-17bd5cd1ead3 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:02.983542 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5af82-968c-41be-b57c-17bd5cd1ead3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:02.985892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5af82-968c-41be-b57c-17bd5cd1ead3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:03.022268 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e5a35-8639-451a-8c54-3ea9ae862ccc None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:03.022821 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e5a35-8639-451a-8c54-3ea9ae862ccc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:03.023274 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e5a35-8639-451a-8c54-3ea9ae862ccc None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:03.026078 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 862/1706] 10.222.0.48 () {54 vars in 912 bytes} [Mon Jul 25 12:15:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:15:03.036842 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009cd00-2472-4274-8ac3-ea3c65c6a689 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:03.037160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009cd00-2472-4274-8ac3-ea3c65c6a689 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:03.037809 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009cd00-2472-4274-8ac3-ea3c65c6a689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:03.132872 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:03.150522 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8009cd00-2472-4274-8ac3-ea3c65c6a689 None None] MFA Rules not processed for user `fbc9fad7089b4c95ac92e846d46cb5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:03.152139 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8009cd00-2472-4274-8ac3-ea3c65c6a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:03.181580 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5af82-968c-41be-b57c-17bd5cd1ead3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:03.185535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5af82-968c-41be-b57c-17bd5cd1ead3 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:03.211902 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 845/1707] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:15:03.252837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 863/1708] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 12:15:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:03.298182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5af82-968c-41be-b57c-17bd5cd1ead3 service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:03.300180 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-f3e5af82-968c-41be-b57c-17bd5cd1ead3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:03.325335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5af82-968c-41be-b57c-17bd5cd1ead3 service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:03.335356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bfc42-a419-420c-a7b7-7208da274c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:03.336590 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bfc42-a419-420c-a7b7-7208da274c1b service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:03.338161 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bfc42-a419-420c-a7b7-7208da274c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:03.338604 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bfc42-a419-420c-a7b7-7208da274c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:03.360927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009cd00-2472-4274-8ac3-ea3c65c6a689 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:03.362183 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8009cd00-2472-4274-8ac3-ea3c65c6a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:03.376891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bfc42-a419-420c-a7b7-7208da274c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:03.385597 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009cd00-2472-4274-8ac3-ea3c65c6a689 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:03.386379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bfc42-a419-420c-a7b7-7208da274c1b service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:03.403109 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a12b1c-0e5e-4c15-b802-1881e2dbc102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:03.403806 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a12b1c-0e5e-4c15-b802-1881e2dbc102 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:03.404099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a12b1c-0e5e-4c15-b802-1881e2dbc102 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:03.404380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a12b1c-0e5e-4c15-b802-1881e2dbc102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:03.412534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-72a12b1c-0e5e-4c15-b802-1881e2dbc102 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:03.416575 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 846/1709] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:03.503229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a12b1c-0e5e-4c15-b802-1881e2dbc102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:03.504749 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a12b1c-0e5e-4c15-b802-1881e2dbc102 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:03.536294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 864/1710] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:15:04.072657 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bfc42-a419-420c-a7b7-7208da274c1b service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:04.075088 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-9e5bfc42-a419-420c-a7b7-7208da274c1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:04.137667 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:04.308751 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bfc42-a419-420c-a7b7-7208da274c1b service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:04.330031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94dbe5-2346-44fe-a044-7e2d256d330d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:04.342345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94dbe5-2346-44fe-a044-7e2d256d330d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:04.342345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94dbe5-2346-44fe-a044-7e2d256d330d admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:04.342345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94dbe5-2346-44fe-a044-7e2d256d330d admin admin] PATH_INFO: `/v3/projects/5fb1d27e5bd0455c95c8d3f255399aed` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:04.342345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94dbe5-2346-44fe-a044-7e2d256d330d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb1d27e5bd0455c95c8d3f255399aed)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:04.344254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94dbe5-2346-44fe-a044-7e2d256d330d admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:04.495977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c54493-47b0-4662-acc6-630fd6e12346 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:04.496443 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c54493-47b0-4662-acc6-630fd6e12346 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:04.496718 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c54493-47b0-4662-acc6-630fd6e12346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:04.497372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7d94dbe5-2346-44fe-a044-7e2d256d330d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb1d27e5bd0455c95c8d3f255399aed', 'request_id': 'req-7d94dbe5-2346-44fe-a044-7e2d256d330d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:04.516988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7d94dbe5-2346-44fe-a044-7e2d256d330d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb1d27e5bd0455c95c8d3f255399aed', 'request_id': 'req-7d94dbe5-2346-44fe-a044-7e2d256d330d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:04.537692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7d94dbe5-2346-44fe-a044-7e2d256d330d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb1d27e5bd0455c95c8d3f255399aed', 'request_id': 'req-7d94dbe5-2346-44fe-a044-7e2d256d330d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:04.582400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7d94dbe5-2346-44fe-a044-7e2d256d330d admin admin] The token cache is being invalidate because project 5fb1d27e5bd0455c95c8d3f255399aed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:04.582400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7d94dbe5-2346-44fe-a044-7e2d256d330d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:04.583394 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7d94dbe5-2346-44fe-a044-7e2d256d330d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:04.593304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 847/1711] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:04 2022] DELETE /identity/v3/projects/5fb1d27e5bd0455c95c8d3f255399aed => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:04.599037 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40cd53-33ce-4958-8cb4-09a77bbff66d None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:04.602384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40cd53-33ce-4958-8cb4-09a77bbff66d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:04.603985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40cd53-33ce-4958-8cb4-09a77bbff66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:04.648904 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c7c54493-47b0-4662-acc6-630fd6e12346 None None] MFA Rules not processed for user `6d58bfe99dfd4c79b7eabae6e1f5c536`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:04.663576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c7c54493-47b0-4662-acc6-630fd6e12346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:04.668428 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-8e40cd53-33ce-4958-8cb4-09a77bbff66d None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:04.669789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-8e40cd53-33ce-4958-8cb4-09a77bbff66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:04.858930 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 848/1712] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:04.860769 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6466ec4-5754-4494-ac64-06d43276b2b2 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:04.861122 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6466ec4-5754-4494-ac64-06d43276b2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:04.861364 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6466ec4-5754-4494-ac64-06d43276b2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:04.907303 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-a6466ec4-5754-4494-ac64-06d43276b2b2 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:04.909033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a6466ec4-5754-4494-ac64-06d43276b2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:04.913296 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 865/1713] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:04.917283 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22100ff7-143c-4b94-993f-41fe14cc564d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:04.917587 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22100ff7-143c-4b94-993f-41fe14cc564d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:04.917879 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22100ff7-143c-4b94-993f-41fe14cc564d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:04.935491 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 849/1714] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:04.936482 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6466ec4-5754-4494-ac64-06d43276b2b2 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:04.958759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6466ec4-5754-4494-ac64-06d43276b2b2 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:04.971598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b2146-e88f-4d93-b832-8048e6b7a056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:04.972291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b2146-e88f-4d93-b832-8048e6b7a056 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:04.972589 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b2146-e88f-4d93-b832-8048e6b7a056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:04.973352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b2146-e88f-4d93-b832-8048e6b7a056 admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:04.973627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b2146-e88f-4d93-b832-8048e6b7a056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:15:04.974091 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b2146-e88f-4d93-b832-8048e6b7a056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:04.976078 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b2146-e88f-4d93-b832-8048e6b7a056 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:04.996396 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-22100ff7-143c-4b94-993f-41fe14cc564d None None] MFA Rules not processed for user `6d58bfe99dfd4c79b7eabae6e1f5c536`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:04.998106 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-22100ff7-143c-4b94-993f-41fe14cc564d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:05.011095 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 850/1715] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:15:05.012894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 866/1716] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:05.013925 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b2146-e88f-4d93-b832-8048e6b7a056 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:05.027134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22100ff7-143c-4b94-993f-41fe14cc564d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:05.033629 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-22100ff7-143c-4b94-993f-41fe14cc564d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:05.043507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b2146-e88f-4d93-b832-8048e6b7a056 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:05.069133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73091f58-53c5-4aa1-8fa7-501787b85952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:05.069315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73091f58-53c5-4aa1-8fa7-501787b85952 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:05.069695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73091f58-53c5-4aa1-8fa7-501787b85952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:05.069983 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73091f58-53c5-4aa1-8fa7-501787b85952 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:05.070717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73091f58-53c5-4aa1-8fa7-501787b85952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:05.077286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73091f58-53c5-4aa1-8fa7-501787b85952 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:05.109672 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:05.143361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 851/1717] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:05 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:05.143361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c2e96-d23d-4ae4-8ce5-52b06fbf590f None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:05.144557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c2e96-d23d-4ae4-8ce5-52b06fbf590f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:05.145150 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c2e96-d23d-4ae4-8ce5-52b06fbf590f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:05.169597 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:05.189316 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22100ff7-143c-4b94-993f-41fe14cc564d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:05.212072 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-700c2e96-d23d-4ae4-8ce5-52b06fbf590f None None] MFA Rules not processed for user `8e0fa1b05a614a7d866c207c8fc9201b`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:05.213652 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-700c2e96-d23d-4ae4-8ce5-52b06fbf590f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:05.314929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e8b18-4100-4e70-8b60-73885fde1821 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:05.316283 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e8b18-4100-4e70-8b60-73885fde1821 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:05.316283 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e8b18-4100-4e70-8b60-73885fde1821 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:05.316605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e8b18-4100-4e70-8b60-73885fde1821 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:05.317708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 852/1718] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:05.318567 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c2e96-d23d-4ae4-8ce5-52b06fbf590f None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:05.392774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e8b18-4100-4e70-8b60-73885fde1821 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:05.394483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e8b18-4100-4e70-8b60-73885fde1821 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:05.408364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 867/1719] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:15:05.410070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be466188-275b-4a04-ba1c-b6ae9168d6f0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:05.410312 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be466188-275b-4a04-ba1c-b6ae9168d6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:05.410594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be466188-275b-4a04-ba1c-b6ae9168d6f0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:05.412164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 868/1720] 10.222.0.48 () {54 vars in 961 bytes} [Mon Jul 25 12:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:15:05.413362 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdfc49-bf00-47ab-ad0b-d00e5a06c7ef None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:05.413641 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdfc49-bf00-47ab-ad0b-d00e5a06c7ef None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:05.414250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdfc49-bf00-47ab-ad0b-d00e5a06c7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:05.460520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-dafdfc49-bf00-47ab-ad0b-d00e5a06c7ef None None] MFA Rules not processed for user `8e0fa1b05a614a7d866c207c8fc9201b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:05.466070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dafdfc49-bf00-47ab-ad0b-d00e5a06c7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:05.480612 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c2e96-d23d-4ae4-8ce5-52b06fbf590f None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:05.482894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 869/1721] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:05.489264 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5fc62-327e-4c1b-b239-4714c3c8c2ef None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:05.489556 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5fc62-327e-4c1b-b239-4714c3c8c2ef None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:05.493627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec65b1-e3f0-4520-843a-0b08c6c32d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:05.495330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec65b1-e3f0-4520-843a-0b08c6c32d00 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:05.495821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec65b1-e3f0-4520-843a-0b08c6c32d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:05.496071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec65b1-e3f0-4520-843a-0b08c6c32d00 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:05.496787 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec65b1-e3f0-4520-843a-0b08c6c32d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:05.502162 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec65b1-e3f0-4520-843a-0b08c6c32d00 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:05.502548 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5fc62-327e-4c1b-b239-4714c3c8c2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:05.548398 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 853/1722] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:05 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:05.549475 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec65b1-e3f0-4520-843a-0b08c6c32d00 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:05.557106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-74ec65b1-e3f0-4520-843a-0b08c6c32d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:05.572209 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2dc5fc62-327e-4c1b-b239-4714c3c8c2ef None None] MFA Rules not processed for user `40f748b0f6b1433c87012793f0dda307`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:05.573432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2dc5fc62-327e-4c1b-b239-4714c3c8c2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:05.588903 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec65b1-e3f0-4520-843a-0b08c6c32d00 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:05.609800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c690f-f89f-414a-a547-3cf694877c04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:05.610698 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c690f-f89f-414a-a547-3cf694877c04 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:05.611095 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c690f-f89f-414a-a547-3cf694877c04 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:05.611483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c690f-f89f-414a-a547-3cf694877c04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:05.627875 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c690f-f89f-414a-a547-3cf694877c04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:05.630160 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c690f-f89f-414a-a547-3cf694877c04 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:05.648218 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 854/1723] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:05.650091 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c690f-f89f-414a-a547-3cf694877c04 service nova] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:05.665988 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 870/1724] 10.222.0.48 () {58 vars in 1058 bytes} [Mon Jul 25 12:15:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:05.673882 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5fc62-327e-4c1b-b239-4714c3c8c2ef None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:05.682156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:05.688022 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c690f-f89f-414a-a547-3cf694877c04 service nova] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:05.704277 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5fc62-327e-4c1b-b239-4714c3c8c2ef None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:05.707841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec978889-f652-49d0-9a3d-8b801464c048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:05.708707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec978889-f652-49d0-9a3d-8b801464c048 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:05.709114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec978889-f652-49d0-9a3d-8b801464c048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:05.709594 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec978889-f652-49d0-9a3d-8b801464c048 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:05.711100 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec978889-f652-49d0-9a3d-8b801464c048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:05.714356 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5245e-d989-442b-8fe9-4746234df419 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f748b0f6b1433c87012793f0dda307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:05.715346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5245e-d989-442b-8fe9-4746234df419 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:05.715788 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5245e-d989-442b-8fe9-4746234df419 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:05.716199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5245e-d989-442b-8fe9-4746234df419 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:05.716982 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec978889-f652-49d0-9a3d-8b801464c048 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:05.718539 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-46b5245e-d989-442b-8fe9-4746234df419 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:05.732867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5245e-d989-442b-8fe9-4746234df419 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:05.734996 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5245e-d989-442b-8fe9-4746234df419 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:05.746764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 871/1725] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:05.756057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 855/1726] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:05.764297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5245e-d989-442b-8fe9-4746234df419 service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:05.803790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5245e-d989-442b-8fe9-4746234df419 service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:05.829081 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124943a-0907-4039-96c5-086858874f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:05.831107 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124943a-0907-4039-96c5-086858874f21 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:05.833187 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124943a-0907-4039-96c5-086858874f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:05.833536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124943a-0907-4039-96c5-086858874f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:05.838056 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124943a-0907-4039-96c5-086858874f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:05.845939 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124943a-0907-4039-96c5-086858874f21 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:05.890467 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 872/1727] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:05.892601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec978889-f652-49d0-9a3d-8b801464c048 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:05.910285 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec978889-f652-49d0-9a3d-8b801464c048 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:05.928603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1185a-7b6f-442b-9c1d-7ea08bbc46b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:05.929636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1185a-7b6f-442b-9c1d-7ea08bbc46b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:05.930047 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1185a-7b6f-442b-9c1d-7ea08bbc46b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:05.930998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1185a-7b6f-442b-9c1d-7ea08bbc46b3 admin admin] PATH_INFO: `/v3/projects/0a1eb248dfd1434587020b1eb9d3e4a8/users/ffd1d0993a104daca0d24000c7133709/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:06.017695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1185a-7b6f-442b-9c1d-7ea08bbc46b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a1eb248dfd1434587020b1eb9d3e4a8, user_id=ffd1d0993a104daca0d24000c7133709, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:06.030791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1185a-7b6f-442b-9c1d-7ea08bbc46b3 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:06.099330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 856/1728] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:05 2022] PUT /identity/v3/projects/0a1eb248dfd1434587020b1eb9d3e4a8/users/ffd1d0993a104daca0d24000c7133709/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:06.109048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd414591-aede-4aff-93bb-9f69921e71ac None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:06.109443 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd414591-aede-4aff-93bb-9f69921e71ac None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:06.109823 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd414591-aede-4aff-93bb-9f69921e71ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:06.215937 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fd414591-aede-4aff-93bb-9f69921e71ac None None] MFA Rules not processed for user `ffd1d0993a104daca0d24000c7133709`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:06.217184 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fd414591-aede-4aff-93bb-9f69921e71ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:06.450887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 873/1729] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:06.455289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1185a-7b6f-442b-9c1d-7ea08bbc46b3 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:06.526926 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6b7d8-5b12-491d-81e2-a5ed0c8e080c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:06.527493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6b7d8-5b12-491d-81e2-a5ed0c8e080c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:06.527493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6b7d8-5b12-491d-81e2-a5ed0c8e080c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:06.529168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 874/1730] 10.222.0.48 () {54 vars in 912 bytes} [Mon Jul 25 12:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:15:06.536739 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57daf84-3c5a-4a10-b93f-62bea668503b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:06.537258 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57daf84-3c5a-4a10-b93f-62bea668503b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:06.537709 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57daf84-3c5a-4a10-b93f-62bea668503b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:06.583235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b57daf84-3c5a-4a10-b93f-62bea668503b None None] MFA Rules not processed for user `fbc9fad7089b4c95ac92e846d46cb5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:06.584493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b57daf84-3c5a-4a10-b93f-62bea668503b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:06.598466 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:06.669260 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1185a-7b6f-442b-9c1d-7ea08bbc46b3 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:06.685934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db556c-dab4-49d1-b113-51b2d63158b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:06.688073 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db556c-dab4-49d1-b113-51b2d63158b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:06.688363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db556c-dab4-49d1-b113-51b2d63158b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:06.688941 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db556c-dab4-49d1-b113-51b2d63158b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:06.689679 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db556c-dab4-49d1-b113-51b2d63158b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:06.699971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db556c-dab4-49d1-b113-51b2d63158b1 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:06.738689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 875/1731] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 12:15:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:15:06.770330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57daf84-3c5a-4a10-b93f-62bea668503b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:06.772293 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b57daf84-3c5a-4a10-b93f-62bea668503b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:06.800266 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57daf84-3c5a-4a10-b93f-62bea668503b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:06.821593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74897bcb-af8d-48ca-b43e-490e39d45069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:06.821989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74897bcb-af8d-48ca-b43e-490e39d45069 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:06.822302 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74897bcb-af8d-48ca-b43e-490e39d45069 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:06.822580 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74897bcb-af8d-48ca-b43e-490e39d45069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:06.838217 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 857/1732] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:06 2022] POST /identity/v3/projects => generated 381 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:06.839384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db556c-dab4-49d1-b113-51b2d63158b1 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:06.839755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74897bcb-af8d-48ca-b43e-490e39d45069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:06.847180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74897bcb-af8d-48ca-b43e-490e39d45069 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:06.894178 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 876/1733] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:07.036390 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db556c-dab4-49d1-b113-51b2d63158b1 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:07.050830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ee8ea-f455-46e5-94d4-a8841411adbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:07.051511 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ee8ea-f455-46e5-94d4-a8841411adbe admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:07.052193 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ee8ea-f455-46e5-94d4-a8841411adbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:07.052562 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ee8ea-f455-46e5-94d4-a8841411adbe admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:07.053449 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ee8ea-f455-46e5-94d4-a8841411adbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:07.059058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ee8ea-f455-46e5-94d4-a8841411adbe admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:07.152994 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 858/1734] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:06 2022] POST /identity/v3/users => generated 297 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:07.158358 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74897bcb-af8d-48ca-b43e-490e39d45069 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:07.207511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74897bcb-af8d-48ca-b43e-490e39d45069 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:07.223892 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418b737-c85d-49a1-bdd8-de1079f2875f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:07.224559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418b737-c85d-49a1-bdd8-de1079f2875f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:07.224843 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418b737-c85d-49a1-bdd8-de1079f2875f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:07.225122 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418b737-c85d-49a1-bdd8-de1079f2875f admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:07.225862 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418b737-c85d-49a1-bdd8-de1079f2875f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:07.237137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418b737-c85d-49a1-bdd8-de1079f2875f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:07.287977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 877/1735] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:07.293938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ee8ea-f455-46e5-94d4-a8841411adbe admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:07.310870 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ee8ea-f455-46e5-94d4-a8841411adbe admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:07.334877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810c5c0-ca98-49e0-bde3-6b4f8bab4f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:07.335775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810c5c0-ca98-49e0-bde3-6b4f8bab4f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:07.336089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810c5c0-ca98-49e0-bde3-6b4f8bab4f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:07.336324 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810c5c0-ca98-49e0-bde3-6b4f8bab4f23 admin admin] PATH_INFO: `/v3/projects/e482510287414da8acf71fb41ebd3122/users/9858a46ef35a42d09615fb4a8e22b87a/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:07.401550 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810c5c0-ca98-49e0-bde3-6b4f8bab4f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e482510287414da8acf71fb41ebd3122, user_id=9858a46ef35a42d09615fb4a8e22b87a, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:07.404610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810c5c0-ca98-49e0-bde3-6b4f8bab4f23 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:07.457116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 859/1736] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:07 2022] PUT /identity/v3/projects/e482510287414da8acf71fb41ebd3122/users/9858a46ef35a42d09615fb4a8e22b87a/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:07.462123 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418b737-c85d-49a1-bdd8-de1079f2875f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:07.492580 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418b737-c85d-49a1-bdd8-de1079f2875f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:07.678618 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:07.697130 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92f24b-f618-4c5a-bb80-ef543cb5c765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:07.699079 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92f24b-f618-4c5a-bb80-ef543cb5c765 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:07.699753 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92f24b-f618-4c5a-bb80-ef543cb5c765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:07.701115 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92f24b-f618-4c5a-bb80-ef543cb5c765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:07.705002 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92f24b-f618-4c5a-bb80-ef543cb5c765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:07.708629 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92f24b-f618-4c5a-bb80-ef543cb5c765 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:07.741054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 878/1737] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:07.742059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810c5c0-ca98-49e0-bde3-6b4f8bab4f23 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:07.768473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810c5c0-ca98-49e0-bde3-6b4f8bab4f23 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:07.777158 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16970da-e8c7-4679-bfe5-d403e1a85f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:07.778266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16970da-e8c7-4679-bfe5-d403e1a85f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:07.778627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16970da-e8c7-4679-bfe5-d403e1a85f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:07.778994 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16970da-e8c7-4679-bfe5-d403e1a85f1f admin admin] PATH_INFO: `/v3/projects/e482510287414da8acf71fb41ebd3122/users/9858a46ef35a42d09615fb4a8e22b87a/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:07.781368 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16970da-e8c7-4679-bfe5-d403e1a85f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e482510287414da8acf71fb41ebd3122, user_id=9858a46ef35a42d09615fb4a8e22b87a, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:07.784654 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16970da-e8c7-4679-bfe5-d403e1a85f1f admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:07.822104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 860/1738] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:07 2022] PUT /identity/v3/projects/e482510287414da8acf71fb41ebd3122/users/9858a46ef35a42d09615fb4a8e22b87a/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:07.827923 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439405f2-0846-4120-a203-b98b0d09aed9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:07.828452 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439405f2-0846-4120-a203-b98b0d09aed9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:07.833025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439405f2-0846-4120-a203-b98b0d09aed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:07.948173 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-439405f2-0846-4120-a203-b98b0d09aed9 None None] MFA Rules not processed for user `9858a46ef35a42d09615fb4a8e22b87a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:07.953150 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-439405f2-0846-4120-a203-b98b0d09aed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:08.276738 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 879/1739] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:08.442537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16970da-e8c7-4679-bfe5-d403e1a85f1f admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:08.449393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b16970da-e8c7-4679-bfe5-d403e1a85f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:08.504933 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dd878-e764-4114-ace2-2b21c55f3e3a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:08.505597 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dd878-e764-4114-ace2-2b21c55f3e3a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:08.505981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dd878-e764-4114-ace2-2b21c55f3e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:08.579491 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-433dd878-e764-4114-ace2-2b21c55f3e3a None None] MFA Rules not processed for user `170f479a814646e0b8822c1133cc9be4`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:08.582846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-433dd878-e764-4114-ace2-2b21c55f3e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:08.745556 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 880/1740] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:08.756029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8282c1-a938-40ee-a9e5-d33919dfcb82 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:08.756728 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8282c1-a938-40ee-a9e5-d33919dfcb82 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:08.757571 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8282c1-a938-40ee-a9e5-d33919dfcb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:08.779599 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16970da-e8c7-4679-bfe5-d403e1a85f1f admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:08.791300 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5b75b-6b8c-455b-b84e-ebbbb744171c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:08.793160 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5b75b-6b8c-455b-b84e-ebbbb744171c service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:08.794610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5b75b-6b8c-455b-b84e-ebbbb744171c service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:08.795147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5b75b-6b8c-455b-b84e-ebbbb744171c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:08.810304 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ab8282c1-a938-40ee-a9e5-d33919dfcb82 None None] MFA Rules not processed for user `8e0fa1b05a614a7d866c207c8fc9201b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:08.817924 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ab8282c1-a938-40ee-a9e5-d33919dfcb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:08.875061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5b75b-6b8c-455b-b84e-ebbbb744171c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:08.886149 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5b75b-6b8c-455b-b84e-ebbbb744171c service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:08.952153 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 861/1741] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:15:09.033967 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 881/1742] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:09.693482 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5b75b-6b8c-455b-b84e-ebbbb744171c service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:09.695506 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-18e5b75b-6b8c-455b-b84e-ebbbb744171c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:09.757105 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:09.891524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5b75b-6b8c-455b-b84e-ebbbb744171c service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:09.904459 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11287d-b927-4c06-ad3e-eedd08d0723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:09.905687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11287d-b927-4c06-ad3e-eedd08d0723e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:09.909750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11287d-b927-4c06-ad3e-eedd08d0723e admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:09.912443 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11287d-b927-4c06-ad3e-eedd08d0723e admin admin] PATH_INFO: `/v3/users/cbbc5558bed1435f9f7a7e4b493f248e` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:09.918512 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11287d-b927-4c06-ad3e-eedd08d0723e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbbc5558bed1435f9f7a7e4b493f248e)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:09.927375 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11287d-b927-4c06-ad3e-eedd08d0723e admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:10.043640 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-5f11287d-b927-4c06-ad3e-eedd08d0723e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbbc5558bed1435f9f7a7e4b493f248e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:10.046020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-5f11287d-b927-4c06-ad3e-eedd08d0723e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbbc5558bed1435f9f7a7e4b493f248e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:10.047302 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-5f11287d-b927-4c06-ad3e-eedd08d0723e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbbc5558bed1435f9f7a7e4b493f248e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:10.081877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-5f11287d-b927-4c06-ad3e-eedd08d0723e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbbc5558bed1435f9f7a7e4b493f248e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:10.104059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-5f11287d-b927-4c06-ad3e-eedd08d0723e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbbc5558bed1435f9f7a7e4b493f248e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:10.137189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 862/1743] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:09 2022] DELETE /identity/v3/users/cbbc5558bed1435f9f7a7e4b493f248e => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:10.142093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757783e-4e7e-4d72-be47-29d14805d026 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:10.142676 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757783e-4e7e-4d72-be47-29d14805d026 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:10.143623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757783e-4e7e-4d72-be47-29d14805d026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:10.202394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2757783e-4e7e-4d72-be47-29d14805d026 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:10.204104 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2757783e-4e7e-4d72-be47-29d14805d026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:10.253552 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:10.305423 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11287d-b927-4c06-ad3e-eedd08d0723e admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:10.307061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5f11287d-b927-4c06-ad3e-eedd08d0723e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:10.393214 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 882/1744] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:10.429386 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757783e-4e7e-4d72-be47-29d14805d026 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:10.431657 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2757783e-4e7e-4d72-be47-29d14805d026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:10.511061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11287d-b927-4c06-ad3e-eedd08d0723e admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:10.525777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741537b-13ec-4c6e-8f39-f834dcc4e18b tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858a46ef35a42d09615fb4a8e22b87a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e482510287414da8acf71fb41ebd3122', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:10.526974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741537b-13ec-4c6e-8f39-f834dcc4e18b tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:10.527580 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741537b-13ec-4c6e-8f39-f834dcc4e18b tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:10.529187 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741537b-13ec-4c6e-8f39-f834dcc4e18b tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:10.530635 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741537b-13ec-4c6e-8f39-f834dcc4e18b tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:15:10.533160 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741537b-13ec-4c6e-8f39-f834dcc4e18b tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:10.534976 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741537b-13ec-4c6e-8f39-f834dcc4e18b tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:10.563821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 863/1745] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:15:10.567870 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741537b-13ec-4c6e-8f39-f834dcc4e18b tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:10.591877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741537b-13ec-4c6e-8f39-f834dcc4e18b tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:10.609896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101c64b-1405-4b3a-8abe-bf0c23680029 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858a46ef35a42d09615fb4a8e22b87a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e482510287414da8acf71fb41ebd3122', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:10.614837 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101c64b-1405-4b3a-8abe-bf0c23680029 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:10.615228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101c64b-1405-4b3a-8abe-bf0c23680029 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:10.615766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101c64b-1405-4b3a-8abe-bf0c23680029 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:10.618073 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101c64b-1405-4b3a-8abe-bf0c23680029 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:10.627837 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101c64b-1405-4b3a-8abe-bf0c23680029 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:10.651249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757783e-4e7e-4d72-be47-29d14805d026 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:10.664370 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176097e1-5ad7-428f-a03e-d39c1a3588aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:10.666114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176097e1-5ad7-428f-a03e-d39c1a3588aa service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:10.666318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176097e1-5ad7-428f-a03e-d39c1a3588aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:10.666598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176097e1-5ad7-428f-a03e-d39c1a3588aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:10.722595 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176097e1-5ad7-428f-a03e-d39c1a3588aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:10.724009 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176097e1-5ad7-428f-a03e-d39c1a3588aa service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:10.748175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 864/1746] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:10 2022] POST /identity/v3/projects => generated 354 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:10.750817 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101c64b-1405-4b3a-8abe-bf0c23680029 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:10.758273 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b101c64b-1405-4b3a-8abe-bf0c23680029 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:10.797376 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 883/1747] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:10.800114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176097e1-5ad7-428f-a03e-d39c1a3588aa service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:10.809043 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:10.829642 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176097e1-5ad7-428f-a03e-d39c1a3588aa service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:11.019830 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce0930-2a5b-4741-a332-66ad4c4dece3 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858a46ef35a42d09615fb4a8e22b87a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e482510287414da8acf71fb41ebd3122', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:11.023102 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce0930-2a5b-4741-a332-66ad4c4dece3 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:11.026815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce0930-2a5b-4741-a332-66ad4c4dece3 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:11.026815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce0930-2a5b-4741-a332-66ad4c4dece3 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:11.026815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce0930-2a5b-4741-a332-66ad4c4dece3 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:15:11.026815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce0930-2a5b-4741-a332-66ad4c4dece3 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:11.034641 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce0930-2a5b-4741-a332-66ad4c4dece3 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:11.063792 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101c64b-1405-4b3a-8abe-bf0c23680029 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:11.081830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a03ed-5d9e-46b7-9a0e-85cc6fc590ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:11.085535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a03ed-5d9e-46b7-9a0e-85cc6fc590ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:11.091491 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a03ed-5d9e-46b7-9a0e-85cc6fc590ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:11.105415 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a03ed-5d9e-46b7-9a0e-85cc6fc590ed admin admin] PATH_INFO: `/v3/users/f79ab19da8a04b4d9f8ff840661581c4` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:11.108326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 884/1748] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:15:11.110246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a03ed-5d9e-46b7-9a0e-85cc6fc590ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=f79ab19da8a04b4d9f8ff840661581c4)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:11.112181 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9081aa3-a25f-4708-b84a-42fb7beae849 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:11.116131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a03ed-5d9e-46b7-9a0e-85cc6fc590ed admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:11.118801 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9081aa3-a25f-4708-b84a-42fb7beae849 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:11.122568 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9081aa3-a25f-4708-b84a-42fb7beae849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:11.351552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-5c0a03ed-5d9e-46b7-9a0e-85cc6fc590ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f79ab19da8a04b4d9f8ff840661581c4'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:11.353003 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-5c0a03ed-5d9e-46b7-9a0e-85cc6fc590ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f79ab19da8a04b4d9f8ff840661581c4'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:11.353949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-5c0a03ed-5d9e-46b7-9a0e-85cc6fc590ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f79ab19da8a04b4d9f8ff840661581c4'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:11.376924 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d9081aa3-a25f-4708-b84a-42fb7beae849 None None] MFA Rules not processed for user `30c0516b85e74bdb829a3019e71e6ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:11.378626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d9081aa3-a25f-4708-b84a-42fb7beae849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:11.417159 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-5c0a03ed-5d9e-46b7-9a0e-85cc6fc590ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f79ab19da8a04b4d9f8ff840661581c4'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:11.483616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-5c0a03ed-5d9e-46b7-9a0e-85cc6fc590ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f79ab19da8a04b4d9f8ff840661581c4'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:11.535506 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:11.563971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 865/1749] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:10 2022] DELETE /identity/v3/users/f79ab19da8a04b4d9f8ff840661581c4 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:11.570230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a03ed-5d9e-46b7-9a0e-85cc6fc590ed admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:11.576961 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5c0a03ed-5d9e-46b7-9a0e-85cc6fc590ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:11.609775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 885/1750] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 12:15:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:11.657325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d708122-928a-4725-994d-e7505b5f7c77 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:11.661135 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d708122-928a-4725-994d-e7505b5f7c77 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:11.663033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d708122-928a-4725-994d-e7505b5f7c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:11.741675 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8d708122-928a-4725-994d-e7505b5f7c77 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:11.744852 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8d708122-928a-4725-994d-e7505b5f7c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:11.887518 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 886/1751] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:11.894242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a03ed-5d9e-46b7-9a0e-85cc6fc590ed admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:11.906274 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef3bdd-316a-4045-9772-9f1f564b7e49 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9858a46ef35a42d09615fb4a8e22b87a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e482510287414da8acf71fb41ebd3122', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:11.909084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef3bdd-316a-4045-9772-9f1f564b7e49 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:11.909815 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef3bdd-316a-4045-9772-9f1f564b7e49 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:11.911755 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef3bdd-316a-4045-9772-9f1f564b7e49 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] PATH_INFO: `/v3/projects/309012c6283a4b408b6df6d3ea6e5c93` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:11.915111 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef3bdd-316a-4045-9772-9f1f564b7e49 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] RBAC: Authorizing `identity:delete_project(project_id=309012c6283a4b408b6df6d3ea6e5c93)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:11.919199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef3bdd-316a-4045-9772-9f1f564b7e49 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:11.986404 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d708122-928a-4725-994d-e7505b5f7c77 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:11.988094 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8d708122-928a-4725-994d-e7505b5f7c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:12.124330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:12.177366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-66ef3bdd-316a-4045-9772-9f1f564b7e49 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '309012c6283a4b408b6df6d3ea6e5c93', 'request_id': 'req-66ef3bdd-316a-4045-9772-9f1f564b7e49'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:12.205295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d708122-928a-4725-994d-e7505b5f7c77 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:12.207967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-66ef3bdd-316a-4045-9772-9f1f564b7e49 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '309012c6283a4b408b6df6d3ea6e5c93', 'request_id': 'req-66ef3bdd-316a-4045-9772-9f1f564b7e49'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:12.228972 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-66ef3bdd-316a-4045-9772-9f1f564b7e49 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '309012c6283a4b408b6df6d3ea6e5c93', 'request_id': 'req-66ef3bdd-316a-4045-9772-9f1f564b7e49'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:12.278570 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-66ef3bdd-316a-4045-9772-9f1f564b7e49 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] The token cache is being invalidate because project 309012c6283a4b408b6df6d3ea6e5c93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:12.279704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-66ef3bdd-316a-4045-9772-9f1f564b7e49 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:12.280591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-66ef3bdd-316a-4045-9772-9f1f564b7e49 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:12.286560 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 866/1752] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:11 2022] DELETE /identity/v3/projects/309012c6283a4b408b6df6d3ea6e5c93 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:12.287814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef3bdd-316a-4045-9772-9f1f564b7e49 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:12.290507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-66ef3bdd-316a-4045-9772-9f1f564b7e49 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:12.427494 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef3bdd-316a-4045-9772-9f1f564b7e49 tempest-VolumeQuotaClassesTest-2034450828 tempest-VolumeQuotaClassesTest-2034450828-project-admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:12.434508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0c46d-1c4d-4054-9f42-0c8e2d6a8031 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71de21b4b6d4971953f0c1ca92d9f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:12.435441 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0c46d-1c4d-4054-9f42-0c8e2d6a8031 service swift] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:12.435555 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c209d-845a-401f-8c2d-bbd4af25c0ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:12.436200 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c209d-845a-401f-8c2d-bbd4af25c0ac service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:12.436470 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0c46d-1c4d-4054-9f42-0c8e2d6a8031 service swift] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:12.436587 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c209d-845a-401f-8c2d-bbd4af25c0ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:12.436745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c209d-845a-401f-8c2d-bbd4af25c0ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:12.437119 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0c46d-1c4d-4054-9f42-0c8e2d6a8031 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:12.439983 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9b5c209d-845a-401f-8c2d-bbd4af25c0ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:12.441735 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-44d0c46d-1c4d-4054-9f42-0c8e2d6a8031 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:12.560112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0c46d-1c4d-4054-9f42-0c8e2d6a8031 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:12.562646 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0c46d-1c4d-4054-9f42-0c8e2d6a8031 service swift] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:12.564361 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:12.580857 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 867/1753] 10.222.0.48 () {60 vars in 1384 bytes} [Mon Jul 25 12:15:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:15:12.620429 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c209d-845a-401f-8c2d-bbd4af25c0ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:12.626886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c209d-845a-401f-8c2d-bbd4af25c0ac service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:12.666104 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 887/1754] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:15:13.109928 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0c46d-1c4d-4054-9f42-0c8e2d6a8031 service swift] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:13.115358 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-44d0c46d-1c4d-4054-9f42-0c8e2d6a8031 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:13.158378 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0c46d-1c4d-4054-9f42-0c8e2d6a8031 service swift] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:13.167908 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d903ec-09a8-4a2a-a370-3950adb2eafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:13.169668 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d903ec-09a8-4a2a-a370-3950adb2eafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:13.170140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d903ec-09a8-4a2a-a370-3950adb2eafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:13.170750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d903ec-09a8-4a2a-a370-3950adb2eafc admin admin] PATH_INFO: `/v3/users/ffd1d0993a104daca0d24000c7133709` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:13.172495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d903ec-09a8-4a2a-a370-3950adb2eafc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd1d0993a104daca0d24000c7133709)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:13.175677 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d903ec-09a8-4a2a-a370-3950adb2eafc admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:13.253260 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:13.294237 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-16d903ec-09a8-4a2a-a370-3950adb2eafc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd1d0993a104daca0d24000c7133709'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:13.303215 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-16d903ec-09a8-4a2a-a370-3950adb2eafc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd1d0993a104daca0d24000c7133709'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:13.304638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-16d903ec-09a8-4a2a-a370-3950adb2eafc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd1d0993a104daca0d24000c7133709'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:13.344637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-16d903ec-09a8-4a2a-a370-3950adb2eafc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd1d0993a104daca0d24000c7133709'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:13.377952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-16d903ec-09a8-4a2a-a370-3950adb2eafc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd1d0993a104daca0d24000c7133709'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:13.410456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 868/1755] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:13 2022] DELETE /identity/v3/users/ffd1d0993a104daca0d24000c7133709 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:13.415946 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6c2ae-b904-448f-8c16-9684ae9e7c3c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:13.416427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6c2ae-b904-448f-8c16-9684ae9e7c3c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:13.416846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6c2ae-b904-448f-8c16-9684ae9e7c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:13.458345 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d3b6c2ae-b904-448f-8c16-9684ae9e7c3c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:13.463618 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d3b6c2ae-b904-448f-8c16-9684ae9e7c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:13.636659 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 888/1756] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:13.670068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d903ec-09a8-4a2a-a370-3950adb2eafc admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:13.671553 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-16d903ec-09a8-4a2a-a370-3950adb2eafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:13.925668 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d903ec-09a8-4a2a-a370-3950adb2eafc admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:13.932125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74771f-75f2-4be6-a08e-bd92c865d477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:13.949265 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74771f-75f2-4be6-a08e-bd92c865d477 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:13.951812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74771f-75f2-4be6-a08e-bd92c865d477 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:13.951812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74771f-75f2-4be6-a08e-bd92c865d477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:14.018811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74771f-75f2-4be6-a08e-bd92c865d477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:14.020926 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74771f-75f2-4be6-a08e-bd92c865d477 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:14.064339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 869/1757] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:14.827952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca09fe-0ee7-4340-8124-71a2591ff32c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:14.828561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca09fe-0ee7-4340-8124-71a2591ff32c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:14.828561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca09fe-0ee7-4340-8124-71a2591ff32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:14.835315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74771f-75f2-4be6-a08e-bd92c865d477 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:14.840587 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5a74771f-75f2-4be6-a08e-bd92c865d477 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:14.865420 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74771f-75f2-4be6-a08e-bd92c865d477 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:14.885358 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ad4d2-f741-4210-b54b-93b012fca4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:14.886545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ad4d2-f741-4210-b54b-93b012fca4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:14.886942 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ad4d2-f741-4210-b54b-93b012fca4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:14.887426 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ad4d2-f741-4210-b54b-93b012fca4a4 admin admin] PATH_INFO: `/v3/projects/4ef08183f25d46c5864382200f7caa36` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:14.893754 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ad4d2-f741-4210-b54b-93b012fca4a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef08183f25d46c5864382200f7caa36)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:14.897232 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ad4d2-f741-4210-b54b-93b012fca4a4 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:14.930213 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-11ca09fe-0ee7-4340-8124-71a2591ff32c None None] MFA Rules not processed for user `fbc9fad7089b4c95ac92e846d46cb5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:14.946726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-11ca09fe-0ee7-4340-8124-71a2591ff32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:14.984988 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 889/1758] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Jul 25 12:15:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:15.044801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-652ad4d2-f741-4210-b54b-93b012fca4a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef08183f25d46c5864382200f7caa36', 'request_id': 'req-652ad4d2-f741-4210-b54b-93b012fca4a4'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:15.060275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-652ad4d2-f741-4210-b54b-93b012fca4a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef08183f25d46c5864382200f7caa36', 'request_id': 'req-652ad4d2-f741-4210-b54b-93b012fca4a4'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:15.069110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-652ad4d2-f741-4210-b54b-93b012fca4a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef08183f25d46c5864382200f7caa36', 'request_id': 'req-652ad4d2-f741-4210-b54b-93b012fca4a4'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:15.087811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca09fe-0ee7-4340-8124-71a2591ff32c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:15.106235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca09fe-0ee7-4340-8124-71a2591ff32c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:15.130445 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-652ad4d2-f741-4210-b54b-93b012fca4a4 admin admin] The token cache is being invalidate because project 4ef08183f25d46c5864382200f7caa36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:15.131430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-652ad4d2-f741-4210-b54b-93b012fca4a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:15.134993 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-652ad4d2-f741-4210-b54b-93b012fca4a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:15.141217 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 870/1759] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:14 2022] DELETE /identity/v3/projects/4ef08183f25d46c5864382200f7caa36 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:15.145548 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ad4d2-f741-4210-b54b-93b012fca4a4 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:15.148796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-652ad4d2-f741-4210-b54b-93b012fca4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:15.239377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:15.279717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ad4d2-f741-4210-b54b-93b012fca4a4 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:15.343104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247deb4-9e33-4dd1-9540-236acb099ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:15.347939 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247deb4-9e33-4dd1-9540-236acb099ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:15.349669 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247deb4-9e33-4dd1-9540-236acb099ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:15.350179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247deb4-9e33-4dd1-9540-236acb099ffb admin admin] PATH_INFO: `/v3/users/8dbdf5d915f54f628a34aa482e51c2a9` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:15.353839 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247deb4-9e33-4dd1-9540-236acb099ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dbdf5d915f54f628a34aa482e51c2a9)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:15.356979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c8af6-c66f-40c8-b5bc-c9ed1bbb4fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:15.357656 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c8af6-c66f-40c8-b5bc-c9ed1bbb4fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:15.358894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c8af6-c66f-40c8-b5bc-c9ed1bbb4fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:15.359323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c8af6-c66f-40c8-b5bc-c9ed1bbb4fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:15.360445 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247deb4-9e33-4dd1-9540-236acb099ffb admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:15.363370 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-992c8af6-c66f-40c8-b5bc-c9ed1bbb4fa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:15.441895 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c8af6-c66f-40c8-b5bc-c9ed1bbb4fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:15.443735 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c8af6-c66f-40c8-b5bc-c9ed1bbb4fa7 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:15.482712 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 890/1760] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:15.535907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d247deb4-9e33-4dd1-9540-236acb099ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dbdf5d915f54f628a34aa482e51c2a9'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:15.540383 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d247deb4-9e33-4dd1-9540-236acb099ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dbdf5d915f54f628a34aa482e51c2a9'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:15.540383 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d247deb4-9e33-4dd1-9540-236acb099ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dbdf5d915f54f628a34aa482e51c2a9'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:15.582480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d247deb4-9e33-4dd1-9540-236acb099ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dbdf5d915f54f628a34aa482e51c2a9'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:15.595017 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d247deb4-9e33-4dd1-9540-236acb099ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dbdf5d915f54f628a34aa482e51c2a9'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:15.626296 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 871/1761] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:15 2022] DELETE /identity/v3/users/8dbdf5d915f54f628a34aa482e51c2a9 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:16.845787 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c8af6-c66f-40c8-b5bc-c9ed1bbb4fa7 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:16.848401 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-992c8af6-c66f-40c8-b5bc-c9ed1bbb4fa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:16.873522 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c8af6-c66f-40c8-b5bc-c9ed1bbb4fa7 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:17.126520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c0e4e-b6c0-4b7f-b27c-67265e0b51e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:17.127426 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c0e4e-b6c0-4b7f-b27c-67265e0b51e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:17.127726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c0e4e-b6c0-4b7f-b27c-67265e0b51e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:17.127992 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c0e4e-b6c0-4b7f-b27c-67265e0b51e8 admin admin] PATH_INFO: `/v3/projects/0a1eb248dfd1434587020b1eb9d3e4a8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:17.134363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c0e4e-b6c0-4b7f-b27c-67265e0b51e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a1eb248dfd1434587020b1eb9d3e4a8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:17.136998 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c0e4e-b6c0-4b7f-b27c-67265e0b51e8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:17.196557 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:17.277741 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-227c0e4e-b6c0-4b7f-b27c-67265e0b51e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a1eb248dfd1434587020b1eb9d3e4a8', 'request_id': 'req-227c0e4e-b6c0-4b7f-b27c-67265e0b51e8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:17.311449 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-227c0e4e-b6c0-4b7f-b27c-67265e0b51e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a1eb248dfd1434587020b1eb9d3e4a8', 'request_id': 'req-227c0e4e-b6c0-4b7f-b27c-67265e0b51e8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:17.334589 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-227c0e4e-b6c0-4b7f-b27c-67265e0b51e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a1eb248dfd1434587020b1eb9d3e4a8', 'request_id': 'req-227c0e4e-b6c0-4b7f-b27c-67265e0b51e8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:17.380484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247deb4-9e33-4dd1-9540-236acb099ffb admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:17.382216 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d247deb4-9e33-4dd1-9540-236acb099ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:17.391920 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-227c0e4e-b6c0-4b7f-b27c-67265e0b51e8 admin admin] The token cache is being invalidate because project 0a1eb248dfd1434587020b1eb9d3e4a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:17.393063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-227c0e4e-b6c0-4b7f-b27c-67265e0b51e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:17.396249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-227c0e4e-b6c0-4b7f-b27c-67265e0b51e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:17.404234 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 891/1762] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:16 2022] DELETE /identity/v3/projects/0a1eb248dfd1434587020b1eb9d3e4a8 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:17.409647 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c0e4e-b6c0-4b7f-b27c-67265e0b51e8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:17.413727 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-227c0e4e-b6c0-4b7f-b27c-67265e0b51e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:17.466251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247deb4-9e33-4dd1-9540-236acb099ffb admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:17.702032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d80799-1aff-4b90-9424-399f446ba890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:17.702032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d80799-1aff-4b90-9424-399f446ba890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:17.702032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d80799-1aff-4b90-9424-399f446ba890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:17.702032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d80799-1aff-4b90-9424-399f446ba890 admin admin] PATH_INFO: `/v3/projects/bb9f5ff552f849f7992a1ace61cc4baf` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:17.702476 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d80799-1aff-4b90-9424-399f446ba890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb9f5ff552f849f7992a1ace61cc4baf)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:17.704760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d80799-1aff-4b90-9424-399f446ba890 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:17.721361 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c0e4e-b6c0-4b7f-b27c-67265e0b51e8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:17.747728 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004adee-4252-4607-9fdc-c7556a508020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:17.753961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004adee-4252-4607-9fdc-c7556a508020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:17.754424 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004adee-4252-4607-9fdc-c7556a508020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:17.755989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004adee-4252-4607-9fdc-c7556a508020 admin admin] PATH_INFO: `/v3/users/9858a46ef35a42d09615fb4a8e22b87a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:17.763603 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004adee-4252-4607-9fdc-c7556a508020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9858a46ef35a42d09615fb4a8e22b87a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:17.767021 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004adee-4252-4607-9fdc-c7556a508020 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:17.900973 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b6d80799-1aff-4b90-9424-399f446ba890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb9f5ff552f849f7992a1ace61cc4baf', 'request_id': 'req-b6d80799-1aff-4b90-9424-399f446ba890'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:17.917682 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e004adee-4252-4607-9fdc-c7556a508020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9858a46ef35a42d09615fb4a8e22b87a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:17.919605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e004adee-4252-4607-9fdc-c7556a508020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9858a46ef35a42d09615fb4a8e22b87a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:17.920546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e004adee-4252-4607-9fdc-c7556a508020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9858a46ef35a42d09615fb4a8e22b87a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:17.934883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b6d80799-1aff-4b90-9424-399f446ba890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb9f5ff552f849f7992a1ace61cc4baf', 'request_id': 'req-b6d80799-1aff-4b90-9424-399f446ba890'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:17.951719 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:17.966055 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b6d80799-1aff-4b90-9424-399f446ba890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb9f5ff552f849f7992a1ace61cc4baf', 'request_id': 'req-b6d80799-1aff-4b90-9424-399f446ba890'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:17.969402 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e004adee-4252-4607-9fdc-c7556a508020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9858a46ef35a42d09615fb4a8e22b87a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:17.987703 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b6d80799-1aff-4b90-9424-399f446ba890 admin admin] The token cache is being invalidate because project bb9f5ff552f849f7992a1ace61cc4baf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:17.988124 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b6d80799-1aff-4b90-9424-399f446ba890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:17.989184 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b6d80799-1aff-4b90-9424-399f446ba890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:17.991408 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e004adee-4252-4607-9fdc-c7556a508020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9858a46ef35a42d09615fb4a8e22b87a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:17.992308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 872/1763] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:17 2022] DELETE /identity/v3/projects/bb9f5ff552f849f7992a1ace61cc4baf => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:17.997142 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d80799-1aff-4b90-9424-399f446ba890 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:18.000878 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b6d80799-1aff-4b90-9424-399f446ba890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:18.024777 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 892/1764] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:17 2022] DELETE /identity/v3/users/9858a46ef35a42d09615fb4a8e22b87a => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:18.154447 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d80799-1aff-4b90-9424-399f446ba890 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:18.308208 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ee7ae-8d4f-4865-a435-5346407ac204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:18.310889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ee7ae-8d4f-4865-a435-5346407ac204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:18.311368 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ee7ae-8d4f-4865-a435-5346407ac204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:18.311654 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ee7ae-8d4f-4865-a435-5346407ac204 admin admin] PATH_INFO: `/v3/users/61a2fc04c4e344c697b31588d226485b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:18.316459 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ee7ae-8d4f-4865-a435-5346407ac204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a2fc04c4e344c697b31588d226485b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:18.318698 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ee7ae-8d4f-4865-a435-5346407ac204 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:18.469348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4e7ee7ae-8d4f-4865-a435-5346407ac204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a2fc04c4e344c697b31588d226485b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:18.469348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4e7ee7ae-8d4f-4865-a435-5346407ac204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a2fc04c4e344c697b31588d226485b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:18.471814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4e7ee7ae-8d4f-4865-a435-5346407ac204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a2fc04c4e344c697b31588d226485b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:18.528522 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4e7ee7ae-8d4f-4865-a435-5346407ac204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a2fc04c4e344c697b31588d226485b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:18.549352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4e7ee7ae-8d4f-4865-a435-5346407ac204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a2fc04c4e344c697b31588d226485b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:18.579707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 873/1765] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:17 2022] DELETE /identity/v3/users/61a2fc04c4e344c697b31588d226485b => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:19.022588 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d3027-043f-4b3e-ba28-3d5c04f56a5f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:19.023141 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d3027-043f-4b3e-ba28-3d5c04f56a5f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:19.023141 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d3027-043f-4b3e-ba28-3d5c04f56a5f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:19.025055 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 893/1766] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 12:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:15:19.068065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc529216-1fbd-4197-bf03-d39db7e1b13f None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:19.068686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc529216-1fbd-4197-bf03-d39db7e1b13f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:19.069074 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc529216-1fbd-4197-bf03-d39db7e1b13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:19.112774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-bc529216-1fbd-4197-bf03-d39db7e1b13f None None] MFA Rules not processed for user `6d9db26891a04b0bb7e655c21feeffdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:19.114061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-bc529216-1fbd-4197-bf03-d39db7e1b13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:19.152815 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:19.205702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d3027-043f-4b3e-ba28-3d5c04f56a5f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:19.207558 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-864d3027-043f-4b3e-ba28-3d5c04f56a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:19.324199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:19.372715 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 874/1767] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 12:15:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:15:19.437271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d3027-043f-4b3e-ba28-3d5c04f56a5f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:19.448690 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40cfc5-a418-4627-8b0a-855d60a564e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:19.454300 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40cfc5-a418-4627-8b0a-855d60a564e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:19.454819 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40cfc5-a418-4627-8b0a-855d60a564e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:19.455242 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40cfc5-a418-4627-8b0a-855d60a564e8 admin admin] PATH_INFO: `/v3/projects/b1463cbaedb3490cbaa15b2b5aa7526c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:19.457430 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40cfc5-a418-4627-8b0a-855d60a564e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1463cbaedb3490cbaa15b2b5aa7526c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:19.459648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40cfc5-a418-4627-8b0a-855d60a564e8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:19.713193 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fa40cfc5-a418-4627-8b0a-855d60a564e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1463cbaedb3490cbaa15b2b5aa7526c', 'request_id': 'req-fa40cfc5-a418-4627-8b0a-855d60a564e8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:19.760775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fa40cfc5-a418-4627-8b0a-855d60a564e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1463cbaedb3490cbaa15b2b5aa7526c', 'request_id': 'req-fa40cfc5-a418-4627-8b0a-855d60a564e8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:19.784386 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fa40cfc5-a418-4627-8b0a-855d60a564e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1463cbaedb3490cbaa15b2b5aa7526c', 'request_id': 'req-fa40cfc5-a418-4627-8b0a-855d60a564e8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:19.823774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fa40cfc5-a418-4627-8b0a-855d60a564e8 admin admin] The token cache is being invalidate because project b1463cbaedb3490cbaa15b2b5aa7526c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:19.824507 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fa40cfc5-a418-4627-8b0a-855d60a564e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:19.826148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fa40cfc5-a418-4627-8b0a-855d60a564e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:19.830440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 894/1768] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:19 2022] DELETE /identity/v3/projects/b1463cbaedb3490cbaa15b2b5aa7526c => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:19.835579 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d36c50-95d1-422a-bcee-64be94d9eb42 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:19.837162 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d36c50-95d1-422a-bcee-64be94d9eb42 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:19.837728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d36c50-95d1-422a-bcee-64be94d9eb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:19.873480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-42d36c50-95d1-422a-bcee-64be94d9eb42 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:19.875282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-42d36c50-95d1-422a-bcee-64be94d9eb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:20.063709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 875/1769] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:20.065740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd664d85-f1d0-4b88-8eec-94f239d77060 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:20.066267 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd664d85-f1d0-4b88-8eec-94f239d77060 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:20.066619 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd664d85-f1d0-4b88-8eec-94f239d77060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:20.126954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-dd664d85-f1d0-4b88-8eec-94f239d77060 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:20.130366 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dd664d85-f1d0-4b88-8eec-94f239d77060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:20.177992 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 895/1770] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:20.181888 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d36c50-95d1-422a-bcee-64be94d9eb42 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:20.203139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d36c50-95d1-422a-bcee-64be94d9eb42 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:20.226920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca43c97-f236-4ab8-b959-0710b8214d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:20.228172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca43c97-f236-4ab8-b959-0710b8214d5e admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:20.228498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca43c97-f236-4ab8-b959-0710b8214d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:20.228781 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca43c97-f236-4ab8-b959-0710b8214d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:20.229535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca43c97-f236-4ab8-b959-0710b8214d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:15:20.230215 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca43c97-f236-4ab8-b959-0710b8214d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:20.247740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca43c97-f236-4ab8-b959-0710b8214d5e admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:20.311541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 876/1771] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:15:20.315780 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd664d85-f1d0-4b88-8eec-94f239d77060 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:20.331349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd664d85-f1d0-4b88-8eec-94f239d77060 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:20.342962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca43c97-f236-4ab8-b959-0710b8214d5e admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:20.345192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-2ca43c97-f236-4ab8-b959-0710b8214d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:20.360205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88917664-f402-406f-939c-74c70c0521aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:20.365612 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88917664-f402-406f-939c-74c70c0521aa admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:20.370464 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88917664-f402-406f-939c-74c70c0521aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:20.371340 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88917664-f402-406f-939c-74c70c0521aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:20.381622 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88917664-f402-406f-939c-74c70c0521aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:20.384250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88917664-f402-406f-939c-74c70c0521aa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:20.449423 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca43c97-f236-4ab8-b959-0710b8214d5e admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:20.451728 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 896/1772] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:20 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:20.456559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88917664-f402-406f-939c-74c70c0521aa admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:20.639323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88917664-f402-406f-939c-74c70c0521aa admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:20.657892 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0affe-2dec-4f87-8f90-599d48665b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:20.658623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0affe-2dec-4f87-8f90-599d48665b04 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:20.658906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0affe-2dec-4f87-8f90-599d48665b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:20.659187 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0affe-2dec-4f87-8f90-599d48665b04 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:20.659888 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0affe-2dec-4f87-8f90-599d48665b04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:20.673598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0affe-2dec-4f87-8f90-599d48665b04 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:20.734150 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fcb36-58f9-448b-aaa2-ae168e1eae61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:20.735053 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fcb36-58f9-448b-aaa2-ae168e1eae61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:20.735338 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fcb36-58f9-448b-aaa2-ae168e1eae61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:20.735619 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fcb36-58f9-448b-aaa2-ae168e1eae61 admin admin] PATH_INFO: `/v3/projects/e482510287414da8acf71fb41ebd3122` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:20.740163 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fcb36-58f9-448b-aaa2-ae168e1eae61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e482510287414da8acf71fb41ebd3122)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:20.744031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fcb36-58f9-448b-aaa2-ae168e1eae61 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:20.778552 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 897/1773] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:20 2022] POST /identity/v3/users => generated 286 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:20.778552 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0affe-2dec-4f87-8f90-599d48665b04 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:20.800313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7eb0affe-2dec-4f87-8f90-599d48665b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:20.953894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:20.973679 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:20.997748 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6b6fcb36-58f9-448b-aaa2-ae168e1eae61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e482510287414da8acf71fb41ebd3122', 'request_id': 'req-6b6fcb36-58f9-448b-aaa2-ae168e1eae61'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:21.013552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6b6fcb36-58f9-448b-aaa2-ae168e1eae61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e482510287414da8acf71fb41ebd3122', 'request_id': 'req-6b6fcb36-58f9-448b-aaa2-ae168e1eae61'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:21.024554 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6b6fcb36-58f9-448b-aaa2-ae168e1eae61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e482510287414da8acf71fb41ebd3122', 'request_id': 'req-6b6fcb36-58f9-448b-aaa2-ae168e1eae61'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:21.075549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6b6fcb36-58f9-448b-aaa2-ae168e1eae61 admin admin] The token cache is being invalidate because project e482510287414da8acf71fb41ebd3122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:21.076125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6b6fcb36-58f9-448b-aaa2-ae168e1eae61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:21.076685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6b6fcb36-58f9-448b-aaa2-ae168e1eae61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:21.085467 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 877/1774] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:20 2022] DELETE /identity/v3/projects/e482510287414da8acf71fb41ebd3122 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:21.086489 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fcb36-58f9-448b-aaa2-ae168e1eae61 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:21.093758 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6b6fcb36-58f9-448b-aaa2-ae168e1eae61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:21.106901 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0affe-2dec-4f87-8f90-599d48665b04 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:21.201511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586de4b6-1cb9-4a29-85d5-44ff553c257e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:21.202386 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586de4b6-1cb9-4a29-85d5-44ff553c257e service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:21.202776 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586de4b6-1cb9-4a29-85d5-44ff553c257e service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:21.203158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586de4b6-1cb9-4a29-85d5-44ff553c257e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:21.205734 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-586de4b6-1cb9-4a29-85d5-44ff553c257e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:21.235928 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586de4b6-1cb9-4a29-85d5-44ff553c257e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:21.237316 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586de4b6-1cb9-4a29-85d5-44ff553c257e service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:21.245132 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fcb36-58f9-448b-aaa2-ae168e1eae61 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:21.252172 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 898/1775] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:21.264494 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378c507-893b-4964-b5f7-ee2a55e180cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:21.265203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378c507-893b-4964-b5f7-ee2a55e180cf admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:21.265493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378c507-893b-4964-b5f7-ee2a55e180cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:21.265772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378c507-893b-4964-b5f7-ee2a55e180cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:21.266523 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e48a1-8106-4845-8380-5b74e5a5d94f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:21.266641 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378c507-893b-4964-b5f7-ee2a55e180cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:21.266992 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e48a1-8106-4845-8380-5b74e5a5d94f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:21.267462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e48a1-8106-4845-8380-5b74e5a5d94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:21.269025 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378c507-893b-4964-b5f7-ee2a55e180cf admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:21.299822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 878/1776] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:21.303992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378c507-893b-4964-b5f7-ee2a55e180cf admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:21.311734 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4e5e48a1-8106-4845-8380-5b74e5a5d94f None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:21.313107 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4e5e48a1-8106-4845-8380-5b74e5a5d94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:21.334567 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378c507-893b-4964-b5f7-ee2a55e180cf admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:21.336100 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 899/1777] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:21.344045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af431c-3e0c-4482-b829-a7c4dd04c16b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:21.344489 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af431c-3e0c-4482-b829-a7c4dd04c16b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:21.344828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af431c-3e0c-4482-b829-a7c4dd04c16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:21.356637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f22a2-0b38-4997-bfc1-684f4930f114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:21.358326 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f22a2-0b38-4997-bfc1-684f4930f114 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:21.359515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f22a2-0b38-4997-bfc1-684f4930f114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:21.359871 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f22a2-0b38-4997-bfc1-684f4930f114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:21.362510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f22a2-0b38-4997-bfc1-684f4930f114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:21.368670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f22a2-0b38-4997-bfc1-684f4930f114 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:21.393504 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 879/1778] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:21.396593 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f22a2-0b38-4997-bfc1-684f4930f114 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:21.416851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f22a2-0b38-4997-bfc1-684f4930f114 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:21.433882 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f0af431c-3e0c-4482-b829-a7c4dd04c16b None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:21.434882 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7e97a-1728-4925-bb73-6ceed84a54ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:21.436294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f0af431c-3e0c-4482-b829-a7c4dd04c16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:21.438675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7e97a-1728-4925-bb73-6ceed84a54ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:21.439131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7e97a-1728-4925-bb73-6ceed84a54ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:21.439775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7e97a-1728-4925-bb73-6ceed84a54ee admin admin] PATH_INFO: `/v3/projects/1f9437338d1c4c1f88862a34c887d4be/users/4e14f750e7954553a7679a2e3701918d/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:21.483079 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7e97a-1728-4925-bb73-6ceed84a54ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9437338d1c4c1f88862a34c887d4be, user_id=4e14f750e7954553a7679a2e3701918d, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:21.485824 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7e97a-1728-4925-bb73-6ceed84a54ee admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:21.502249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 900/1779] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:21.506852 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af431c-3e0c-4482-b829-a7c4dd04c16b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:21.536698 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 880/1780] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:21 2022] PUT /identity/v3/projects/1f9437338d1c4c1f88862a34c887d4be/users/4e14f750e7954553a7679a2e3701918d/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:21.538572 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2340a-2883-4eea-b061-e5383e3998bd None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:21.538868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2340a-2883-4eea-b061-e5383e3998bd None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:21.539153 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2340a-2883-4eea-b061-e5383e3998bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:21.572973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af431c-3e0c-4482-b829-a7c4dd04c16b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:21.623104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-02e2340a-2883-4eea-b061-e5383e3998bd None None] MFA Rules not processed for user `4e14f750e7954553a7679a2e3701918d`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:21.624438 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-02e2340a-2883-4eea-b061-e5383e3998bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:21.744380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd864cce-d742-40f6-9471-5f4de396beca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:21.745531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd864cce-d742-40f6-9471-5f4de396beca admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:21.745982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd864cce-d742-40f6-9471-5f4de396beca admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:21.746503 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd864cce-d742-40f6-9471-5f4de396beca admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:21.747454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd864cce-d742-40f6-9471-5f4de396beca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:15:21.747925 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd864cce-d742-40f6-9471-5f4de396beca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:21.749819 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd864cce-d742-40f6-9471-5f4de396beca admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:21.781600 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 901/1781] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:15:21.783208 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd864cce-d742-40f6-9471-5f4de396beca admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:21.792575 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bd864cce-d742-40f6-9471-5f4de396beca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:21.818518 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd864cce-d742-40f6-9471-5f4de396beca admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:21.827571 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20598f9d-df21-4f22-94fe-8d606a567f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:21.828745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20598f9d-df21-4f22-94fe-8d606a567f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:21.831101 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20598f9d-df21-4f22-94fe-8d606a567f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:21.831534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20598f9d-df21-4f22-94fe-8d606a567f2d admin admin] PATH_INFO: `/v3/projects/af9ea293befa420f975f55e2001f4f6d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:21.834782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20598f9d-df21-4f22-94fe-8d606a567f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=af9ea293befa420f975f55e2001f4f6d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:21.837364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20598f9d-df21-4f22-94fe-8d606a567f2d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:21.895023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:21.908017 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 881/1782] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:21.909922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2340a-2883-4eea-b061-e5383e3998bd None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:21.925676 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2340a-2883-4eea-b061-e5383e3998bd None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:21.932575 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4ba78-ec69-4e11-a5c5-9bf52578e986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:21.934187 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4ba78-ec69-4e11-a5c5-9bf52578e986 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:21.934650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4ba78-ec69-4e11-a5c5-9bf52578e986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:21.936967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4ba78-ec69-4e11-a5c5-9bf52578e986 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:21.938295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4ba78-ec69-4e11-a5c5-9bf52578e986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:21.941755 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4ba78-ec69-4e11-a5c5-9bf52578e986 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:21.961831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:22.010722 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-20598f9d-df21-4f22-94fe-8d606a567f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af9ea293befa420f975f55e2001f4f6d', 'request_id': 'req-20598f9d-df21-4f22-94fe-8d606a567f2d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:22.017641 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-20598f9d-df21-4f22-94fe-8d606a567f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af9ea293befa420f975f55e2001f4f6d', 'request_id': 'req-20598f9d-df21-4f22-94fe-8d606a567f2d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:22.023577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 882/1783] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:21 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:22.025161 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-20598f9d-df21-4f22-94fe-8d606a567f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af9ea293befa420f975f55e2001f4f6d', 'request_id': 'req-20598f9d-df21-4f22-94fe-8d606a567f2d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:22.026012 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4ba78-ec69-4e11-a5c5-9bf52578e986 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:22.031983 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5cd4ba78-ec69-4e11-a5c5-9bf52578e986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:22.060519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-20598f9d-df21-4f22-94fe-8d606a567f2d admin admin] The token cache is being invalidate because project af9ea293befa420f975f55e2001f4f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:22.061514 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-20598f9d-df21-4f22-94fe-8d606a567f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:22.061514 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-20598f9d-df21-4f22-94fe-8d606a567f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:22.063667 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 902/1784] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:21 2022] DELETE /identity/v3/projects/af9ea293befa420f975f55e2001f4f6d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:22.064512 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20598f9d-df21-4f22-94fe-8d606a567f2d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:22.065897 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-20598f9d-df21-4f22-94fe-8d606a567f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:22.248721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4ba78-ec69-4e11-a5c5-9bf52578e986 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:22.264139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b6cfe-6223-4cb1-b9df-09e4194727ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:22.265890 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b6cfe-6223-4cb1-b9df-09e4194727ff service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:22.268876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b6cfe-6223-4cb1-b9df-09e4194727ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:22.269154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b6cfe-6223-4cb1-b9df-09e4194727ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:22.276375 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a53b6cfe-6223-4cb1-b9df-09e4194727ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:22.359433 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20598f9d-df21-4f22-94fe-8d606a567f2d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:22.388029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b6cfe-6223-4cb1-b9df-09e4194727ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:22.389570 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b6cfe-6223-4cb1-b9df-09e4194727ff service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:22.418360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 883/1785] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:22.420821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7491d-7a47-4486-877c-af39fc75504d None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:22.421124 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7491d-7a47-4486-877c-af39fc75504d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:22.421447 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7491d-7a47-4486-877c-af39fc75504d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:22.489066 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-64e7491d-7a47-4486-877c-af39fc75504d None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:22.490399 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-64e7491d-7a47-4486-877c-af39fc75504d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:22.522848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d633a-cf5b-4901-966f-8e7e7d7f07d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:22.524883 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d633a-cf5b-4901-966f-8e7e7d7f07d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:22.526270 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d633a-cf5b-4901-966f-8e7e7d7f07d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:22.527007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d633a-cf5b-4901-966f-8e7e7d7f07d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:22.527957 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d633a-cf5b-4901-966f-8e7e7d7f07d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:22.549745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d633a-cf5b-4901-966f-8e7e7d7f07d0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:22.613588 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 903/1786] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:22 2022] POST /identity/v3/users => generated 291 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:22.616909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d633a-cf5b-4901-966f-8e7e7d7f07d0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:22.622849 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-367d633a-cf5b-4901-966f-8e7e7d7f07d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:22.661106 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d633a-cf5b-4901-966f-8e7e7d7f07d0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:22.676862 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddfd03-579a-410c-8c26-1cb790c2b8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:22.678214 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddfd03-579a-410c-8c26-1cb790c2b8e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:22.679872 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddfd03-579a-410c-8c26-1cb790c2b8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:22.680989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddfd03-579a-410c-8c26-1cb790c2b8e2 admin admin] PATH_INFO: `/v3/users/4e14f750e7954553a7679a2e3701918d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:22.683000 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddfd03-579a-410c-8c26-1cb790c2b8e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e14f750e7954553a7679a2e3701918d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:22.686113 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddfd03-579a-410c-8c26-1cb790c2b8e2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:22.690703 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 884/1787] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:22.691815 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7491d-7a47-4486-877c-af39fc75504d None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:22.716622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7491d-7a47-4486-877c-af39fc75504d None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:22.736357 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20743c32-ff95-42de-8a57-6dd1b8bba632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:22.737201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20743c32-ff95-42de-8a57-6dd1b8bba632 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:22.737560 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20743c32-ff95-42de-8a57-6dd1b8bba632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:22.737911 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20743c32-ff95-42de-8a57-6dd1b8bba632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:22.738768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20743c32-ff95-42de-8a57-6dd1b8bba632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:22.740800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20743c32-ff95-42de-8a57-6dd1b8bba632 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:22.761624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 885/1788] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:22.763366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb759716-7db3-4da4-9c6d-202144f21ed5 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:22.764410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb759716-7db3-4da4-9c6d-202144f21ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:22.764410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb759716-7db3-4da4-9c6d-202144f21ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:22.793682 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:22.817273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-62ddfd03-579a-410c-8c26-1cb790c2b8e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e14f750e7954553a7679a2e3701918d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:22.818238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-62ddfd03-579a-410c-8c26-1cb790c2b8e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e14f750e7954553a7679a2e3701918d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:22.818917 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-62ddfd03-579a-410c-8c26-1cb790c2b8e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e14f750e7954553a7679a2e3701918d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:22.820298 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-cb759716-7db3-4da4-9c6d-202144f21ed5 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:22.829269 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-cb759716-7db3-4da4-9c6d-202144f21ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:22.847385 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-62ddfd03-579a-410c-8c26-1cb790c2b8e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e14f750e7954553a7679a2e3701918d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:22.858675 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-62ddfd03-579a-410c-8c26-1cb790c2b8e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e14f750e7954553a7679a2e3701918d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:22.870599 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 886/1789] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:22.871570 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb759716-7db3-4da4-9c6d-202144f21ed5 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:22.876007 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-cb759716-7db3-4da4-9c6d-202144f21ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:22.891036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 904/1790] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:22 2022] DELETE /identity/v3/users/4e14f750e7954553a7679a2e3701918d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:22.892132 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddfd03-579a-410c-8c26-1cb790c2b8e2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:22.914891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb759716-7db3-4da4-9c6d-202144f21ed5 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:22.982029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:23.082702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddfd03-579a-410c-8c26-1cb790c2b8e2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:23.093421 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6067c-f58e-4468-b1d3-00c886650b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:23.094131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6067c-f58e-4468-b1d3-00c886650b7f admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:23.094411 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6067c-f58e-4468-b1d3-00c886650b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:23.094694 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6067c-f58e-4468-b1d3-00c886650b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:23.098473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6067c-f58e-4468-b1d3-00c886650b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:23.100335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6067c-f58e-4468-b1d3-00c886650b7f admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:23.100757 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803463e6-9a74-4000-87ab-ac1e2b097fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:23.101717 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803463e6-9a74-4000-87ab-ac1e2b097fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:23.102908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803463e6-9a74-4000-87ab-ac1e2b097fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:23.103660 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803463e6-9a74-4000-87ab-ac1e2b097fd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:23.104859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803463e6-9a74-4000-87ab-ac1e2b097fd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:15:23.107365 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803463e6-9a74-4000-87ab-ac1e2b097fd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:23.111379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803463e6-9a74-4000-87ab-ac1e2b097fd1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:23.125884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 887/1791] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:23.127453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3afbf-2183-471a-bf68-1b415f79d51e None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:23.127741 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3afbf-2183-471a-bf68-1b415f79d51e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:23.128020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3afbf-2183-471a-bf68-1b415f79d51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:23.142359 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 905/1792] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:15:23.143769 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803463e6-9a74-4000-87ab-ac1e2b097fd1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:23.164998 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803463e6-9a74-4000-87ab-ac1e2b097fd1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:23.176158 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-45e3afbf-2183-471a-bf68-1b415f79d51e None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:23.177669 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-45e3afbf-2183-471a-bf68-1b415f79d51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:23.187674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 888/1793] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:23.188506 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3afbf-2183-471a-bf68-1b415f79d51e None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:23.189230 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91d7f7-05f4-45b4-8b1e-d894342d7e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:23.190524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91d7f7-05f4-45b4-8b1e-d894342d7e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:23.190958 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91d7f7-05f4-45b4-8b1e-d894342d7e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:23.191377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91d7f7-05f4-45b4-8b1e-d894342d7e7e admin admin] PATH_INFO: `/v3/projects/4f565ba4484d47c3bfa177c4bb58ac97/users/4e654ef0faa24b1588868f8a1be450ae/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:23.209161 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3afbf-2183-471a-bf68-1b415f79d51e None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:23.214483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f33a9-2d9b-493a-89b0-5e5403239994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:23.219677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91d7f7-05f4-45b4-8b1e-d894342d7e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f565ba4484d47c3bfa177c4bb58ac97, user_id=4e654ef0faa24b1588868f8a1be450ae, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:23.220874 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f33a9-2d9b-493a-89b0-5e5403239994 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:23.221325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f33a9-2d9b-493a-89b0-5e5403239994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:23.221895 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f33a9-2d9b-493a-89b0-5e5403239994 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:23.229619 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91d7f7-05f4-45b4-8b1e-d894342d7e7e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:23.234281 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f33a9-2d9b-493a-89b0-5e5403239994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:23.236909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f33a9-2d9b-493a-89b0-5e5403239994 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:23.280069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 906/1794] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:23 2022] PUT /identity/v3/projects/4f565ba4484d47c3bfa177c4bb58ac97/users/4e654ef0faa24b1588868f8a1be450ae/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:23.281988 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bb93e-ab5d-40bf-8803-599dc8be023e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:23.282364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bb93e-ab5d-40bf-8803-599dc8be023e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:23.282688 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bb93e-ab5d-40bf-8803-599dc8be023e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:23.342028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8e7bb93e-ab5d-40bf-8803-599dc8be023e None None] MFA Rules not processed for user `4e654ef0faa24b1588868f8a1be450ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:23.343696 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8e7bb93e-ab5d-40bf-8803-599dc8be023e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:23.369112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 889/1795] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:23 2022] POST /identity/v3/projects => generated 367 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:23.372154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f33a9-2d9b-493a-89b0-5e5403239994 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:23.539528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 907/1796] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:23.548836 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bb93e-ab5d-40bf-8803-599dc8be023e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:23.560405 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8e7bb93e-ab5d-40bf-8803-599dc8be023e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:23.594485 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f33a9-2d9b-493a-89b0-5e5403239994 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:23.599991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:23.613469 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f32eca-b1eb-4bb5-9d60-f2f26c7596bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:23.614204 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f32eca-b1eb-4bb5-9d60-f2f26c7596bb admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:23.614495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f32eca-b1eb-4bb5-9d60-f2f26c7596bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:23.614881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f32eca-b1eb-4bb5-9d60-f2f26c7596bb admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:23.615460 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f32eca-b1eb-4bb5-9d60-f2f26c7596bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:23.617439 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f32eca-b1eb-4bb5-9d60-f2f26c7596bb admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:23.686418 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 890/1797] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:23 2022] POST /identity/v3/users => generated 284 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:15:23.687989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f32eca-b1eb-4bb5-9d60-f2f26c7596bb admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:23.705930 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f32eca-b1eb-4bb5-9d60-f2f26c7596bb admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:23.717119 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac6c76-3c40-4184-a490-60f287a7cec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:23.718211 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac6c76-3c40-4184-a490-60f287a7cec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:23.718735 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac6c76-3c40-4184-a490-60f287a7cec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:23.719231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac6c76-3c40-4184-a490-60f287a7cec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:23.724309 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac6c76-3c40-4184-a490-60f287a7cec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:23.726880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac6c76-3c40-4184-a490-60f287a7cec9 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:23.740508 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bb93e-ab5d-40bf-8803-599dc8be023e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:23.817607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 891/1798] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:23 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:23.818553 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac6c76-3c40-4184-a490-60f287a7cec9 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:23.968859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4884ff-6ea4-4202-8ba7-9c20d9f9ffc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:23.969544 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4884ff-6ea4-4202-8ba7-9c20d9f9ffc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:23.969825 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4884ff-6ea4-4202-8ba7-9c20d9f9ffc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:23.970125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4884ff-6ea4-4202-8ba7-9c20d9f9ffc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:23.996672 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4884ff-6ea4-4202-8ba7-9c20d9f9ffc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:23.997947 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4884ff-6ea4-4202-8ba7-9c20d9f9ffc7 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:24.056046 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 908/1799] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:24.056046 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4884ff-6ea4-4202-8ba7-9c20d9f9ffc7 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:24.086051 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac6c76-3c40-4184-a490-60f287a7cec9 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:24.088077 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4884ff-6ea4-4202-8ba7-9c20d9f9ffc7 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:24.102099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1d76f-4143-4875-857b-b3b04f64e160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:24.102099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1d76f-4143-4875-857b-b3b04f64e160 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:24.102099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1d76f-4143-4875-857b-b3b04f64e160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:24.102099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1d76f-4143-4875-857b-b3b04f64e160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:24.111801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1d76f-4143-4875-857b-b3b04f64e160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:24.115612 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb7fe0-18b4-4894-b849-f6046f34344f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:24.116338 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb7fe0-18b4-4894-b849-f6046f34344f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:24.116586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb7fe0-18b4-4894-b849-f6046f34344f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:24.116858 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb7fe0-18b4-4894-b849-f6046f34344f admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:24.117561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb7fe0-18b4-4894-b849-f6046f34344f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:24.118331 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1d76f-4143-4875-857b-b3b04f64e160 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:24.119625 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb7fe0-18b4-4894-b849-f6046f34344f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:24.129243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:24.137161 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 892/1800] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:24.141955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1d76f-4143-4875-857b-b3b04f64e160 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:24.158973 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1d76f-4143-4875-857b-b3b04f64e160 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:24.165849 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253c7e2-42a2-4e43-ae65-a2f8355d3bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:24.166927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253c7e2-42a2-4e43-ae65-a2f8355d3bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:24.167374 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253c7e2-42a2-4e43-ae65-a2f8355d3bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:24.167727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253c7e2-42a2-4e43-ae65-a2f8355d3bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:24.168625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253c7e2-42a2-4e43-ae65-a2f8355d3bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:24.171525 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253c7e2-42a2-4e43-ae65-a2f8355d3bc7 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:24.186119 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 893/1801] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:24.188759 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 909/1802] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:24 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:24.196110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253c7e2-42a2-4e43-ae65-a2f8355d3bc7 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:24.198200 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb7fe0-18b4-4894-b849-f6046f34344f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:24.228323 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253c7e2-42a2-4e43-ae65-a2f8355d3bc7 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:24.231109 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb7fe0-18b4-4894-b849-f6046f34344f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:24.247821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822947f-a855-4ed6-9336-6451def78d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:24.248644 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822947f-a855-4ed6-9336-6451def78d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:24.248930 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822947f-a855-4ed6-9336-6451def78d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:24.249209 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822947f-a855-4ed6-9336-6451def78d50 admin admin] PATH_INFO: `/v3/projects/06204cf80e2648559ea5b2c2e884190a/users/91605e55310748ceab3f2a8a77ad7198/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:24.256961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9822303-ff10-4d25-8e1c-330c8ec17d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:24.257855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9822303-ff10-4d25-8e1c-330c8ec17d1e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:24.258270 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9822303-ff10-4d25-8e1c-330c8ec17d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:24.258787 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9822303-ff10-4d25-8e1c-330c8ec17d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:24.260352 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9822303-ff10-4d25-8e1c-330c8ec17d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:24.265375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9822303-ff10-4d25-8e1c-330c8ec17d1e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:24.277171 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822947f-a855-4ed6-9336-6451def78d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06204cf80e2648559ea5b2c2e884190a, user_id=91605e55310748ceab3f2a8a77ad7198, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:24.280469 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822947f-a855-4ed6-9336-6451def78d50 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:24.302623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 910/1803] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:24.304059 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9822303-ff10-4d25-8e1c-330c8ec17d1e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:24.326350 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 894/1804] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:24 2022] PUT /identity/v3/projects/06204cf80e2648559ea5b2c2e884190a/users/91605e55310748ceab3f2a8a77ad7198/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:24.328546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9822303-ff10-4d25-8e1c-330c8ec17d1e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:24.342184 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290419-d244-4034-8852-8c24563c9d52 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:24.343597 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290419-d244-4034-8852-8c24563c9d52 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:24.343957 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290419-d244-4034-8852-8c24563c9d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:24.422607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-7a290419-d244-4034-8852-8c24563c9d52 None None] MFA Rules not processed for user `91605e55310748ceab3f2a8a77ad7198`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:24.423778 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-7a290419-d244-4034-8852-8c24563c9d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:24.524665 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac7586-0f83-499e-875d-3d7d9dd9367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:24.525987 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac7586-0f83-499e-875d-3d7d9dd9367b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:24.526818 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac7586-0f83-499e-875d-3d7d9dd9367b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:24.527101 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac7586-0f83-499e-875d-3d7d9dd9367b admin admin] PATH_INFO: `/v3/projects/a904b878fc764e9ca4eee728ff542643/users/45c1ec39ddd74e35b3b34611fe542a04/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:24.551096 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac7586-0f83-499e-875d-3d7d9dd9367b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a904b878fc764e9ca4eee728ff542643, user_id=45c1ec39ddd74e35b3b34611fe542a04, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:24.554486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac7586-0f83-499e-875d-3d7d9dd9367b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:24.608043 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 911/1805] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:24 2022] PUT /identity/v3/projects/a904b878fc764e9ca4eee728ff542643/users/45c1ec39ddd74e35b3b34611fe542a04/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:24.612427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac7586-0f83-499e-875d-3d7d9dd9367b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:24.665972 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 895/1806] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:24.670751 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290419-d244-4034-8852-8c24563c9d52 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:24.697013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:24.698799 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290419-d244-4034-8852-8c24563c9d52 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:24.767594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac7586-0f83-499e-875d-3d7d9dd9367b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:24.786262 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447696f-5f6b-4561-a31f-c00fbaec6e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:24.787200 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447696f-5f6b-4561-a31f-c00fbaec6e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:24.787487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447696f-5f6b-4561-a31f-c00fbaec6e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:24.787791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447696f-5f6b-4561-a31f-c00fbaec6e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:24.788496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447696f-5f6b-4561-a31f-c00fbaec6e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:24.790180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447696f-5f6b-4561-a31f-c00fbaec6e31 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:24.814435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 912/1807] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:24.822244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447696f-5f6b-4561-a31f-c00fbaec6e31 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:24.835279 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04e1c0-26d9-402a-b948-ca06cc32446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:24.837419 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04e1c0-26d9-402a-b948-ca06cc32446a admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:24.838277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04e1c0-26d9-402a-b948-ca06cc32446a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:24.838657 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04e1c0-26d9-402a-b948-ca06cc32446a admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:24.839690 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04e1c0-26d9-402a-b948-ca06cc32446a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:24.845883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04e1c0-26d9-402a-b948-ca06cc32446a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:24.848074 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447696f-5f6b-4561-a31f-c00fbaec6e31 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:24.858912 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed1708-bc5a-4bee-a5c2-e75ea8598cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:24.859480 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed1708-bc5a-4bee-a5c2-e75ea8598cae admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:24.859752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed1708-bc5a-4bee-a5c2-e75ea8598cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:24.860036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed1708-bc5a-4bee-a5c2-e75ea8598cae admin admin] PATH_INFO: `/v3/projects/a904b878fc764e9ca4eee728ff542643/users/45c1ec39ddd74e35b3b34611fe542a04/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:24.862687 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed1708-bc5a-4bee-a5c2-e75ea8598cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=a904b878fc764e9ca4eee728ff542643, user_id=45c1ec39ddd74e35b3b34611fe542a04, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:24.866133 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed1708-bc5a-4bee-a5c2-e75ea8598cae admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:24.891528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 913/1808] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:24 2022] PUT /identity/v3/projects/a904b878fc764e9ca4eee728ff542643/users/45c1ec39ddd74e35b3b34611fe542a04/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:24.894090 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 896/1809] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:24 2022] POST /identity/v3/projects => generated 367 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:24.898427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed1708-bc5a-4bee-a5c2-e75ea8598cae admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:24.904899 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f8deb-6f83-4e80-8826-5b9e6f99d573 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:24.905538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f8deb-6f83-4e80-8826-5b9e6f99d573 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:24.907383 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f8deb-6f83-4e80-8826-5b9e6f99d573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:24.978795 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-076f8deb-6f83-4e80-8826-5b9e6f99d573 None None] MFA Rules not processed for user `45c1ec39ddd74e35b3b34611fe542a04`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:24.981514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-076f8deb-6f83-4e80-8826-5b9e6f99d573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:25.047878 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed1708-bc5a-4bee-a5c2-e75ea8598cae admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:25.055000 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:25.168810 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 897/1810] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:25.188997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f8deb-6f83-4e80-8826-5b9e6f99d573 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:25.191188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-076f8deb-6f83-4e80-8826-5b9e6f99d573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:25.238619 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e776d0f-077c-412d-ae9e-ef5a8bc283f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:25.239911 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e776d0f-077c-412d-ae9e-ef5a8bc283f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:25.240566 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e776d0f-077c-412d-ae9e-ef5a8bc283f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:25.241173 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e776d0f-077c-412d-ae9e-ef5a8bc283f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:25.245218 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e776d0f-077c-412d-ae9e-ef5a8bc283f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:25.255787 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e776d0f-077c-412d-ae9e-ef5a8bc283f6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:25.304125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 914/1811] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:24 2022] POST /identity/v3/users => generated 290 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:15:25.308850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e776d0f-077c-412d-ae9e-ef5a8bc283f6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:25.324815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e776d0f-077c-412d-ae9e-ef5a8bc283f6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:25.343647 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56e51d-ebd5-4d7f-a44c-531afb803f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:25.344342 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56e51d-ebd5-4d7f-a44c-531afb803f8f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:25.344735 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56e51d-ebd5-4d7f-a44c-531afb803f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:25.345149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56e51d-ebd5-4d7f-a44c-531afb803f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:25.346185 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56e51d-ebd5-4d7f-a44c-531afb803f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:25.347944 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56e51d-ebd5-4d7f-a44c-531afb803f8f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:25.380738 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 915/1812] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:25.385523 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56e51d-ebd5-4d7f-a44c-531afb803f8f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:25.391723 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f8deb-6f83-4e80-8826-5b9e6f99d573 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:25.418527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56e51d-ebd5-4d7f-a44c-531afb803f8f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:25.426198 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea71ee1-2919-4e89-8f40-56f558bd8e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:25.431546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea71ee1-2919-4e89-8f40-56f558bd8e16 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:25.438519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5060b-6a98-4021-898a-5d274da9a408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:25.444087 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea71ee1-2919-4e89-8f40-56f558bd8e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:25.444862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea71ee1-2919-4e89-8f40-56f558bd8e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:25.447444 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5060b-6a98-4021-898a-5d274da9a408 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:25.447444 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5060b-6a98-4021-898a-5d274da9a408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:25.447444 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5060b-6a98-4021-898a-5d274da9a408 admin admin] PATH_INFO: `/v3/projects/71775179cb1b43e7b0336906b6c78b79/users/c376ea12fabb44839d8ef28bfe834f1d/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:25.464084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea71ee1-2919-4e89-8f40-56f558bd8e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:25.466073 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea71ee1-2919-4e89-8f40-56f558bd8e16 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:25.489549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 898/1813] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:15:25.497190 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5060b-6a98-4021-898a-5d274da9a408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71775179cb1b43e7b0336906b6c78b79, user_id=c376ea12fabb44839d8ef28bfe834f1d, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:25.500399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5060b-6a98-4021-898a-5d274da9a408 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:25.522782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 916/1814] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:25 2022] PUT /identity/v3/projects/71775179cb1b43e7b0336906b6c78b79/users/c376ea12fabb44839d8ef28bfe834f1d/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:25.525244 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea71ee1-2919-4e89-8f40-56f558bd8e16 service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:25.540867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea71ee1-2919-4e89-8f40-56f558bd8e16 service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:25.675470 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d570fa2-ea5b-4185-b48d-732603aa0c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:25.676150 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d570fa2-ea5b-4185-b48d-732603aa0c49 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:25.676435 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d570fa2-ea5b-4185-b48d-732603aa0c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:25.676703 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d570fa2-ea5b-4185-b48d-732603aa0c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:25.677436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d570fa2-ea5b-4185-b48d-732603aa0c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:25.687245 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d570fa2-ea5b-4185-b48d-732603aa0c49 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:25.709156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 899/1815] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:15:25.713747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5060b-6a98-4021-898a-5d274da9a408 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:25.722757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d570fa2-ea5b-4185-b48d-732603aa0c49 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:25.731190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-3d570fa2-ea5b-4185-b48d-732603aa0c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:25.733230 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5060b-6a98-4021-898a-5d274da9a408 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:25.737965 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6905d-a5d6-49e7-848b-1bd3cbcfaf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:25.738999 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6905d-a5d6-49e7-848b-1bd3cbcfaf54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:25.739339 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6905d-a5d6-49e7-848b-1bd3cbcfaf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:25.739649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6905d-a5d6-49e7-848b-1bd3cbcfaf54 admin admin] PATH_INFO: `/v3/projects/71775179cb1b43e7b0336906b6c78b79/users/c376ea12fabb44839d8ef28bfe834f1d/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:25.742430 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6905d-a5d6-49e7-848b-1bd3cbcfaf54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71775179cb1b43e7b0336906b6c78b79, user_id=c376ea12fabb44839d8ef28bfe834f1d, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:25.745535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6905d-a5d6-49e7-848b-1bd3cbcfaf54 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:25.752633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:25.762698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 917/1816] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:25 2022] PUT /identity/v3/projects/71775179cb1b43e7b0336906b6c78b79/users/c376ea12fabb44839d8ef28bfe834f1d/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:25.784500 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0afb9-cbbb-424a-994f-8856bf2c3d3a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:25.785133 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0afb9-cbbb-424a-994f-8856bf2c3d3a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:25.785326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0afb9-cbbb-424a-994f-8856bf2c3d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:25.845382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d570fa2-ea5b-4185-b48d-732603aa0c49 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:25.853394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-dec0afb9-cbbb-424a-994f-8856bf2c3d3a None None] MFA Rules not processed for user `c376ea12fabb44839d8ef28bfe834f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:25.855207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dec0afb9-cbbb-424a-994f-8856bf2c3d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:25.881808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:25.985421 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb571b-6301-4c98-b4ae-751cd731cb5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:25.986268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb571b-6301-4c98-b4ae-751cd731cb5d service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:25.986617 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb571b-6301-4c98-b4ae-751cd731cb5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:25.986960 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb571b-6301-4c98-b4ae-751cd731cb5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:26.023204 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 918/1817] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:15:26.025211 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b6dc3-9d00-4904-8129-bac8022478d2 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:26.025502 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b6dc3-9d00-4904-8129-bac8022478d2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:26.025781 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b6dc3-9d00-4904-8129-bac8022478d2 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:26.032890 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 919/1818] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 12:15:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:15:26.114615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b6dc3-9d00-4904-8129-bac8022478d2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:26.125685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb571b-6301-4c98-b4ae-751cd731cb5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:26.127375 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb571b-6301-4c98-b4ae-751cd731cb5d service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:26.129938 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b6dc3-9d00-4904-8129-bac8022478d2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:26.134234 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c537394-53e2-4a3e-a421-913b8af8b3e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:26.134886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c537394-53e2-4a3e-a421-913b8af8b3e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:26.135163 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c537394-53e2-4a3e-a421-913b8af8b3e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:26.135574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c537394-53e2-4a3e-a421-913b8af8b3e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:26.140060 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 900/1819] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:15:26.157470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c537394-53e2-4a3e-a421-913b8af8b3e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:26.159649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c537394-53e2-4a3e-a421-913b8af8b3e5 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:26.185511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 920/1820] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:26 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:15:26.197413 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c46e63-a450-4205-8060-b3e7af29b199 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:26.197953 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c46e63-a450-4205-8060-b3e7af29b199 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:26.199082 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c46e63-a450-4205-8060-b3e7af29b199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:26.247370 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-e3c46e63-a450-4205-8060-b3e7af29b199 None None] MFA Rules not processed for user `6d9db26891a04b0bb7e655c21feeffdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:26.249949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-e3c46e63-a450-4205-8060-b3e7af29b199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:26.281487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c537394-53e2-4a3e-a421-913b8af8b3e5 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:26.283043 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4c537394-53e2-4a3e-a421-913b8af8b3e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:26.422350 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 901/1821] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 12:15:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:15:26.448881 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c537394-53e2-4a3e-a421-913b8af8b3e5 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:26.459762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1c858-114b-4c84-9c36-dea496e5e020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:26.460706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1c858-114b-4c84-9c36-dea496e5e020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:26.460981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1c858-114b-4c84-9c36-dea496e5e020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:26.470561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1c858-114b-4c84-9c36-dea496e5e020 admin admin] PATH_INFO: `/v3/projects/1f9437338d1c4c1f88862a34c887d4be` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:26.471290 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c46e63-a450-4205-8060-b3e7af29b199 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:26.472978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-e3c46e63-a450-4205-8060-b3e7af29b199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:26.478805 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1c858-114b-4c84-9c36-dea496e5e020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9437338d1c4c1f88862a34c887d4be)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:26.483648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1c858-114b-4c84-9c36-dea496e5e020 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:26.505676 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c46e63-a450-4205-8060-b3e7af29b199 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:26.534418 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8651ce-e736-482f-b0c8-b906e11a5466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:26.535429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8651ce-e736-482f-b0c8-b906e11a5466 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:26.536061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8651ce-e736-482f-b0c8-b906e11a5466 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:26.536939 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8651ce-e736-482f-b0c8-b906e11a5466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:26.567908 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8651ce-e736-482f-b0c8-b906e11a5466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:26.569531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8651ce-e736-482f-b0c8-b906e11a5466 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:26.584618 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0dd1c858-114b-4c84-9c36-dea496e5e020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9437338d1c4c1f88862a34c887d4be', 'request_id': 'req-0dd1c858-114b-4c84-9c36-dea496e5e020'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:26.598379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 902/1822] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:15:26.599191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0dd1c858-114b-4c84-9c36-dea496e5e020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9437338d1c4c1f88862a34c887d4be', 'request_id': 'req-0dd1c858-114b-4c84-9c36-dea496e5e020'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:26.606768 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0dd1c858-114b-4c84-9c36-dea496e5e020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9437338d1c4c1f88862a34c887d4be', 'request_id': 'req-0dd1c858-114b-4c84-9c36-dea496e5e020'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:26.625033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:26.632789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0dd1c858-114b-4c84-9c36-dea496e5e020 admin admin] The token cache is being invalidate because project 1f9437338d1c4c1f88862a34c887d4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:26.633120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0dd1c858-114b-4c84-9c36-dea496e5e020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:26.634590 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0dd1c858-114b-4c84-9c36-dea496e5e020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:26.638783 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 921/1823] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:26 2022] DELETE /identity/v3/projects/1f9437338d1c4c1f88862a34c887d4be => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:26.643518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e050419-095c-4060-8b77-2f8523ecd532 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:26.643952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e050419-095c-4060-8b77-2f8523ecd532 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:26.644444 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e050419-095c-4060-8b77-2f8523ecd532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:26.668510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-3e050419-095c-4060-8b77-2f8523ecd532 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:26.669743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-3e050419-095c-4060-8b77-2f8523ecd532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:26.723977 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:26.745296 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 903/1824] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:26.753228 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ffd64-aaf1-4ac4-8d03-82d9669b385b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:26.753716 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ffd64-aaf1-4ac4-8d03-82d9669b385b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:26.753790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ffd64-aaf1-4ac4-8d03-82d9669b385b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:26.786365 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a69ffd64-aaf1-4ac4-8d03-82d9669b385b None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:26.788129 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a69ffd64-aaf1-4ac4-8d03-82d9669b385b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:26.830806 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 922/1825] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:26.831567 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e050419-095c-4060-8b77-2f8523ecd532 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:26.847311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e050419-095c-4060-8b77-2f8523ecd532 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:26.853273 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c7f9c-7b60-49d8-b98f-f4b56141c8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:26.854470 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c7f9c-7b60-49d8-b98f-f4b56141c8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:26.854991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c7f9c-7b60-49d8-b98f-f4b56141c8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:26.855479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c7f9c-7b60-49d8-b98f-f4b56141c8d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:26.857118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c7f9c-7b60-49d8-b98f-f4b56141c8d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:15:26.857636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c7f9c-7b60-49d8-b98f-f4b56141c8d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:26.859754 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c7f9c-7b60-49d8-b98f-f4b56141c8d8 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:26.882755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ffd64-aaf1-4ac4-8d03-82d9669b385b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:26.888968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 904/1826] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:15:26.907011 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ffd64-aaf1-4ac4-8d03-82d9669b385b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:26.916883 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fdc5b-e73e-42e4-b3ea-7360c123c1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:26.918912 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fdc5b-e73e-42e4-b3ea-7360c123c1ce admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:26.920229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fdc5b-e73e-42e4-b3ea-7360c123c1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:26.920638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fdc5b-e73e-42e4-b3ea-7360c123c1ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:26.921394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fdc5b-e73e-42e4-b3ea-7360c123c1ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:26.926144 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fdc5b-e73e-42e4-b3ea-7360c123c1ce admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:27.002233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 923/1827] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:26 2022] POST /identity/v3/projects => generated 361 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:15:27.005493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c7f9c-7b60-49d8-b98f-f4b56141c8d8 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:27.020443 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c7f9c-7b60-49d8-b98f-f4b56141c8d8 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:27.141696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e941a0-b080-41ad-877e-831e9d2eec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:27.142111 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e941a0-b080-41ad-877e-831e9d2eec86 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:27.149386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e941a0-b080-41ad-877e-831e9d2eec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:27.149386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e941a0-b080-41ad-877e-831e9d2eec86 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:27.150859 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e941a0-b080-41ad-877e-831e9d2eec86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:27.155764 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e941a0-b080-41ad-877e-831e9d2eec86 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:27.195271 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 905/1828] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:27 2022] POST /identity/v3/users => generated 281 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:15:27.204567 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fdc5b-e73e-42e4-b3ea-7360c123c1ce admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:27.252781 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fdc5b-e73e-42e4-b3ea-7360c123c1ce admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:27.258993 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5914a-997a-4f29-9170-b82104343f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:27.260457 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5914a-997a-4f29-9170-b82104343f98 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:27.261338 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5914a-997a-4f29-9170-b82104343f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:27.261338 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5914a-997a-4f29-9170-b82104343f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:27.262682 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5914a-997a-4f29-9170-b82104343f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:27.264689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5914a-997a-4f29-9170-b82104343f98 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:27.293203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e941a0-b080-41ad-877e-831e9d2eec86 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:27.299904 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 924/1829] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:27.326675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e941a0-b080-41ad-877e-831e9d2eec86 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:27.349699 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859edb9-c315-442a-ac49-837f6e03907d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:27.350673 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859edb9-c315-442a-ac49-837f6e03907d admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:27.351300 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859edb9-c315-442a-ac49-837f6e03907d admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:27.353062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859edb9-c315-442a-ac49-837f6e03907d admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:27.354827 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859edb9-c315-442a-ac49-837f6e03907d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:27.358105 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859edb9-c315-442a-ac49-837f6e03907d admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:27.382681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 906/1830] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:27.387246 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5914a-997a-4f29-9170-b82104343f98 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:27.412813 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5914a-997a-4f29-9170-b82104343f98 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:27.419209 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc055b56-ee17-472f-bcbc-a4a811697c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:27.420126 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc055b56-ee17-472f-bcbc-a4a811697c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:27.420412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc055b56-ee17-472f-bcbc-a4a811697c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:27.420689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc055b56-ee17-472f-bcbc-a4a811697c66 admin admin] PATH_INFO: `/v3/projects/ef8face11b2a4fb295bd7f5156613b91/users/38c29100ab8349a993847ec23aab9bd5/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:27.469593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc055b56-ee17-472f-bcbc-a4a811697c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8face11b2a4fb295bd7f5156613b91, user_id=38c29100ab8349a993847ec23aab9bd5, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:27.477674 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc055b56-ee17-472f-bcbc-a4a811697c66 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:27.505743 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 925/1831] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:27 2022] PUT /identity/v3/projects/ef8face11b2a4fb295bd7f5156613b91/users/38c29100ab8349a993847ec23aab9bd5/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:27.519211 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2d351-7d79-4dc2-9e1c-b5935391ebc5 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:27.519451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2d351-7d79-4dc2-9e1c-b5935391ebc5 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:27.519712 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2d351-7d79-4dc2-9e1c-b5935391ebc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:27.577891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-96c2d351-7d79-4dc2-9e1c-b5935391ebc5 None None] MFA Rules not processed for user `38c29100ab8349a993847ec23aab9bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:27.579230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-96c2d351-7d79-4dc2-9e1c-b5935391ebc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:27.678665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 907/1832] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:27.715463 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc055b56-ee17-472f-bcbc-a4a811697c66 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:27.718614 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cc055b56-ee17-472f-bcbc-a4a811697c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:27.792036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc055b56-ee17-472f-bcbc-a4a811697c66 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:27.802129 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ffd37-8545-4f9c-b295-e61535eacfd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:27.802129 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ffd37-8545-4f9c-b295-e61535eacfd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:27.802129 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ffd37-8545-4f9c-b295-e61535eacfd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:27.802129 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ffd37-8545-4f9c-b295-e61535eacfd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:27.812097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ffd37-8545-4f9c-b295-e61535eacfd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:27.813538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ffd37-8545-4f9c-b295-e61535eacfd3 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:27.823875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 926/1833] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:27.842366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2d351-7d79-4dc2-9e1c-b5935391ebc5 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:27.968601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:28.009275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2d351-7d79-4dc2-9e1c-b5935391ebc5 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:28.020411 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff8f8c-b841-4b35-b2fb-5d99d0066132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:28.021774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff8f8c-b841-4b35-b2fb-5d99d0066132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:28.038182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff8f8c-b841-4b35-b2fb-5d99d0066132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:28.038182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff8f8c-b841-4b35-b2fb-5d99d0066132 admin admin] PATH_INFO: `/v3/users/38c29100ab8349a993847ec23aab9bd5` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:28.038182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff8f8c-b841-4b35-b2fb-5d99d0066132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c29100ab8349a993847ec23aab9bd5)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:28.038182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff8f8c-b841-4b35-b2fb-5d99d0066132 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:28.141830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-f7ff8f8c-b841-4b35-b2fb-5d99d0066132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c29100ab8349a993847ec23aab9bd5'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:28.142626 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-f7ff8f8c-b841-4b35-b2fb-5d99d0066132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c29100ab8349a993847ec23aab9bd5'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:28.143320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-f7ff8f8c-b841-4b35-b2fb-5d99d0066132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c29100ab8349a993847ec23aab9bd5'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:28.170239 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-f7ff8f8c-b841-4b35-b2fb-5d99d0066132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c29100ab8349a993847ec23aab9bd5'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:28.178797 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-f7ff8f8c-b841-4b35-b2fb-5d99d0066132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c29100ab8349a993847ec23aab9bd5'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:28.205246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 908/1834] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:27 2022] DELETE /identity/v3/users/38c29100ab8349a993847ec23aab9bd5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:28.210254 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d56916-2bf9-46eb-8a90-ce5bd549d3c3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:28.210718 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d56916-2bf9-46eb-8a90-ce5bd549d3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:28.211348 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d56916-2bf9-46eb-8a90-ce5bd549d3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:28.244579 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f9d56916-2bf9-46eb-8a90-ce5bd549d3c3 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:28.246745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f9d56916-2bf9-46eb-8a90-ce5bd549d3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:28.347931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 927/1835] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:15:28.357222 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff8f8c-b841-4b35-b2fb-5d99d0066132 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:28.358869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-f7ff8f8c-b841-4b35-b2fb-5d99d0066132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:28.491429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff8f8c-b841-4b35-b2fb-5d99d0066132 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:28.497496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625e2a4-bc28-42a9-9950-64f1815a551b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:28.498372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625e2a4-bc28-42a9-9950-64f1815a551b service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:28.498669 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625e2a4-bc28-42a9-9950-64f1815a551b service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:28.498952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625e2a4-bc28-42a9-9950-64f1815a551b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:28.518081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625e2a4-bc28-42a9-9950-64f1815a551b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:28.521341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625e2a4-bc28-42a9-9950-64f1815a551b service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:28.559736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 909/1836] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:28.957386 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d56916-2bf9-46eb-8a90-ce5bd549d3c3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:28.958949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f9d56916-2bf9-46eb-8a90-ce5bd549d3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:28.994167 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d56916-2bf9-46eb-8a90-ce5bd549d3c3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:29.004964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625e2a4-bc28-42a9-9950-64f1815a551b service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:29.007066 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d625e2a4-bc28-42a9-9950-64f1815a551b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:29.011081 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963ee0c-b141-48d8-b8a0-75d6d86b5a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:29.012470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963ee0c-b141-48d8-b8a0-75d6d86b5a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:29.012597 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963ee0c-b141-48d8-b8a0-75d6d86b5a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:29.012983 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963ee0c-b141-48d8-b8a0-75d6d86b5a68 admin admin] PATH_INFO: `/v3/users/47ce23ee5ec843ea8a62655d4611a92f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:29.014516 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963ee0c-b141-48d8-b8a0-75d6d86b5a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47ce23ee5ec843ea8a62655d4611a92f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:29.016905 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963ee0c-b141-48d8-b8a0-75d6d86b5a68 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:29.027633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625e2a4-bc28-42a9-9950-64f1815a551b service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:29.042332 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fceafa1-a95e-40d4-90e3-ca38a5ace86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:29.043526 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fceafa1-a95e-40d4-90e3-ca38a5ace86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:29.044868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fceafa1-a95e-40d4-90e3-ca38a5ace86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:29.047053 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fceafa1-a95e-40d4-90e3-ca38a5ace86c admin admin] PATH_INFO: `/v3/users/91605e55310748ceab3f2a8a77ad7198` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:29.049685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fceafa1-a95e-40d4-90e3-ca38a5ace86c admin admin] RBAC: Authorizing `identity:delete_user(user_id=91605e55310748ceab3f2a8a77ad7198)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:29.053212 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fceafa1-a95e-40d4-90e3-ca38a5ace86c admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:29.094863 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:29.104272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6963ee0c-b141-48d8-b8a0-75d6d86b5a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47ce23ee5ec843ea8a62655d4611a92f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.104973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6963ee0c-b141-48d8-b8a0-75d6d86b5a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47ce23ee5ec843ea8a62655d4611a92f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.105623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6963ee0c-b141-48d8-b8a0-75d6d86b5a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47ce23ee5ec843ea8a62655d4611a92f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.146176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6963ee0c-b141-48d8-b8a0-75d6d86b5a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47ce23ee5ec843ea8a62655d4611a92f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.163534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6963ee0c-b141-48d8-b8a0-75d6d86b5a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47ce23ee5ec843ea8a62655d4611a92f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.182243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7fceafa1-a95e-40d4-90e3-ca38a5ace86c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91605e55310748ceab3f2a8a77ad7198'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.183147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7fceafa1-a95e-40d4-90e3-ca38a5ace86c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91605e55310748ceab3f2a8a77ad7198'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.184350 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7fceafa1-a95e-40d4-90e3-ca38a5ace86c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91605e55310748ceab3f2a8a77ad7198'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.188262 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 928/1837] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:28 2022] DELETE /identity/v3/users/47ce23ee5ec843ea8a62655d4611a92f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:29.189771 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61345969-43b3-4913-a3a1-eea7949ab149 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:29.190089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61345969-43b3-4913-a3a1-eea7949ab149 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:29.190657 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61345969-43b3-4913-a3a1-eea7949ab149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:29.200051 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7fceafa1-a95e-40d4-90e3-ca38a5ace86c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91605e55310748ceab3f2a8a77ad7198'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.201501 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:29.208792 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7fceafa1-a95e-40d4-90e3-ca38a5ace86c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91605e55310748ceab3f2a8a77ad7198'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.216098 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-61345969-43b3-4913-a3a1-eea7949ab149 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:29.217375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-61345969-43b3-4913-a3a1-eea7949ab149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:29.230784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 910/1838] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:29 2022] DELETE /identity/v3/users/91605e55310748ceab3f2a8a77ad7198 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:29.236124 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13e3b2-fa48-48f2-aa08-ba265dd63e09 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:29.237249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13e3b2-fa48-48f2-aa08-ba265dd63e09 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:29.238452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13e3b2-fa48-48f2-aa08-ba265dd63e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:29.280811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-4e13e3b2-fa48-48f2-aa08-ba265dd63e09 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:29.282873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-4e13e3b2-fa48-48f2-aa08-ba265dd63e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:29.347657 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 929/1839] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:29.351654 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61345969-43b3-4913-a3a1-eea7949ab149 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:29.353590 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-61345969-43b3-4913-a3a1-eea7949ab149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:29.369192 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61345969-43b3-4913-a3a1-eea7949ab149 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:29.394202 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 911/1840] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:15:29.398777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13e3b2-fa48-48f2-aa08-ba265dd63e09 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:29.400772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-4e13e3b2-fa48-48f2-aa08-ba265dd63e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:29.442638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edc2a9-94c4-4202-9223-700415a7886f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:29.443523 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edc2a9-94c4-4202-9223-700415a7886f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:29.443801 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edc2a9-94c4-4202-9223-700415a7886f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:29.444069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edc2a9-94c4-4202-9223-700415a7886f admin admin] PATH_INFO: `/v3/projects/ef8face11b2a4fb295bd7f5156613b91` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:29.445457 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edc2a9-94c4-4202-9223-700415a7886f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef8face11b2a4fb295bd7f5156613b91)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:29.447737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edc2a9-94c4-4202-9223-700415a7886f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:29.500182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13e3b2-fa48-48f2-aa08-ba265dd63e09 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:29.500182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0f967-0b5c-4b41-b467-d41cd79682f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:29.500182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0f967-0b5c-4b41-b467-d41cd79682f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:29.500182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0f967-0b5c-4b41-b467-d41cd79682f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:29.500518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0f967-0b5c-4b41-b467-d41cd79682f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:29.509805 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-18edc2a9-94c4-4202-9223-700415a7886f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef8face11b2a4fb295bd7f5156613b91', 'request_id': 'req-18edc2a9-94c4-4202-9223-700415a7886f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.510109 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0f967-0b5c-4b41-b467-d41cd79682f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:29.511829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0f967-0b5c-4b41-b467-d41cd79682f3 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:29.520199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:29.522732 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-18edc2a9-94c4-4202-9223-700415a7886f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef8face11b2a4fb295bd7f5156613b91', 'request_id': 'req-18edc2a9-94c4-4202-9223-700415a7886f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.529386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 912/1841] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:29.530114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0f967-0b5c-4b41-b467-d41cd79682f3 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:29.541351 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-18edc2a9-94c4-4202-9223-700415a7886f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef8face11b2a4fb295bd7f5156613b91', 'request_id': 'req-18edc2a9-94c4-4202-9223-700415a7886f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.544670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0f967-0b5c-4b41-b467-d41cd79682f3 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:29.564228 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-18edc2a9-94c4-4202-9223-700415a7886f admin admin] The token cache is being invalidate because project ef8face11b2a4fb295bd7f5156613b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:29.564562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-18edc2a9-94c4-4202-9223-700415a7886f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.565978 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-18edc2a9-94c4-4202-9223-700415a7886f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.567877 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 930/1842] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:29 2022] DELETE /identity/v3/projects/ef8face11b2a4fb295bd7f5156613b91 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:29.571354 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edc2a9-94c4-4202-9223-700415a7886f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:29.575513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-18edc2a9-94c4-4202-9223-700415a7886f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:29.614727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb601674-b1bf-4493-acf1-eeeb042faf8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:29.616077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb601674-b1bf-4493-acf1-eeeb042faf8d service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:29.616371 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb601674-b1bf-4493-acf1-eeeb042faf8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:29.616653 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb601674-b1bf-4493-acf1-eeeb042faf8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:29.619905 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-fb601674-b1bf-4493-acf1-eeeb042faf8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:29.676504 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edc2a9-94c4-4202-9223-700415a7886f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:29.693431 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:29.694997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83926bf-a73b-4494-b955-a37593e408c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:29.698633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83926bf-a73b-4494-b955-a37593e408c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:29.698939 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83926bf-a73b-4494-b955-a37593e408c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:29.699258 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83926bf-a73b-4494-b955-a37593e408c4 admin admin] PATH_INFO: `/v3/users/4e654ef0faa24b1588868f8a1be450ae` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:29.701077 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83926bf-a73b-4494-b955-a37593e408c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e654ef0faa24b1588868f8a1be450ae)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:29.703536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83926bf-a73b-4494-b955-a37593e408c4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:29.734943 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb601674-b1bf-4493-acf1-eeeb042faf8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:29.737346 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb601674-b1bf-4493-acf1-eeeb042faf8d service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:29.752622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 913/1843] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:29.754525 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5710e1-82b8-4a0a-9cc3-eec878228f18 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:29.754988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5710e1-82b8-4a0a-9cc3-eec878228f18 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:29.755485 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5710e1-82b8-4a0a-9cc3-eec878228f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:29.778510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a83926bf-a73b-4494-b955-a37593e408c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e654ef0faa24b1588868f8a1be450ae'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.779660 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a83926bf-a73b-4494-b955-a37593e408c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e654ef0faa24b1588868f8a1be450ae'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.780565 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a83926bf-a73b-4494-b955-a37593e408c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e654ef0faa24b1588868f8a1be450ae'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.782132 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-db5710e1-82b8-4a0a-9cc3-eec878228f18 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:29.783778 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-db5710e1-82b8-4a0a-9cc3-eec878228f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:29.794438 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 914/1844] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:29.803866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a83926bf-a73b-4494-b955-a37593e408c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e654ef0faa24b1588868f8a1be450ae'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.804499 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada78e7a-9702-4a2d-815e-715ad327bb97 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:29.804784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada78e7a-9702-4a2d-815e-715ad327bb97 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:29.805059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada78e7a-9702-4a2d-815e-715ad327bb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:29.814184 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a83926bf-a73b-4494-b955-a37593e408c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e654ef0faa24b1588868f8a1be450ae'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:29.835841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 931/1845] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:29 2022] DELETE /identity/v3/users/4e654ef0faa24b1588868f8a1be450ae => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:29.839226 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-ada78e7a-9702-4a2d-815e-715ad327bb97 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:29.840759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ada78e7a-9702-4a2d-815e-715ad327bb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:29.842546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47f5ae-91da-4818-a2d2-963c16ce20c2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:29.842981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47f5ae-91da-4818-a2d2-963c16ce20c2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:29.843288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47f5ae-91da-4818-a2d2-963c16ce20c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:29.870086 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3f47f5ae-91da-4818-a2d2-963c16ce20c2 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:29.871570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3f47f5ae-91da-4818-a2d2-963c16ce20c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:29.915292 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 915/1846] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:29.916091 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada78e7a-9702-4a2d-815e-715ad327bb97 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:29.917500 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ada78e7a-9702-4a2d-815e-715ad327bb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:29.930785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada78e7a-9702-4a2d-815e-715ad327bb97 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:29.936057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b78ca-95b5-41a6-be3c-5e2b6e9f3bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:29.937081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b78ca-95b5-41a6-be3c-5e2b6e9f3bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:29.937823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b78ca-95b5-41a6-be3c-5e2b6e9f3bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:29.937823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b78ca-95b5-41a6-be3c-5e2b6e9f3bba admin admin] PATH_INFO: `/v3/projects/1c45bb4903a64ad08ec8aa4ad9bf9a0a` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:29.938878 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b78ca-95b5-41a6-be3c-5e2b6e9f3bba admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c45bb4903a64ad08ec8aa4ad9bf9a0a)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:29.940774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b78ca-95b5-41a6-be3c-5e2b6e9f3bba admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:29.954041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 932/1847] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:29.955517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47f5ae-91da-4818-a2d2-963c16ce20c2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:29.960842 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:29.968548 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47f5ae-91da-4818-a2d2-963c16ce20c2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:29.978229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a91ed-3fa3-4f8d-8f4d-bdbf8753d730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:29.978912 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a91ed-3fa3-4f8d-8f4d-bdbf8753d730 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:29.979203 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a91ed-3fa3-4f8d-8f4d-bdbf8753d730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:29.979485 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a91ed-3fa3-4f8d-8f4d-bdbf8753d730 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:29.980228 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a91ed-3fa3-4f8d-8f4d-bdbf8753d730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:15:29.980539 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a91ed-3fa3-4f8d-8f4d-bdbf8753d730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:29.982199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a91ed-3fa3-4f8d-8f4d-bdbf8753d730 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:29.996413 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 933/1848] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:15:29.997453 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a91ed-3fa3-4f8d-8f4d-bdbf8753d730 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:29.999272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-728a91ed-3fa3-4f8d-8f4d-bdbf8753d730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:30.025524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-385b78ca-95b5-41a6-be3c-5e2b6e9f3bba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c45bb4903a64ad08ec8aa4ad9bf9a0a', 'request_id': 'req-385b78ca-95b5-41a6-be3c-5e2b6e9f3bba'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:30.043292 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-385b78ca-95b5-41a6-be3c-5e2b6e9f3bba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c45bb4903a64ad08ec8aa4ad9bf9a0a', 'request_id': 'req-385b78ca-95b5-41a6-be3c-5e2b6e9f3bba'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:30.051104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-385b78ca-95b5-41a6-be3c-5e2b6e9f3bba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c45bb4903a64ad08ec8aa4ad9bf9a0a', 'request_id': 'req-385b78ca-95b5-41a6-be3c-5e2b6e9f3bba'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:30.067081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-385b78ca-95b5-41a6-be3c-5e2b6e9f3bba admin admin] The token cache is being invalidate because project 1c45bb4903a64ad08ec8aa4ad9bf9a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:30.067422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-385b78ca-95b5-41a6-be3c-5e2b6e9f3bba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:30.068163 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-385b78ca-95b5-41a6-be3c-5e2b6e9f3bba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:30.070387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 916/1849] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:29 2022] DELETE /identity/v3/projects/1c45bb4903a64ad08ec8aa4ad9bf9a0a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:30.076854 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b78ca-95b5-41a6-be3c-5e2b6e9f3bba admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:30.077548 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-385b78ca-95b5-41a6-be3c-5e2b6e9f3bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:30.099942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a91ed-3fa3-4f8d-8f4d-bdbf8753d730 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:30.161142 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb0f65-aac1-4f2d-a803-3c7d45c9fe86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:30.161587 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:30.161988 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb0f65-aac1-4f2d-a803-3c7d45c9fe86 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:30.162703 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb0f65-aac1-4f2d-a803-3c7d45c9fe86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:30.163060 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb0f65-aac1-4f2d-a803-3c7d45c9fe86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:30.166506 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4ecb0f65-aac1-4f2d-a803-3c7d45c9fe86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:30.181052 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb0f65-aac1-4f2d-a803-3c7d45c9fe86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:30.182900 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb0f65-aac1-4f2d-a803-3c7d45c9fe86 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:30.196843 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 934/1850] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:30.197419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb0f65-aac1-4f2d-a803-3c7d45c9fe86 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:30.199501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4ecb0f65-aac1-4f2d-a803-3c7d45c9fe86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:30.199714 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b78ca-95b5-41a6-be3c-5e2b6e9f3bba admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:30.210909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff223866-bcfa-454f-8eca-a7c49ab49bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:30.211790 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff223866-bcfa-454f-8eca-a7c49ab49bab admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:30.212078 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff223866-bcfa-454f-8eca-a7c49ab49bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:30.212491 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff223866-bcfa-454f-8eca-a7c49ab49bab admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:30.213197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff223866-bcfa-454f-8eca-a7c49ab49bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:30.215141 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff223866-bcfa-454f-8eca-a7c49ab49bab admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:30.220604 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb0f65-aac1-4f2d-a803-3c7d45c9fe86 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:30.226896 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315113af-9fdd-4e5c-9ddd-0f7de81df4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:30.228412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315113af-9fdd-4e5c-9ddd-0f7de81df4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:30.229404 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315113af-9fdd-4e5c-9ddd-0f7de81df4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:30.229747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315113af-9fdd-4e5c-9ddd-0f7de81df4be admin admin] PATH_INFO: `/v3/users/09ee6b0e839a4185aac0af1309ab07eb` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:30.233190 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315113af-9fdd-4e5c-9ddd-0f7de81df4be admin admin] RBAC: Authorizing `identity:delete_user(user_id=09ee6b0e839a4185aac0af1309ab07eb)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:30.235689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315113af-9fdd-4e5c-9ddd-0f7de81df4be admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:30.275506 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 917/1851] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:30 2022] POST /identity/v3/projects => generated 373 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:30.279917 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff223866-bcfa-454f-8eca-a7c49ab49bab admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:30.323466 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-315113af-9fdd-4e5c-9ddd-0f7de81df4be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09ee6b0e839a4185aac0af1309ab07eb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:30.326734 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-315113af-9fdd-4e5c-9ddd-0f7de81df4be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09ee6b0e839a4185aac0af1309ab07eb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:30.327753 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-315113af-9fdd-4e5c-9ddd-0f7de81df4be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09ee6b0e839a4185aac0af1309ab07eb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:30.350070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-315113af-9fdd-4e5c-9ddd-0f7de81df4be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09ee6b0e839a4185aac0af1309ab07eb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:30.366687 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-315113af-9fdd-4e5c-9ddd-0f7de81df4be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09ee6b0e839a4185aac0af1309ab07eb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:30.420891 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 935/1852] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:30 2022] DELETE /identity/v3/users/09ee6b0e839a4185aac0af1309ab07eb => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:30.425086 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315113af-9fdd-4e5c-9ddd-0f7de81df4be admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:30.427983 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-315113af-9fdd-4e5c-9ddd-0f7de81df4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:30.473076 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:30.478699 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff223866-bcfa-454f-8eca-a7c49ab49bab admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:30.545077 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315113af-9fdd-4e5c-9ddd-0f7de81df4be admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:30.550468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899d27f-cbf9-49db-bbc5-55032b1ee613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:30.551631 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899d27f-cbf9-49db-bbc5-55032b1ee613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:30.552015 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899d27f-cbf9-49db-bbc5-55032b1ee613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:30.552408 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899d27f-cbf9-49db-bbc5-55032b1ee613 admin admin] PATH_INFO: `/v3/projects/06204cf80e2648559ea5b2c2e884190a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:30.553716 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899d27f-cbf9-49db-bbc5-55032b1ee613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06204cf80e2648559ea5b2c2e884190a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:30.555923 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899d27f-cbf9-49db-bbc5-55032b1ee613 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:30.559040 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e95ffc-ab76-4300-9702-6dc7d0dd57fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:30.560120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e95ffc-ab76-4300-9702-6dc7d0dd57fd admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:30.560409 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e95ffc-ab76-4300-9702-6dc7d0dd57fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:30.560851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e95ffc-ab76-4300-9702-6dc7d0dd57fd admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:30.561681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e95ffc-ab76-4300-9702-6dc7d0dd57fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:30.565824 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e95ffc-ab76-4300-9702-6dc7d0dd57fd admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:30.614808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 918/1853] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:30 2022] POST /identity/v3/users => generated 287 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:30.620781 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e95ffc-ab76-4300-9702-6dc7d0dd57fd admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:30.648650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-96e95ffc-ab76-4300-9702-6dc7d0dd57fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:30.769931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1899d27f-cbf9-49db-bbc5-55032b1ee613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06204cf80e2648559ea5b2c2e884190a', 'request_id': 'req-1899d27f-cbf9-49db-bbc5-55032b1ee613'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:30.773188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e95ffc-ab76-4300-9702-6dc7d0dd57fd admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:30.780130 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1899d27f-cbf9-49db-bbc5-55032b1ee613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06204cf80e2648559ea5b2c2e884190a', 'request_id': 'req-1899d27f-cbf9-49db-bbc5-55032b1ee613'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:30.787632 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1899d27f-cbf9-49db-bbc5-55032b1ee613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06204cf80e2648559ea5b2c2e884190a', 'request_id': 'req-1899d27f-cbf9-49db-bbc5-55032b1ee613'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:30.807868 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1899d27f-cbf9-49db-bbc5-55032b1ee613 admin admin] The token cache is being invalidate because project 06204cf80e2648559ea5b2c2e884190a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:30.808336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1899d27f-cbf9-49db-bbc5-55032b1ee613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:30.809328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1899d27f-cbf9-49db-bbc5-55032b1ee613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:30.811332 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 936/1854] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:30 2022] DELETE /identity/v3/projects/06204cf80e2648559ea5b2c2e884190a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:30.815199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899d27f-cbf9-49db-bbc5-55032b1ee613 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:30.816964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1899d27f-cbf9-49db-bbc5-55032b1ee613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:30.874450 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeaf18-33ad-44a3-977a-9eee7f4cc572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:30.875148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeaf18-33ad-44a3-977a-9eee7f4cc572 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:30.875908 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeaf18-33ad-44a3-977a-9eee7f4cc572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:30.875908 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeaf18-33ad-44a3-977a-9eee7f4cc572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:30.876527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbeaf18-33ad-44a3-977a-9eee7f4cc572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:30.880090 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbeaf18-33ad-44a3-977a-9eee7f4cc572 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:30.893810 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 919/1855] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:30.898040 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeaf18-33ad-44a3-977a-9eee7f4cc572 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:30.901745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-dbbeaf18-33ad-44a3-977a-9eee7f4cc572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:30.923552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeaf18-33ad-44a3-977a-9eee7f4cc572 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:30.929402 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b31b1-cdf5-418c-9b80-eeb423d9b1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:30.930095 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b31b1-cdf5-418c-9b80-eeb423d9b1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:30.930962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b31b1-cdf5-418c-9b80-eeb423d9b1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:30.931523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b31b1-cdf5-418c-9b80-eeb423d9b1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:30.932392 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b31b1-cdf5-418c-9b80-eeb423d9b1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:30.934440 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b31b1-cdf5-418c-9b80-eeb423d9b1e0 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:30.942303 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899d27f-cbf9-49db-bbc5-55032b1ee613 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:30.942673 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:30.952553 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 920/1856] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:30.952725 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2efaac-1730-47e7-8764-d08a282de47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:30.952725 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2efaac-1730-47e7-8764-d08a282de47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:30.952725 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2efaac-1730-47e7-8764-d08a282de47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:30.953036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2efaac-1730-47e7-8764-d08a282de47c admin admin] PATH_INFO: `/v3/users/c376ea12fabb44839d8ef28bfe834f1d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:30.954314 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b31b1-cdf5-418c-9b80-eeb423d9b1e0 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:30.954703 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2efaac-1730-47e7-8764-d08a282de47c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c376ea12fabb44839d8ef28bfe834f1d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:30.957971 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2efaac-1730-47e7-8764-d08a282de47c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:30.969254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b31b1-cdf5-418c-9b80-eeb423d9b1e0 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:30.977525 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51731603-3c9a-437f-a5ce-66b0c7a88fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:30.978606 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51731603-3c9a-437f-a5ce-66b0c7a88fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:30.979152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51731603-3c9a-437f-a5ce-66b0c7a88fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:30.980771 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51731603-3c9a-437f-a5ce-66b0c7a88fa6 admin admin] PATH_INFO: `/v3/projects/65349fd538c3400282d2a0ccfee80f16/users/91f439ef5c5d4282a100de832a1555cc/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:31.006791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51731603-3c9a-437f-a5ce-66b0c7a88fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65349fd538c3400282d2a0ccfee80f16, user_id=91f439ef5c5d4282a100de832a1555cc, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:31.012655 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51731603-3c9a-437f-a5ce-66b0c7a88fa6 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:31.043382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 921/1857] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:30 2022] PUT /identity/v3/projects/65349fd538c3400282d2a0ccfee80f16/users/91f439ef5c5d4282a100de832a1555cc/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:31.057571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51731603-3c9a-437f-a5ce-66b0c7a88fa6 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:31.060044 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-51731603-3c9a-437f-a5ce-66b0c7a88fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:31.067558 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8b2efaac-1730-47e7-8764-d08a282de47c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c376ea12fabb44839d8ef28bfe834f1d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.069196 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8b2efaac-1730-47e7-8764-d08a282de47c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c376ea12fabb44839d8ef28bfe834f1d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.069974 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8b2efaac-1730-47e7-8764-d08a282de47c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c376ea12fabb44839d8ef28bfe834f1d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.078304 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:31.103459 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8b2efaac-1730-47e7-8764-d08a282de47c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c376ea12fabb44839d8ef28bfe834f1d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.114152 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8b2efaac-1730-47e7-8764-d08a282de47c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c376ea12fabb44839d8ef28bfe834f1d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.137330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 937/1858] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:30 2022] DELETE /identity/v3/users/c376ea12fabb44839d8ef28bfe834f1d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:31.138971 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fe25d-f32a-468d-bc67-07b75ebc2921 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:31.139388 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fe25d-f32a-468d-bc67-07b75ebc2921 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:31.139814 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fe25d-f32a-468d-bc67-07b75ebc2921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:31.175613 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51731603-3c9a-437f-a5ce-66b0c7a88fa6 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:31.185432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-119fe25d-f32a-468d-bc67-07b75ebc2921 None None] MFA Rules not processed for user `91f439ef5c5d4282a100de832a1555cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:31.186760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-119fe25d-f32a-468d-bc67-07b75ebc2921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:31.253665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cdb2f-fce1-426b-a47b-286ea07d9dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:31.255301 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cdb2f-fce1-426b-a47b-286ea07d9dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:31.255301 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cdb2f-fce1-426b-a47b-286ea07d9dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:31.255445 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cdb2f-fce1-426b-a47b-286ea07d9dc1 admin admin] PATH_INFO: `/v3/projects/4f565ba4484d47c3bfa177c4bb58ac97` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:31.257007 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cdb2f-fce1-426b-a47b-286ea07d9dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f565ba4484d47c3bfa177c4bb58ac97)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:31.259476 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cdb2f-fce1-426b-a47b-286ea07d9dc1 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:31.264754 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 938/1859] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:31.264754 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fe25d-f32a-468d-bc67-07b75ebc2921 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:31.267267 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-119fe25d-f32a-468d-bc67-07b75ebc2921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:31.286837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fe25d-f32a-468d-bc67-07b75ebc2921 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:31.292480 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0840d8-926a-4238-811f-fa1d061dd83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:31.293361 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0840d8-926a-4238-811f-fa1d061dd83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:31.293739 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0840d8-926a-4238-811f-fa1d061dd83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:31.294149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0840d8-926a-4238-811f-fa1d061dd83f admin admin] PATH_INFO: `/v3/projects/a783e9317e544fe0aa658e92d113af03` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:31.296113 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0840d8-926a-4238-811f-fa1d061dd83f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a783e9317e544fe0aa658e92d113af03)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:31.298104 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0840d8-926a-4238-811f-fa1d061dd83f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:31.323315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cf3cdb2f-fce1-426b-a47b-286ea07d9dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f565ba4484d47c3bfa177c4bb58ac97', 'request_id': 'req-cf3cdb2f-fce1-426b-a47b-286ea07d9dc1'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.332806 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cf3cdb2f-fce1-426b-a47b-286ea07d9dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f565ba4484d47c3bfa177c4bb58ac97', 'request_id': 'req-cf3cdb2f-fce1-426b-a47b-286ea07d9dc1'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.340659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cf3cdb2f-fce1-426b-a47b-286ea07d9dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f565ba4484d47c3bfa177c4bb58ac97', 'request_id': 'req-cf3cdb2f-fce1-426b-a47b-286ea07d9dc1'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.355067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cf3cdb2f-fce1-426b-a47b-286ea07d9dc1 admin admin] The token cache is being invalidate because project 4f565ba4484d47c3bfa177c4bb58ac97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:31.355657 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cf3cdb2f-fce1-426b-a47b-286ea07d9dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.356472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cf3cdb2f-fce1-426b-a47b-286ea07d9dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.358267 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bd0840d8-926a-4238-811f-fa1d061dd83f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a783e9317e544fe0aa658e92d113af03', 'request_id': 'req-bd0840d8-926a-4238-811f-fa1d061dd83f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.358520 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 922/1860] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:31 2022] DELETE /identity/v3/projects/4f565ba4484d47c3bfa177c4bb58ac97 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:31.359293 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cdb2f-fce1-426b-a47b-286ea07d9dc1 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:31.360644 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-cf3cdb2f-fce1-426b-a47b-286ea07d9dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:31.368920 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bd0840d8-926a-4238-811f-fa1d061dd83f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a783e9317e544fe0aa658e92d113af03', 'request_id': 'req-bd0840d8-926a-4238-811f-fa1d061dd83f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.376722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:31.377485 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bd0840d8-926a-4238-811f-fa1d061dd83f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a783e9317e544fe0aa658e92d113af03', 'request_id': 'req-bd0840d8-926a-4238-811f-fa1d061dd83f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.395332 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bd0840d8-926a-4238-811f-fa1d061dd83f admin admin] The token cache is being invalidate because project a783e9317e544fe0aa658e92d113af03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:31.395874 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bd0840d8-926a-4238-811f-fa1d061dd83f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.396875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bd0840d8-926a-4238-811f-fa1d061dd83f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.398761 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 939/1861] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:31 2022] DELETE /identity/v3/projects/a783e9317e544fe0aa658e92d113af03 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:31.399979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0840d8-926a-4238-811f-fa1d061dd83f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:31.401330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bd0840d8-926a-4238-811f-fa1d061dd83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:31.439609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cdb2f-fce1-426b-a47b-286ea07d9dc1 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:31.486713 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:31.536593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0840d8-926a-4238-811f-fa1d061dd83f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:31.538460 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698257f1-94b7-4bdb-a6f7-a554275fcefe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:31.539218 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698257f1-94b7-4bdb-a6f7-a554275fcefe service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:31.539499 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698257f1-94b7-4bdb-a6f7-a554275fcefe service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:31.540386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698257f1-94b7-4bdb-a6f7-a554275fcefe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:31.542240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-698257f1-94b7-4bdb-a6f7-a554275fcefe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:31.563630 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b01c0-bff5-4b3e-aa93-57d1d386fa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:31.564683 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b01c0-bff5-4b3e-aa93-57d1d386fa19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:31.565084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b01c0-bff5-4b3e-aa93-57d1d386fa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:31.565461 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b01c0-bff5-4b3e-aa93-57d1d386fa19 admin admin] PATH_INFO: `/v3/users/45c1ec39ddd74e35b3b34611fe542a04` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:31.567565 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b01c0-bff5-4b3e-aa93-57d1d386fa19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45c1ec39ddd74e35b3b34611fe542a04)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:31.575630 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b01c0-bff5-4b3e-aa93-57d1d386fa19 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:31.627596 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698257f1-94b7-4bdb-a6f7-a554275fcefe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:31.629624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698257f1-94b7-4bdb-a6f7-a554275fcefe service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:31.645684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 923/1862] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:31.647870 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb1fc8-fc5b-4466-ac8b-0e01a4b83999 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:31.648347 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb1fc8-fc5b-4466-ac8b-0e01a4b83999 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:31.648848 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb1fc8-fc5b-4466-ac8b-0e01a4b83999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:31.691311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-f3cb1fc8-fc5b-4466-ac8b-0e01a4b83999 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:31.693091 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-f3cb1fc8-fc5b-4466-ac8b-0e01a4b83999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:31.706829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 924/1863] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:31.708142 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb1fc8-fc5b-4466-ac8b-0e01a4b83999 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:31.709742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-f3cb1fc8-fc5b-4466-ac8b-0e01a4b83999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:31.725539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb1fc8-fc5b-4466-ac8b-0e01a4b83999 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:31.730499 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-230b01c0-bff5-4b3e-aa93-57d1d386fa19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45c1ec39ddd74e35b3b34611fe542a04'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.732022 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03766a67-ee87-41aa-8b53-c199b453c2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:31.732599 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-230b01c0-bff5-4b3e-aa93-57d1d386fa19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45c1ec39ddd74e35b3b34611fe542a04'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.733378 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03766a67-ee87-41aa-8b53-c199b453c2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:31.733518 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-230b01c0-bff5-4b3e-aa93-57d1d386fa19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45c1ec39ddd74e35b3b34611fe542a04'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.734161 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03766a67-ee87-41aa-8b53-c199b453c2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:31.734617 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03766a67-ee87-41aa-8b53-c199b453c2c9 admin admin] PATH_INFO: `/v3/projects/71775179cb1b43e7b0336906b6c78b79` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:31.738192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03766a67-ee87-41aa-8b53-c199b453c2c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71775179cb1b43e7b0336906b6c78b79)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:31.741275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03766a67-ee87-41aa-8b53-c199b453c2c9 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:31.766904 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-230b01c0-bff5-4b3e-aa93-57d1d386fa19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45c1ec39ddd74e35b3b34611fe542a04'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.783378 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-230b01c0-bff5-4b3e-aa93-57d1d386fa19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45c1ec39ddd74e35b3b34611fe542a04'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.822924 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 940/1864] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:31 2022] DELETE /identity/v3/users/45c1ec39ddd74e35b3b34611fe542a04 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:31.823370 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3c656-5108-466d-ab8d-dd46792dbdf8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:31.823667 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3c656-5108-466d-ab8d-dd46792dbdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:31.823944 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3c656-5108-466d-ab8d-dd46792dbdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:31.830873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-03766a67-ee87-41aa-8b53-c199b453c2c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71775179cb1b43e7b0336906b6c78b79', 'request_id': 'req-03766a67-ee87-41aa-8b53-c199b453c2c9'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.843626 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-03766a67-ee87-41aa-8b53-c199b453c2c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71775179cb1b43e7b0336906b6c78b79', 'request_id': 'req-03766a67-ee87-41aa-8b53-c199b453c2c9'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.853695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-03766a67-ee87-41aa-8b53-c199b453c2c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71775179cb1b43e7b0336906b6c78b79', 'request_id': 'req-03766a67-ee87-41aa-8b53-c199b453c2c9'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.863377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a8f3c656-5108-466d-ab8d-dd46792dbdf8 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:31.864778 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:31.869344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a8f3c656-5108-466d-ab8d-dd46792dbdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:31.871264 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-03766a67-ee87-41aa-8b53-c199b453c2c9 admin admin] The token cache is being invalidate because project 71775179cb1b43e7b0336906b6c78b79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:31.872025 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-03766a67-ee87-41aa-8b53-c199b453c2c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.873368 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-03766a67-ee87-41aa-8b53-c199b453c2c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:31.876528 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 925/1865] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:31 2022] DELETE /identity/v3/projects/71775179cb1b43e7b0336906b6c78b79 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:31.882585 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5507f34-41e7-4d99-b227-6b2b90739019 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:31.883105 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5507f34-41e7-4d99-b227-6b2b90739019 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:31.883538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5507f34-41e7-4d99-b227-6b2b90739019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:31.913009 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-a5507f34-41e7-4d99-b227-6b2b90739019 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:31.915650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a5507f34-41e7-4d99-b227-6b2b90739019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:31.991586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 941/1866] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:31.997749 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3c656-5108-466d-ab8d-dd46792dbdf8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:32.011281 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 926/1867] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:15:32.012499 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1f82f-2922-431a-bf94-f06e250f4c79 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.012740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1f82f-2922-431a-bf94-f06e250f4c79 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.013015 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1f82f-2922-431a-bf94-f06e250f4c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.025790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3c656-5108-466d-ab8d-dd46792dbdf8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:32.034831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c3674-3ae3-4e73-a9e5-5e59f8c7dbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:32.036060 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c3674-3ae3-4e73-a9e5-5e59f8c7dbeb admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.036568 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c3674-3ae3-4e73-a9e5-5e59f8c7dbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.037066 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c3674-3ae3-4e73-a9e5-5e59f8c7dbeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.038072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c3674-3ae3-4e73-a9e5-5e59f8c7dbeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:15:32.038589 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c3674-3ae3-4e73-a9e5-5e59f8c7dbeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:32.039156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-10f1f82f-2922-431a-bf94-f06e250f4c79 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:32.041235 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-10f1f82f-2922-431a-bf94-f06e250f4c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:32.042948 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c3674-3ae3-4e73-a9e5-5e59f8c7dbeb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:32.056889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 927/1868] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:32.056889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c91f53-5247-4388-a2f6-eea644e3464f None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.056889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c91f53-5247-4388-a2f6-eea644e3464f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.056889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c91f53-5247-4388-a2f6-eea644e3464f None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.059058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 928/1869] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 12:15:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:15:32.059865 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c91f53-5247-4388-a2f6-eea644e3464f None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:32.073592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 942/1870] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:15:32.077256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c3674-3ae3-4e73-a9e5-5e59f8c7dbeb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:32.079049 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c91f53-5247-4388-a2f6-eea644e3464f None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:32.084654 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9581c1-b595-47ad-9958-330672743eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:32.085891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9581c1-b595-47ad-9958-330672743eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.086358 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9581c1-b595-47ad-9958-330672743eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.087000 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9581c1-b595-47ad-9958-330672743eaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.088973 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9581c1-b595-47ad-9958-330672743eaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:15:32.089445 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9581c1-b595-47ad-9958-330672743eaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:32.091922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9581c1-b595-47ad-9958-330672743eaa admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:32.094558 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c3674-3ae3-4e73-a9e5-5e59f8c7dbeb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:32.106669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220b928-070f-44cb-a9aa-0b11c6a5e663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:32.107262 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220b928-070f-44cb-a9aa-0b11c6a5e663 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.107804 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220b928-070f-44cb-a9aa-0b11c6a5e663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.108290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220b928-070f-44cb-a9aa-0b11c6a5e663 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.110539 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220b928-070f-44cb-a9aa-0b11c6a5e663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:32.113571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 929/1871] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:15:32.114524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220b928-070f-44cb-a9aa-0b11c6a5e663 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:32.119511 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9581c1-b595-47ad-9958-330672743eaa admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:32.133820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9581c1-b595-47ad-9958-330672743eaa admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:32.141420 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62482afa-232f-4cf6-a71d-f953f02d50dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:32.142786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62482afa-232f-4cf6-a71d-f953f02d50dd admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.143501 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62482afa-232f-4cf6-a71d-f953f02d50dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.146963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62482afa-232f-4cf6-a71d-f953f02d50dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.148317 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62482afa-232f-4cf6-a71d-f953f02d50dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:32.151595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62482afa-232f-4cf6-a71d-f953f02d50dd admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:32.186485 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 943/1872] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:32 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:15:32.189133 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616af851-02aa-449a-ae70-ee5a6c86591e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.191966 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616af851-02aa-449a-ae70-ee5a6c86591e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.191966 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616af851-02aa-449a-ae70-ee5a6c86591e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.252925 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 930/1873] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:32 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:32.255072 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62482afa-232f-4cf6-a71d-f953f02d50dd admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:32.294663 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-616af851-02aa-449a-ae70-ee5a6c86591e None None] MFA Rules not processed for user `6d9db26891a04b0bb7e655c21feeffdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:32.299733 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-616af851-02aa-449a-ae70-ee5a6c86591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:32.339471 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:32.386962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62482afa-232f-4cf6-a71d-f953f02d50dd admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:32.392352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89d9a3-6058-4dbc-995f-82e462ec62de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:32.393129 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89d9a3-6058-4dbc-995f-82e462ec62de admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.393389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89d9a3-6058-4dbc-995f-82e462ec62de admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.393558 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89d9a3-6058-4dbc-995f-82e462ec62de admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.394300 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89d9a3-6058-4dbc-995f-82e462ec62de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:32.396216 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89d9a3-6058-4dbc-995f-82e462ec62de admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:32.420434 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 931/1874] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:32 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:32.422172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89d9a3-6058-4dbc-995f-82e462ec62de admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:32.424164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 944/1875] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 12:15:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:32.425603 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616af851-02aa-449a-ae70-ee5a6c86591e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:32.433469 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89d9a3-6058-4dbc-995f-82e462ec62de admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:32.439256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e12281-aea8-4c21-876e-f64a9885b00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:32.439860 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e12281-aea8-4c21-876e-f64a9885b00c admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.440141 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e12281-aea8-4c21-876e-f64a9885b00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.440414 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e12281-aea8-4c21-876e-f64a9885b00c admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.441110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e12281-aea8-4c21-876e-f64a9885b00c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:32.441427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616af851-02aa-449a-ae70-ee5a6c86591e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:32.443145 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e12281-aea8-4c21-876e-f64a9885b00c admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:32.446911 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182d5be-fcef-4b83-8449-ab0aa7663253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:32.447603 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182d5be-fcef-4b83-8449-ab0aa7663253 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.447882 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182d5be-fcef-4b83-8449-ab0aa7663253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.448159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182d5be-fcef-4b83-8449-ab0aa7663253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.448900 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182d5be-fcef-4b83-8449-ab0aa7663253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:32.450584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182d5be-fcef-4b83-8449-ab0aa7663253 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:32.466447 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 945/1876] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:32.466447 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182d5be-fcef-4b83-8449-ab0aa7663253 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:32.469975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4182d5be-fcef-4b83-8449-ab0aa7663253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:32.478915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 932/1877] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:32 2022] POST /identity/v3/users => generated 290 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:32.479976 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e12281-aea8-4c21-876e-f64a9885b00c admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:32.491774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e12281-aea8-4c21-876e-f64a9885b00c admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:32.492341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182d5be-fcef-4b83-8449-ab0aa7663253 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:32.500588 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75e125-7588-4df8-9378-acd8c7689a21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:32.501680 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75e125-7588-4df8-9378-acd8c7689a21 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.502108 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75e125-7588-4df8-9378-acd8c7689a21 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.502541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75e125-7588-4df8-9378-acd8c7689a21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.502853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b061ea-17b2-464c-8f41-0290a34707eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:32.504380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b061ea-17b2-464c-8f41-0290a34707eb admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.504961 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b061ea-17b2-464c-8f41-0290a34707eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.505591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b061ea-17b2-464c-8f41-0290a34707eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.506764 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b061ea-17b2-464c-8f41-0290a34707eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:32.508677 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b061ea-17b2-464c-8f41-0290a34707eb admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:32.518026 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75e125-7588-4df8-9378-acd8c7689a21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:32.521333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75e125-7588-4df8-9378-acd8c7689a21 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:32.525397 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 933/1878] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:32.526676 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b061ea-17b2-464c-8f41-0290a34707eb admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:32.536488 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 946/1879] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:32.537496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75e125-7588-4df8-9378-acd8c7689a21 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:32.550060 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75e125-7588-4df8-9378-acd8c7689a21 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:32.551361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b061ea-17b2-464c-8f41-0290a34707eb admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:32.556464 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a609bb5-eb3a-4a81-ac9d-624d0a1bef37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:32.558471 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a609bb5-eb3a-4a81-ac9d-624d0a1bef37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.559084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a609bb5-eb3a-4a81-ac9d-624d0a1bef37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.559468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a609bb5-eb3a-4a81-ac9d-624d0a1bef37 admin admin] PATH_INFO: `/v3/projects/1b535e8e573f4bd48123466e37e553b1/users/2192721ffaf345b2abc826a140958a0e/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.559993 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa518d-4c34-4701-af8f-f530badbef81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:32.561241 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa518d-4c34-4701-af8f-f530badbef81 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.561915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa518d-4c34-4701-af8f-f530badbef81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.562721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa518d-4c34-4701-af8f-f530badbef81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.563213 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa518d-4c34-4701-af8f-f530badbef81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:32.565109 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa518d-4c34-4701-af8f-f530badbef81 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:32.585079 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 934/1880] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:32.586086 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a609bb5-eb3a-4a81-ac9d-624d0a1bef37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b535e8e573f4bd48123466e37e553b1, user_id=2192721ffaf345b2abc826a140958a0e, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:32.586349 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa518d-4c34-4701-af8f-f530badbef81 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:32.589741 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a609bb5-eb3a-4a81-ac9d-624d0a1bef37 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:32.599591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa518d-4c34-4701-af8f-f530badbef81 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:32.608112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f729671-60c9-4050-ad32-4201f8fb231c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:32.609384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f729671-60c9-4050-ad32-4201f8fb231c admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.609897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f729671-60c9-4050-ad32-4201f8fb231c admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.610649 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f729671-60c9-4050-ad32-4201f8fb231c admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.611583 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f729671-60c9-4050-ad32-4201f8fb231c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:32.613685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f729671-60c9-4050-ad32-4201f8fb231c admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:32.617814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:32.620064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 947/1881] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:32 2022] PUT /identity/v3/projects/1b535e8e573f4bd48123466e37e553b1/users/2192721ffaf345b2abc826a140958a0e/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:32.631388 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf187c9-d982-4175-b60f-9394bb5c6862 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.631688 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf187c9-d982-4175-b60f-9394bb5c6862 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.632939 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf187c9-d982-4175-b60f-9394bb5c6862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.645244 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 935/1882] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:32.650937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f729671-60c9-4050-ad32-4201f8fb231c admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:32.663777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f729671-60c9-4050-ad32-4201f8fb231c admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:32.727950 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-eaf187c9-d982-4175-b60f-9394bb5c6862 None None] MFA Rules not processed for user `2192721ffaf345b2abc826a140958a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:32.729222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-eaf187c9-d982-4175-b60f-9394bb5c6862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:32.749628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08699a19-bc5f-4ba4-bf76-f3c0632df8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:32.751629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08699a19-bc5f-4ba4-bf76-f3c0632df8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.752203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08699a19-bc5f-4ba4-bf76-f3c0632df8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.752688 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08699a19-bc5f-4ba4-bf76-f3c0632df8a8 admin admin] PATH_INFO: `/v3/projects/e88c6bf9b22a4af7bf1ee9e8a377e4f1/users/9983606342b243edae8a8edd6a05e231/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.776896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08699a19-bc5f-4ba4-bf76-f3c0632df8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e88c6bf9b22a4af7bf1ee9e8a377e4f1, user_id=9983606342b243edae8a8edd6a05e231, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:32.781730 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08699a19-bc5f-4ba4-bf76-f3c0632df8a8 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:32.805487 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 936/1883] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:32 2022] PUT /identity/v3/projects/e88c6bf9b22a4af7bf1ee9e8a377e4f1/users/9983606342b243edae8a8edd6a05e231/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:32.820069 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd29be9-267f-48ae-8ef8-83e062fa9407 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.820598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd29be9-267f-48ae-8ef8-83e062fa9407 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.821862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd29be9-267f-48ae-8ef8-83e062fa9407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.860416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-cfd29be9-267f-48ae-8ef8-83e062fa9407 None None] MFA Rules not processed for user `9983606342b243edae8a8edd6a05e231`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:32.862039 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-cfd29be9-267f-48ae-8ef8-83e062fa9407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:32.869301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 948/1884] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:32.873519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf187c9-d982-4175-b60f-9394bb5c6862 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:32.888301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf187c9-d982-4175-b60f-9394bb5c6862 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:32.955871 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6dcb2-0bb1-4212-994f-f30d44cf0e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:32.956375 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 937/1885] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:32.961116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd29be9-267f-48ae-8ef8-83e062fa9407 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:32.962088 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6dcb2-0bb1-4212-994f-f30d44cf0e94 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.962395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6dcb2-0bb1-4212-994f-f30d44cf0e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.964231 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6dcb2-0bb1-4212-994f-f30d44cf0e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.965059 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6dcb2-0bb1-4212-994f-f30d44cf0e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:32.967813 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6dcb2-0bb1-4212-994f-f30d44cf0e94 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:32.975087 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd29be9-267f-48ae-8ef8-83e062fa9407 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:32.975692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:32.981807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99975b-11f5-4ccd-b794-1c577944e124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:32.982949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99975b-11f5-4ccd-b794-1c577944e124 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:32.983413 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99975b-11f5-4ccd-b794-1c577944e124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:32.983897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99975b-11f5-4ccd-b794-1c577944e124 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:32.985106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99975b-11f5-4ccd-b794-1c577944e124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:32.987655 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99975b-11f5-4ccd-b794-1c577944e124 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:33.020727 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 949/1886] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:32 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:15:33.024990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6dcb2-0bb1-4212-994f-f30d44cf0e94 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:33.034040 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 938/1887] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:32 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:33.035468 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99975b-11f5-4ccd-b794-1c577944e124 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:33.094025 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:33.107505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6dcb2-0bb1-4212-994f-f30d44cf0e94 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:33.109681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99975b-11f5-4ccd-b794-1c577944e124 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:33.113219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda2df7-f2cc-4817-9ef2-af40e407d84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:33.114037 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda2df7-f2cc-4817-9ef2-af40e407d84f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:33.116117 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda2df7-f2cc-4817-9ef2-af40e407d84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:33.116397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda2df7-f2cc-4817-9ef2-af40e407d84f admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:33.116681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957f580-0afb-46cf-9bf7-cadf38714164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:33.117273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda2df7-f2cc-4817-9ef2-af40e407d84f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:33.117562 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957f580-0afb-46cf-9bf7-cadf38714164 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:33.118494 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957f580-0afb-46cf-9bf7-cadf38714164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:33.118890 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957f580-0afb-46cf-9bf7-cadf38714164 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:33.119726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957f580-0afb-46cf-9bf7-cadf38714164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:33.119949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda2df7-f2cc-4817-9ef2-af40e407d84f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:33.122083 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957f580-0afb-46cf-9bf7-cadf38714164 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:33.153760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 950/1888] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:33 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:15:33.157756 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda2df7-f2cc-4817-9ef2-af40e407d84f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:33.163303 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 939/1889] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:33 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:33.167493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957f580-0afb-46cf-9bf7-cadf38714164 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:33.175707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda2df7-f2cc-4817-9ef2-af40e407d84f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:33.180085 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957f580-0afb-46cf-9bf7-cadf38714164 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:33.185066 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6804c-fe05-4ff2-8e8c-95fb0c39b3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:33.185747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6804c-fe05-4ff2-8e8c-95fb0c39b3bf admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:33.186048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6804c-fe05-4ff2-8e8c-95fb0c39b3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:33.186325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6804c-fe05-4ff2-8e8c-95fb0c39b3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:33.187056 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6804c-fe05-4ff2-8e8c-95fb0c39b3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:33.187821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba99955-5837-4768-988d-4a24f8f17525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:33.187968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba99955-5837-4768-988d-4a24f8f17525 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:33.188350 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba99955-5837-4768-988d-4a24f8f17525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:33.188720 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba99955-5837-4768-988d-4a24f8f17525 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:33.188883 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6804c-fe05-4ff2-8e8c-95fb0c39b3bf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:33.190236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba99955-5837-4768-988d-4a24f8f17525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:33.191815 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba99955-5837-4768-988d-4a24f8f17525 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:33.202252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 951/1890] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:15:33.203470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6804c-fe05-4ff2-8e8c-95fb0c39b3bf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:33.203963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 940/1891] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:33.205311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba99955-5837-4768-988d-4a24f8f17525 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:33.208859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2ac6804c-fe05-4ff2-8e8c-95fb0c39b3bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:33.218523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba99955-5837-4768-988d-4a24f8f17525 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:33.221690 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6804c-fe05-4ff2-8e8c-95fb0c39b3bf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:33.226168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee98867-ceb6-4e34-8d4f-05bfce343023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:33.226574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2d0da-e1b1-4862-be3d-58450b728fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:33.227462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2d0da-e1b1-4862-be3d-58450b728fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:33.227747 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee98867-ceb6-4e34-8d4f-05bfce343023 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:33.227903 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2d0da-e1b1-4862-be3d-58450b728fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:33.228247 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2d0da-e1b1-4862-be3d-58450b728fdc admin admin] PATH_INFO: `/v3/projects/a904b878fc764e9ca4eee728ff542643` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:33.228548 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee98867-ceb6-4e34-8d4f-05bfce343023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:33.229435 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee98867-ceb6-4e34-8d4f-05bfce343023 admin admin] PATH_INFO: `/v3/projects/9f4d5eb69d7542078ea06759a4c59eec/users/0d80350f677d4521bcae2f5b3e23b09c/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:33.229551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2d0da-e1b1-4862-be3d-58450b728fdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a904b878fc764e9ca4eee728ff542643)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:33.231722 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2d0da-e1b1-4862-be3d-58450b728fdc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:33.259227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee98867-ceb6-4e34-8d4f-05bfce343023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f4d5eb69d7542078ea06759a4c59eec, user_id=0d80350f677d4521bcae2f5b3e23b09c, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:33.264105 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee98867-ceb6-4e34-8d4f-05bfce343023 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:33.283351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 941/1892] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:33 2022] PUT /identity/v3/projects/9f4d5eb69d7542078ea06759a4c59eec/users/0d80350f677d4521bcae2f5b3e23b09c/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:33.284576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee98867-ceb6-4e34-8d4f-05bfce343023 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:33.325089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-06a2d0da-e1b1-4862-be3d-58450b728fdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a904b878fc764e9ca4eee728ff542643', 'request_id': 'req-06a2d0da-e1b1-4862-be3d-58450b728fdc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:33.355497 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-06a2d0da-e1b1-4862-be3d-58450b728fdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a904b878fc764e9ca4eee728ff542643', 'request_id': 'req-06a2d0da-e1b1-4862-be3d-58450b728fdc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:33.367367 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-06a2d0da-e1b1-4862-be3d-58450b728fdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a904b878fc764e9ca4eee728ff542643', 'request_id': 'req-06a2d0da-e1b1-4862-be3d-58450b728fdc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:33.376607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee98867-ceb6-4e34-8d4f-05bfce343023 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:33.404011 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-06a2d0da-e1b1-4862-be3d-58450b728fdc admin admin] The token cache is being invalidate because project a904b878fc764e9ca4eee728ff542643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:33.404309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-06a2d0da-e1b1-4862-be3d-58450b728fdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:33.409473 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-06a2d0da-e1b1-4862-be3d-58450b728fdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:33.412118 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 952/1893] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:33 2022] DELETE /identity/v3/projects/a904b878fc764e9ca4eee728ff542643 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:33.412722 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2d0da-e1b1-4862-be3d-58450b728fdc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:33.415250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-06a2d0da-e1b1-4862-be3d-58450b728fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:33.481829 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:33.483946 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67214814-67c7-4bda-be61-e45de38a7762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:33.485723 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67214814-67c7-4bda-be61-e45de38a7762 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:33.486027 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67214814-67c7-4bda-be61-e45de38a7762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:33.486362 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67214814-67c7-4bda-be61-e45de38a7762 admin admin] PATH_INFO: `/v3/projects/dafc1d87ebee4bfc8edc83c3abb344f1/users/8b79861681784900a7e5164a30b7d8a4/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:33.507465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2d0da-e1b1-4862-be3d-58450b728fdc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:33.516175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67214814-67c7-4bda-be61-e45de38a7762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dafc1d87ebee4bfc8edc83c3abb344f1, user_id=8b79861681784900a7e5164a30b7d8a4, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:33.523122 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12724208-332c-4660-a89f-4a19c91856b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:33.524037 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12724208-332c-4660-a89f-4a19c91856b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:33.524470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12724208-332c-4660-a89f-4a19c91856b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:33.524843 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12724208-332c-4660-a89f-4a19c91856b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:33.525771 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12724208-332c-4660-a89f-4a19c91856b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:33.532747 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67214814-67c7-4bda-be61-e45de38a7762 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:33.543119 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12724208-332c-4660-a89f-4a19c91856b1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:33.564046 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 942/1894] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:33 2022] PUT /identity/v3/projects/dafc1d87ebee4bfc8edc83c3abb344f1/users/8b79861681784900a7e5164a30b7d8a4/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:33.564931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 953/1895] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:33.566625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e53f3-b1dd-4b68-80fc-2530e3c073ba None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:33.568025 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e53f3-b1dd-4b68-80fc-2530e3c073ba None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:33.568453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e53f3-b1dd-4b68-80fc-2530e3c073ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:33.569249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12724208-332c-4660-a89f-4a19c91856b1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:33.572190 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-12724208-332c-4660-a89f-4a19c91856b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:33.594699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12724208-332c-4660-a89f-4a19c91856b1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:33.610794 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-293e53f3-b1dd-4b68-80fc-2530e3c073ba None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:33.612330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-293e53f3-b1dd-4b68-80fc-2530e3c073ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:33.652111 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:33.705577 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a17c13-e6fe-4853-84f8-d6add8e890c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:33.706454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a17c13-e6fe-4853-84f8-d6add8e890c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:33.708796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a17c13-e6fe-4853-84f8-d6add8e890c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:33.709012 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a17c13-e6fe-4853-84f8-d6add8e890c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:33.709768 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a17c13-e6fe-4853-84f8-d6add8e890c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:33.711407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a17c13-e6fe-4853-84f8-d6add8e890c9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:33.721923 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 943/1896] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:33.738376 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 954/1897] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:33.738376 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b831a-cb37-483a-a4ef-e0b0a63f8945 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:33.738376 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b831a-cb37-483a-a4ef-e0b0a63f8945 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:33.738376 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b831a-cb37-483a-a4ef-e0b0a63f8945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:33.738891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e53f3-b1dd-4b68-80fc-2530e3c073ba None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:33.749924 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e53f3-b1dd-4b68-80fc-2530e3c073ba None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:33.755351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adaec3-6aeb-4acd-8451-8bbbb0412276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:33.756476 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adaec3-6aeb-4acd-8451-8bbbb0412276 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:33.757066 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adaec3-6aeb-4acd-8451-8bbbb0412276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:33.757487 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adaec3-6aeb-4acd-8451-8bbbb0412276 admin admin] PATH_INFO: `/v3/projects/9f4d5eb69d7542078ea06759a4c59eec/users/0d80350f677d4521bcae2f5b3e23b09c/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:33.760409 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adaec3-6aeb-4acd-8451-8bbbb0412276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f4d5eb69d7542078ea06759a4c59eec, user_id=0d80350f677d4521bcae2f5b3e23b09c, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:33.764222 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adaec3-6aeb-4acd-8451-8bbbb0412276 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:33.770607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-277b831a-cb37-483a-a4ef-e0b0a63f8945 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:33.771982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-277b831a-cb37-483a-a4ef-e0b0a63f8945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:33.784607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 955/1898] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:33.785599 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b831a-cb37-483a-a4ef-e0b0a63f8945 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:33.793470 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 944/1899] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:33 2022] PUT /identity/v3/projects/9f4d5eb69d7542078ea06759a4c59eec/users/0d80350f677d4521bcae2f5b3e23b09c/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:33.794996 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adaec3-6aeb-4acd-8451-8bbbb0412276 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:33.808359 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b831a-cb37-483a-a4ef-e0b0a63f8945 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:33.917646 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28aa02-bbb2-4d2a-93da-e6674dea6934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:33.918868 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28aa02-bbb2-4d2a-93da-e6674dea6934 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:33.920876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28aa02-bbb2-4d2a-93da-e6674dea6934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:33.921269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28aa02-bbb2-4d2a-93da-e6674dea6934 admin admin] PATH_INFO: `/v3/projects/dafc1d87ebee4bfc8edc83c3abb344f1/users/8b79861681784900a7e5164a30b7d8a4/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:33.925480 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28aa02-bbb2-4d2a-93da-e6674dea6934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dafc1d87ebee4bfc8edc83c3abb344f1, user_id=8b79861681784900a7e5164a30b7d8a4, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:33.935936 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28aa02-bbb2-4d2a-93da-e6674dea6934 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:33.960668 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 956/1900] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:33 2022] PUT /identity/v3/projects/dafc1d87ebee4bfc8edc83c3abb344f1/users/8b79861681784900a7e5164a30b7d8a4/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:33.965441 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adaec3-6aeb-4acd-8451-8bbbb0412276 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:33.972528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e3747-0fa6-49a7-a4ae-7bbf0d3a3d09 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:33.972827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e3747-0fa6-49a7-a4ae-7bbf0d3a3d09 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:33.973121 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e3747-0fa6-49a7-a4ae-7bbf0d3a3d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:34.050037 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-844e3747-0fa6-49a7-a4ae-7bbf0d3a3d09 None None] MFA Rules not processed for user `0d80350f677d4521bcae2f5b3e23b09c`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:34.051275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-844e3747-0fa6-49a7-a4ae-7bbf0d3a3d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:34.052514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc14a51-66a8-4bc2-aa7b-efd42811634f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:34.053420 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc14a51-66a8-4bc2-aa7b-efd42811634f admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:34.053907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc14a51-66a8-4bc2-aa7b-efd42811634f admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:34.054443 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc14a51-66a8-4bc2-aa7b-efd42811634f admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:34.055595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc14a51-66a8-4bc2-aa7b-efd42811634f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:15:34.056283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc14a51-66a8-4bc2-aa7b-efd42811634f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:34.059704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc14a51-66a8-4bc2-aa7b-efd42811634f admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:34.075689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 945/1901] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:15:34.076880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4760c6-1861-47cb-b158-b509622d989e None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:34.077172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4760c6-1861-47cb-b158-b509622d989e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:34.077451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4760c6-1861-47cb-b158-b509622d989e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:34.111650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-3d4760c6-1861-47cb-b158-b509622d989e None None] MFA Rules not processed for user `8b79861681784900a7e5164a30b7d8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:34.112967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-3d4760c6-1861-47cb-b158-b509622d989e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:34.131723 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:34.168189 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 957/1902] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:34.177226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e3747-0fa6-49a7-a4ae-7bbf0d3a3d09 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:34.195734 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e3747-0fa6-49a7-a4ae-7bbf0d3a3d09 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:34.201477 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d124c09-8c6b-47c7-8c7f-5cb88bbe1b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:34.202293 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d124c09-8c6b-47c7-8c7f-5cb88bbe1b91 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:34.202641 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d124c09-8c6b-47c7-8c7f-5cb88bbe1b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:34.203213 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d124c09-8c6b-47c7-8c7f-5cb88bbe1b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:34.204016 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d124c09-8c6b-47c7-8c7f-5cb88bbe1b91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:34.206379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d124c09-8c6b-47c7-8c7f-5cb88bbe1b91 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:34.249195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:34.249804 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 958/1903] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:34 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:34.251524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d124c09-8c6b-47c7-8c7f-5cb88bbe1b91 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:34.254469 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9d124c09-8c6b-47c7-8c7f-5cb88bbe1b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:34.298816 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 946/1904] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:34.299883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4760c6-1861-47cb-b158-b509622d989e None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:34.317432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4760c6-1861-47cb-b158-b509622d989e None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:34.379796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d124c09-8c6b-47c7-8c7f-5cb88bbe1b91 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:34.392471 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b374325-b2f7-48fd-a04a-d44cf99fecef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:34.392747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b374325-b2f7-48fd-a04a-d44cf99fecef service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:34.392836 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b374325-b2f7-48fd-a04a-d44cf99fecef service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:34.393112 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b374325-b2f7-48fd-a04a-d44cf99fecef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:34.446574 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53eb6d-07cc-4c93-af3a-3967d2922899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:34.447399 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53eb6d-07cc-4c93-af3a-3967d2922899 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:34.447777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53eb6d-07cc-4c93-af3a-3967d2922899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:34.448135 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53eb6d-07cc-4c93-af3a-3967d2922899 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:34.448852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53eb6d-07cc-4c93-af3a-3967d2922899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:34.450899 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53eb6d-07cc-4c93-af3a-3967d2922899 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:34.486586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 947/1905] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:34 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:34.486586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53eb6d-07cc-4c93-af3a-3967d2922899 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:34.488474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-4f53eb6d-07cc-4c93-af3a-3967d2922899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:34.498085 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b374325-b2f7-48fd-a04a-d44cf99fecef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:34.500164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b374325-b2f7-48fd-a04a-d44cf99fecef service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:34.502144 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53eb6d-07cc-4c93-af3a-3967d2922899 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:34.506757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d18aca-0900-4b40-b580-4b751f1d4898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:34.507409 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d18aca-0900-4b40-b580-4b751f1d4898 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:34.507745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d18aca-0900-4b40-b580-4b751f1d4898 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:34.508019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d18aca-0900-4b40-b580-4b751f1d4898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:34.510651 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b4d18aca-0900-4b40-b580-4b751f1d4898 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:34.517459 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 959/1906] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:34.518921 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b374325-b2f7-48fd-a04a-d44cf99fecef service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:34.532071 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b374325-b2f7-48fd-a04a-d44cf99fecef service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:34.542240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e065c-0f41-49cd-a642-d16f44a2da35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:34.543196 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e065c-0f41-49cd-a642-d16f44a2da35 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:34.543550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e065c-0f41-49cd-a642-d16f44a2da35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:34.543922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e065c-0f41-49cd-a642-d16f44a2da35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:34.545053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e065c-0f41-49cd-a642-d16f44a2da35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:34.546972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e065c-0f41-49cd-a642-d16f44a2da35 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:34.560985 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 960/1907] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:34.566208 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e065c-0f41-49cd-a642-d16f44a2da35 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:34.587823 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e065c-0f41-49cd-a642-d16f44a2da35 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:34.597214 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382cc09-53e1-47e5-a425-48505f7c8069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:34.598089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382cc09-53e1-47e5-a425-48505f7c8069 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:34.598575 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382cc09-53e1-47e5-a425-48505f7c8069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:34.599273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382cc09-53e1-47e5-a425-48505f7c8069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:34.600191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382cc09-53e1-47e5-a425-48505f7c8069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:34.603057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382cc09-53e1-47e5-a425-48505f7c8069 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:34.611845 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d18aca-0900-4b40-b580-4b751f1d4898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:34.613391 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d18aca-0900-4b40-b580-4b751f1d4898 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:34.619751 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 961/1908] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:15:34.621503 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382cc09-53e1-47e5-a425-48505f7c8069 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:34.626406 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1382cc09-53e1-47e5-a425-48505f7c8069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:34.641853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 948/1909] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:34.644402 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d18aca-0900-4b40-b580-4b751f1d4898 service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:34.652569 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382cc09-53e1-47e5-a425-48505f7c8069 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:34.658100 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5428e-c778-40a4-aa35-92310524ff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:34.659627 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5428e-c778-40a4-aa35-92310524ff5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:34.661516 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5428e-c778-40a4-aa35-92310524ff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:34.661804 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5428e-c778-40a4-aa35-92310524ff5c admin admin] PATH_INFO: `/v3/users/91f439ef5c5d4282a100de832a1555cc` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:34.663124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5428e-c778-40a4-aa35-92310524ff5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=91f439ef5c5d4282a100de832a1555cc)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:34.664481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d18aca-0900-4b40-b580-4b751f1d4898 service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:34.665203 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5428e-c778-40a4-aa35-92310524ff5c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:34.669534 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36697731-c97d-4c8f-8e2f-0fb56953fc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:34.670507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36697731-c97d-4c8f-8e2f-0fb56953fc9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:34.670792 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36697731-c97d-4c8f-8e2f-0fb56953fc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:34.671070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36697731-c97d-4c8f-8e2f-0fb56953fc9b admin admin] PATH_INFO: `/v3/projects/1dfddd29b46046388a87f02bcbbecffd/users/691199af3147422b909cf842fe545550/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:34.689816 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36697731-c97d-4c8f-8e2f-0fb56953fc9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dfddd29b46046388a87f02bcbbecffd, user_id=691199af3147422b909cf842fe545550, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:34.693296 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36697731-c97d-4c8f-8e2f-0fb56953fc9b admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:34.713471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 949/1910] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:34 2022] PUT /identity/v3/projects/1dfddd29b46046388a87f02bcbbecffd/users/691199af3147422b909cf842fe545550/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:34.714606 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36697731-c97d-4c8f-8e2f-0fb56953fc9b admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:34.741956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7fd5428e-c778-40a4-aa35-92310524ff5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91f439ef5c5d4282a100de832a1555cc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:34.743752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7fd5428e-c778-40a4-aa35-92310524ff5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91f439ef5c5d4282a100de832a1555cc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:34.745574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7fd5428e-c778-40a4-aa35-92310524ff5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91f439ef5c5d4282a100de832a1555cc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:34.751839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:34.785764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7fd5428e-c778-40a4-aa35-92310524ff5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91f439ef5c5d4282a100de832a1555cc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:34.802542 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36697731-c97d-4c8f-8e2f-0fb56953fc9b admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:34.804849 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7fd5428e-c778-40a4-aa35-92310524ff5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91f439ef5c5d4282a100de832a1555cc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:34.808833 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259ffbf-1f5e-4c2d-8491-ff74e689044a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:34.809615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ffbf-1f5e-4c2d-8491-ff74e689044a service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:34.810270 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ffbf-1f5e-4c2d-8491-ff74e689044a service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:34.810377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ffbf-1f5e-4c2d-8491-ff74e689044a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:34.813755 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6259ffbf-1f5e-4c2d-8491-ff74e689044a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:34.829082 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:34.838012 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 962/1911] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:34 2022] DELETE /identity/v3/users/91f439ef5c5d4282a100de832a1555cc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:34.841004 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bf823-08ee-4de4-893a-56db9c1a29c9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:34.841004 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bf823-08ee-4de4-893a-56db9c1a29c9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:34.842185 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bf823-08ee-4de4-893a-56db9c1a29c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:34.937656 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-634bf823-08ee-4de4-893a-56db9c1a29c9 None None] MFA Rules not processed for user `691199af3147422b909cf842fe545550`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:34.940536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-634bf823-08ee-4de4-893a-56db9c1a29c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:34.956267 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259ffbf-1f5e-4c2d-8491-ff74e689044a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:34.960488 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259ffbf-1f5e-4c2d-8491-ff74e689044a service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:34.991148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 950/1912] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:34.992642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f30627-92d2-4dd2-849e-fc675676cfb0 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:34.996053 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f30627-92d2-4dd2-849e-fc675676cfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:34.996369 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f30627-92d2-4dd2-849e-fc675676cfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:35.042302 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-f5f30627-92d2-4dd2-849e-fc675676cfb0 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:35.043562 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-f5f30627-92d2-4dd2-849e-fc675676cfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:35.088669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 963/1913] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:35.152269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bf823-08ee-4de4-893a-56db9c1a29c9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:35.154501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-634bf823-08ee-4de4-893a-56db9c1a29c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:35.224849 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 951/1914] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:35.249313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f30627-92d2-4dd2-849e-fc675676cfb0 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:35.251547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-f5f30627-92d2-4dd2-849e-fc675676cfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:35.276006 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bf823-08ee-4de4-893a-56db9c1a29c9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:35.291644 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369fabb-cc08-440f-bc23-bcc65ef6e16b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:35.292320 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369fabb-cc08-440f-bc23-bcc65ef6e16b service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:35.292602 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369fabb-cc08-440f-bc23-bcc65ef6e16b service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:35.292876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369fabb-cc08-440f-bc23-bcc65ef6e16b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:35.317512 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369fabb-cc08-440f-bc23-bcc65ef6e16b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:35.319470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369fabb-cc08-440f-bc23-bcc65ef6e16b service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:35.336468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 964/1915] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:35.412155 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f30627-92d2-4dd2-849e-fc675676cfb0 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:35.416886 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c78eb-1639-445d-868d-93471c9506a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:35.417639 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c78eb-1639-445d-868d-93471c9506a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:35.417994 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c78eb-1639-445d-868d-93471c9506a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:35.418371 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c78eb-1639-445d-868d-93471c9506a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:35.430472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c78eb-1639-445d-868d-93471c9506a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:35.432129 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c78eb-1639-445d-868d-93471c9506a0 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:35.451104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 952/1916] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:35.873641 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369fabb-cc08-440f-bc23-bcc65ef6e16b service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:35.875167 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3369fabb-cc08-440f-bc23-bcc65ef6e16b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:35.894334 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369fabb-cc08-440f-bc23-bcc65ef6e16b service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:35.899098 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6a09f-ea3a-4d88-a541-a301aa0f8f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:35.900666 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6a09f-ea3a-4d88-a541-a301aa0f8f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:35.901293 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6a09f-ea3a-4d88-a541-a301aa0f8f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:35.901293 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6a09f-ea3a-4d88-a541-a301aa0f8f9c admin admin] PATH_INFO: `/v3/projects/65349fd538c3400282d2a0ccfee80f16` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:35.902466 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6a09f-ea3a-4d88-a541-a301aa0f8f9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=65349fd538c3400282d2a0ccfee80f16)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:35.904394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6a09f-ea3a-4d88-a541-a301aa0f8f9c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:35.959430 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-efc6a09f-ea3a-4d88-a541-a301aa0f8f9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65349fd538c3400282d2a0ccfee80f16', 'request_id': 'req-efc6a09f-ea3a-4d88-a541-a301aa0f8f9c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:35.964911 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:35.966141 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-efc6a09f-ea3a-4d88-a541-a301aa0f8f9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65349fd538c3400282d2a0ccfee80f16', 'request_id': 'req-efc6a09f-ea3a-4d88-a541-a301aa0f8f9c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:35.976124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-efc6a09f-ea3a-4d88-a541-a301aa0f8f9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65349fd538c3400282d2a0ccfee80f16', 'request_id': 'req-efc6a09f-ea3a-4d88-a541-a301aa0f8f9c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:35.992487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-efc6a09f-ea3a-4d88-a541-a301aa0f8f9c admin admin] The token cache is being invalidate because project 65349fd538c3400282d2a0ccfee80f16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:35.993496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-efc6a09f-ea3a-4d88-a541-a301aa0f8f9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:35.994168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-efc6a09f-ea3a-4d88-a541-a301aa0f8f9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:35.996079 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 965/1917] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:35 2022] DELETE /identity/v3/projects/65349fd538c3400282d2a0ccfee80f16 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:36.001215 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fe2ac-19d6-4a9f-9d58-21be17686dac None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:36.001729 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fe2ac-19d6-4a9f-9d58-21be17686dac None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:36.001729 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fe2ac-19d6-4a9f-9d58-21be17686dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:36.027188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-a47fe2ac-19d6-4a9f-9d58-21be17686dac None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:36.027693 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a47fe2ac-19d6-4a9f-9d58-21be17686dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:36.083059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:36.099414 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 953/1918] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:36.107202 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289b97a-e960-4ef1-bad6-65e199aaf173 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:36.107488 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289b97a-e960-4ef1-bad6-65e199aaf173 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:36.107762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289b97a-e960-4ef1-bad6-65e199aaf173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:36.128058 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f289b97a-e960-4ef1-bad6-65e199aaf173 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:36.129246 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f289b97a-e960-4ef1-bad6-65e199aaf173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:36.137992 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 966/1919] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:15:36.144033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fe2ac-19d6-4a9f-9d58-21be17686dac None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:36.154867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fe2ac-19d6-4a9f-9d58-21be17686dac None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:36.160424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a1039-9a3a-42ad-97a1-d7480e089e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:36.161243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a1039-9a3a-42ad-97a1-d7480e089e88 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:36.161653 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a1039-9a3a-42ad-97a1-d7480e089e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:36.161943 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a1039-9a3a-42ad-97a1-d7480e089e88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:36.162854 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a1039-9a3a-42ad-97a1-d7480e089e88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:15:36.163189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a1039-9a3a-42ad-97a1-d7480e089e88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:36.164800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a1039-9a3a-42ad-97a1-d7480e089e88 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:36.176724 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 954/1920] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:15:36.181773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289b97a-e960-4ef1-bad6-65e199aaf173 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:36.191622 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289b97a-e960-4ef1-bad6-65e199aaf173 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:36.196827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec476bd-f09b-4737-8296-eba220b7f3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:36.197483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec476bd-f09b-4737-8296-eba220b7f3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:36.197766 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec476bd-f09b-4737-8296-eba220b7f3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:36.198065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec476bd-f09b-4737-8296-eba220b7f3c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:36.198754 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec476bd-f09b-4737-8296-eba220b7f3c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:36.200655 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec476bd-f09b-4737-8296-eba220b7f3c2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:36.228901 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 967/1921] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:36 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:36.233841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a1039-9a3a-42ad-97a1-d7480e089e88 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:36.244588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a1039-9a3a-42ad-97a1-d7480e089e88 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:36.301918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d880ecc-5742-4a63-ad43-f1fe3bab3d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:36.302754 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d880ecc-5742-4a63-ad43-f1fe3bab3d67 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:36.303172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d880ecc-5742-4a63-ad43-f1fe3bab3d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:36.303518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d880ecc-5742-4a63-ad43-f1fe3bab3d67 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:36.304338 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d880ecc-5742-4a63-ad43-f1fe3bab3d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:36.306936 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d880ecc-5742-4a63-ad43-f1fe3bab3d67 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:36.336787 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 955/1922] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:36 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:36.338175 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec476bd-f09b-4737-8296-eba220b7f3c2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:36.350802 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec476bd-f09b-4737-8296-eba220b7f3c2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:36.356176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6521f-90fe-4d4d-b13b-3fa0c73ab8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:36.356930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6521f-90fe-4d4d-b13b-3fa0c73ab8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:36.357375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6521f-90fe-4d4d-b13b-3fa0c73ab8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:36.357725 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6521f-90fe-4d4d-b13b-3fa0c73ab8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:36.358620 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6521f-90fe-4d4d-b13b-3fa0c73ab8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:36.369679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6521f-90fe-4d4d-b13b-3fa0c73ab8b0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:36.391317 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 968/1923] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:36.394815 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d880ecc-5742-4a63-ad43-f1fe3bab3d67 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:36.407532 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d880ecc-5742-4a63-ad43-f1fe3bab3d67 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:36.413124 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c25eb-423a-4e9c-9b09-c8d9b2481bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:36.413811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c25eb-423a-4e9c-9b09-c8d9b2481bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:36.414262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c25eb-423a-4e9c-9b09-c8d9b2481bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:36.415140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c25eb-423a-4e9c-9b09-c8d9b2481bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:36.415860 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c25eb-423a-4e9c-9b09-c8d9b2481bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:36.417444 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c25eb-423a-4e9c-9b09-c8d9b2481bf1 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:36.446695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 956/1924] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:36.446905 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6521f-90fe-4d4d-b13b-3fa0c73ab8b0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:36.457809 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6521f-90fe-4d4d-b13b-3fa0c73ab8b0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:36.460850 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c25eb-423a-4e9c-9b09-c8d9b2481bf1 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:36.463099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a06c25eb-423a-4e9c-9b09-c8d9b2481bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:36.469631 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd0495-fc50-4ecc-a870-4a5dc2982c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:36.473831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd0495-fc50-4ecc-a870-4a5dc2982c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:36.476748 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd0495-fc50-4ecc-a870-4a5dc2982c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:36.477760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd0495-fc50-4ecc-a870-4a5dc2982c96 admin admin] PATH_INFO: `/v3/projects/2d3280f184854bebaf2a1a26d1db6cd2/users/376d10540ec44065a7010c87d1c50dd6/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:36.525002 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd0495-fc50-4ecc-a870-4a5dc2982c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3280f184854bebaf2a1a26d1db6cd2, user_id=376d10540ec44065a7010c87d1c50dd6, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:36.532469 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd0495-fc50-4ecc-a870-4a5dc2982c96 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:36.572615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 969/1925] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:36 2022] PUT /identity/v3/projects/2d3280f184854bebaf2a1a26d1db6cd2/users/376d10540ec44065a7010c87d1c50dd6/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:36.577379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb220b-7bd2-4aeb-9a51-551fc702b75a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:36.577753 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb220b-7bd2-4aeb-9a51-551fc702b75a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:36.578151 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb220b-7bd2-4aeb-9a51-551fc702b75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:36.607477 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c25eb-423a-4e9c-9b09-c8d9b2481bf1 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:36.609652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-42fb220b-7bd2-4aeb-9a51-551fc702b75a None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:36.612461 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-42fb220b-7bd2-4aeb-9a51-551fc702b75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:36.691893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813ea52-e533-4308-b4fb-76fe6234baba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:36.693674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813ea52-e533-4308-b4fb-76fe6234baba service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:36.705821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813ea52-e533-4308-b4fb-76fe6234baba service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:36.705945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813ea52-e533-4308-b4fb-76fe6234baba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:36.717073 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a813ea52-e533-4308-b4fb-76fe6234baba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:36.819803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 970/1926] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:36.830711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb220b-7bd2-4aeb-9a51-551fc702b75a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:36.834336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-42fb220b-7bd2-4aeb-9a51-551fc702b75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:36.834792 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:36.931237 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813ea52-e533-4308-b4fb-76fe6234baba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:36.936092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813ea52-e533-4308-b4fb-76fe6234baba service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:36.947313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb220b-7bd2-4aeb-9a51-551fc702b75a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:36.956605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c47019-6c84-4d39-9801-52479947abaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:36.957260 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c47019-6c84-4d39-9801-52479947abaa service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:36.957547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c47019-6c84-4d39-9801-52479947abaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:36.957819 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c47019-6c84-4d39-9801-52479947abaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:36.962102 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 957/1927] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:15:36.987221 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c47019-6c84-4d39-9801-52479947abaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:36.989602 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c47019-6c84-4d39-9801-52479947abaa service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:37.013617 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 971/1928] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:15:38.507663 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2c6b0-51c7-4a2b-a1eb-9169a3b58d7f None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:38.508242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2c6b0-51c7-4a2b-a1eb-9169a3b58d7f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:38.508242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2c6b0-51c7-4a2b-a1eb-9169a3b58d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:38.559628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-79d2c6b0-51c7-4a2b-a1eb-9169a3b58d7f None None] MFA Rules not processed for user `376d10540ec44065a7010c87d1c50dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:38.561702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-79d2c6b0-51c7-4a2b-a1eb-9169a3b58d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:38.714719 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 958/1929] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:38.800513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c47019-6c84-4d39-9801-52479947abaa service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:38.802906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-65c47019-6c84-4d39-9801-52479947abaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:38.837329 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c47019-6c84-4d39-9801-52479947abaa service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:38.851809 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df0894-909e-4d33-b4d8-a689d35caf57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:38.852578 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df0894-909e-4d33-b4d8-a689d35caf57 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:38.852963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df0894-909e-4d33-b4d8-a689d35caf57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:38.853246 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df0894-909e-4d33-b4d8-a689d35caf57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:38.863230 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df0894-909e-4d33-b4d8-a689d35caf57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:38.864677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df0894-909e-4d33-b4d8-a689d35caf57 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:38.882331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 972/1930] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:40.507433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7d138-2a5a-472c-8771-1abc9910a915 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:40.507967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7d138-2a5a-472c-8771-1abc9910a915 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:40.508155 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7d138-2a5a-472c-8771-1abc9910a915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:40.532654 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-0ed7d138-2a5a-472c-8771-1abc9910a915 None None] MFA Rules not processed for user `376d10540ec44065a7010c87d1c50dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:40.534045 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-0ed7d138-2a5a-472c-8771-1abc9910a915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:40.541318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 959/1931] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:15:41.265577 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df0894-909e-4d33-b4d8-a689d35caf57 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:41.268030 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-17df0894-909e-4d33-b4d8-a689d35caf57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:41.296963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df0894-909e-4d33-b4d8-a689d35caf57 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:41.304969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060f844-1a1c-4eee-810c-ced5cdc495f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:41.307637 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060f844-1a1c-4eee-810c-ced5cdc495f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:41.308109 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060f844-1a1c-4eee-810c-ced5cdc495f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:41.308460 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060f844-1a1c-4eee-810c-ced5cdc495f0 admin admin] PATH_INFO: `/v3/users/9983606342b243edae8a8edd6a05e231` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:41.310461 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d060f844-1a1c-4eee-810c-ced5cdc495f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9983606342b243edae8a8edd6a05e231)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:41.312999 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d060f844-1a1c-4eee-810c-ced5cdc495f0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:41.321525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:41.388447 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d060f844-1a1c-4eee-810c-ced5cdc495f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9983606342b243edae8a8edd6a05e231'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:41.389149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d060f844-1a1c-4eee-810c-ced5cdc495f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9983606342b243edae8a8edd6a05e231'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:41.389931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d060f844-1a1c-4eee-810c-ced5cdc495f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9983606342b243edae8a8edd6a05e231'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:41.407927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d060f844-1a1c-4eee-810c-ced5cdc495f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9983606342b243edae8a8edd6a05e231'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:41.417553 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d060f844-1a1c-4eee-810c-ced5cdc495f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9983606342b243edae8a8edd6a05e231'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:41.433454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 973/1932] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:41 2022] DELETE /identity/v3/users/9983606342b243edae8a8edd6a05e231 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:41.438565 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccdb54-9234-44e1-9fe8-bb8837c7259e None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:41.439078 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccdb54-9234-44e1-9fe8-bb8837c7259e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:41.439591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccdb54-9234-44e1-9fe8-bb8837c7259e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:41.470849 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-ebccdb54-9234-44e1-9fe8-bb8837c7259e None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:41.472391 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ebccdb54-9234-44e1-9fe8-bb8837c7259e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:41.556742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 960/1933] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:15:41.569460 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060f844-1a1c-4eee-810c-ced5cdc495f0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:41.573879 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d060f844-1a1c-4eee-810c-ced5cdc495f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:41.702105 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060f844-1a1c-4eee-810c-ced5cdc495f0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:41.707307 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fbde4-77d4-415b-a018-8492fe2b5cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:41.708096 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fbde4-77d4-415b-a018-8492fe2b5cca service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:41.708410 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fbde4-77d4-415b-a018-8492fe2b5cca service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:41.708657 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fbde4-77d4-415b-a018-8492fe2b5cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:41.721314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fbde4-77d4-415b-a018-8492fe2b5cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:41.723172 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fbde4-77d4-415b-a018-8492fe2b5cca service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:41.735468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 974/1934] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:42.284761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccdb54-9234-44e1-9fe8-bb8837c7259e None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:42.288489 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ebccdb54-9234-44e1-9fe8-bb8837c7259e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:42.310127 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccdb54-9234-44e1-9fe8-bb8837c7259e None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:42.320488 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bc5e4-2924-4b37-8b28-4bf8bccd63e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:42.322258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bc5e4-2924-4b37-8b28-4bf8bccd63e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:42.322547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bc5e4-2924-4b37-8b28-4bf8bccd63e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:42.322826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bc5e4-2924-4b37-8b28-4bf8bccd63e7 admin admin] PATH_INFO: `/v3/users/2192721ffaf345b2abc826a140958a0e` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:42.324837 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bc5e4-2924-4b37-8b28-4bf8bccd63e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2192721ffaf345b2abc826a140958a0e)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:42.330237 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bc5e4-2924-4b37-8b28-4bf8bccd63e7 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:42.339719 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fbde4-77d4-415b-a018-8492fe2b5cca service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:42.341734 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-078fbde4-77d4-415b-a018-8492fe2b5cca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:42.376238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fbde4-77d4-415b-a018-8492fe2b5cca service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:42.389123 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d1361-0b51-439f-a57d-2fa8fdff0763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:42.390447 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d1361-0b51-439f-a57d-2fa8fdff0763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:42.390974 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d1361-0b51-439f-a57d-2fa8fdff0763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:42.391377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d1361-0b51-439f-a57d-2fa8fdff0763 admin admin] PATH_INFO: `/v3/projects/e88c6bf9b22a4af7bf1ee9e8a377e4f1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:42.393159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d1361-0b51-439f-a57d-2fa8fdff0763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e88c6bf9b22a4af7bf1ee9e8a377e4f1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:42.395899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d1361-0b51-439f-a57d-2fa8fdff0763 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:42.413045 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:42.428250 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-dc5bc5e4-2924-4b37-8b28-4bf8bccd63e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2192721ffaf345b2abc826a140958a0e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:42.431703 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-dc5bc5e4-2924-4b37-8b28-4bf8bccd63e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2192721ffaf345b2abc826a140958a0e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:42.432351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-dc5bc5e4-2924-4b37-8b28-4bf8bccd63e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2192721ffaf345b2abc826a140958a0e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:42.459710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-dc5bc5e4-2924-4b37-8b28-4bf8bccd63e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2192721ffaf345b2abc826a140958a0e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:42.479240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-dc5bc5e4-2924-4b37-8b28-4bf8bccd63e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2192721ffaf345b2abc826a140958a0e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:42.506850 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 961/1935] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:42 2022] DELETE /identity/v3/users/2192721ffaf345b2abc826a140958a0e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:42.511701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39ea6a-c4cd-47f8-89cb-53cbcd6430ab None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:42.512172 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39ea6a-c4cd-47f8-89cb-53cbcd6430ab None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:42.512657 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39ea6a-c4cd-47f8-89cb-53cbcd6430ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:42.519201 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8f4d1361-0b51-439f-a57d-2fa8fdff0763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e88c6bf9b22a4af7bf1ee9e8a377e4f1', 'request_id': 'req-8f4d1361-0b51-439f-a57d-2fa8fdff0763'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:42.531237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8f4d1361-0b51-439f-a57d-2fa8fdff0763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e88c6bf9b22a4af7bf1ee9e8a377e4f1', 'request_id': 'req-8f4d1361-0b51-439f-a57d-2fa8fdff0763'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:42.533668 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-5b39ea6a-c4cd-47f8-89cb-53cbcd6430ab None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:42.535282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5b39ea6a-c4cd-47f8-89cb-53cbcd6430ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:42.542962 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8f4d1361-0b51-439f-a57d-2fa8fdff0763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e88c6bf9b22a4af7bf1ee9e8a377e4f1', 'request_id': 'req-8f4d1361-0b51-439f-a57d-2fa8fdff0763'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:42.563052 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8f4d1361-0b51-439f-a57d-2fa8fdff0763 admin admin] The token cache is being invalidate because project e88c6bf9b22a4af7bf1ee9e8a377e4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:42.563394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8f4d1361-0b51-439f-a57d-2fa8fdff0763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:42.564044 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8f4d1361-0b51-439f-a57d-2fa8fdff0763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:42.565787 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 975/1936] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:42 2022] DELETE /identity/v3/projects/e88c6bf9b22a4af7bf1ee9e8a377e4f1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:42.569774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d1361-0b51-439f-a57d-2fa8fdff0763 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:42.571253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8f4d1361-0b51-439f-a57d-2fa8fdff0763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:42.594454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:42.614915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 962/1937] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:42.625441 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39ea6a-c4cd-47f8-89cb-53cbcd6430ab None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:42.628425 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5b39ea6a-c4cd-47f8-89cb-53cbcd6430ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:42.672286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d1361-0b51-439f-a57d-2fa8fdff0763 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:42.679217 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667f5ba-27ac-4b9e-b2ac-568cd117b975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:42.682031 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667f5ba-27ac-4b9e-b2ac-568cd117b975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:42.682622 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667f5ba-27ac-4b9e-b2ac-568cd117b975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:42.683105 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667f5ba-27ac-4b9e-b2ac-568cd117b975 admin admin] PATH_INFO: `/v3/users/8b79861681784900a7e5164a30b7d8a4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:42.685011 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667f5ba-27ac-4b9e-b2ac-568cd117b975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b79861681784900a7e5164a30b7d8a4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:42.687333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667f5ba-27ac-4b9e-b2ac-568cd117b975 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:42.758318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7667f5ba-27ac-4b9e-b2ac-568cd117b975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b79861681784900a7e5164a30b7d8a4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:42.759063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7667f5ba-27ac-4b9e-b2ac-568cd117b975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b79861681784900a7e5164a30b7d8a4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:42.759699 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39ea6a-c4cd-47f8-89cb-53cbcd6430ab None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:42.759825 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7667f5ba-27ac-4b9e-b2ac-568cd117b975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b79861681784900a7e5164a30b7d8a4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:42.764858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60eea6e-38cc-4c76-9ee5-3d4ead676d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:42.766975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eea6e-38cc-4c76-9ee5-3d4ead676d29 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:42.767657 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eea6e-38cc-4c76-9ee5-3d4ead676d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:42.767945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eea6e-38cc-4c76-9ee5-3d4ead676d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:42.770991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c60eea6e-38cc-4c76-9ee5-3d4ead676d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:42.775067 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7667f5ba-27ac-4b9e-b2ac-568cd117b975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b79861681784900a7e5164a30b7d8a4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:42.787707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60eea6e-38cc-4c76-9ee5-3d4ead676d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:42.788132 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7667f5ba-27ac-4b9e-b2ac-568cd117b975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b79861681784900a7e5164a30b7d8a4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:42.790438 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60eea6e-38cc-4c76-9ee5-3d4ead676d29 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:42.802814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 963/1938] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:15:42.812498 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 976/1939] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:42 2022] DELETE /identity/v3/users/8b79861681784900a7e5164a30b7d8a4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:43.525446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60eea6e-38cc-4c76-9ee5-3d4ead676d29 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:43.527918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c60eea6e-38cc-4c76-9ee5-3d4ead676d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:43.552283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60eea6e-38cc-4c76-9ee5-3d4ead676d29 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:43.680776 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cbd5ba-c72d-49b1-99e5-ef97d663288b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:43.682446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbd5ba-c72d-49b1-99e5-ef97d663288b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:43.682957 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbd5ba-c72d-49b1-99e5-ef97d663288b admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:43.683446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbd5ba-c72d-49b1-99e5-ef97d663288b admin admin] PATH_INFO: `/v3/projects/dafc1d87ebee4bfc8edc83c3abb344f1` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:43.685755 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cbd5ba-c72d-49b1-99e5-ef97d663288b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dafc1d87ebee4bfc8edc83c3abb344f1)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:43.688425 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cbd5ba-c72d-49b1-99e5-ef97d663288b admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:43.690536 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:43.798555 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-44cbd5ba-c72d-49b1-99e5-ef97d663288b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dafc1d87ebee4bfc8edc83c3abb344f1', 'request_id': 'req-44cbd5ba-c72d-49b1-99e5-ef97d663288b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:43.812385 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-44cbd5ba-c72d-49b1-99e5-ef97d663288b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dafc1d87ebee4bfc8edc83c3abb344f1', 'request_id': 'req-44cbd5ba-c72d-49b1-99e5-ef97d663288b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:43.821923 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667f5ba-27ac-4b9e-b2ac-568cd117b975 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:43.822457 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-44cbd5ba-c72d-49b1-99e5-ef97d663288b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dafc1d87ebee4bfc8edc83c3abb344f1', 'request_id': 'req-44cbd5ba-c72d-49b1-99e5-ef97d663288b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:43.823415 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7667f5ba-27ac-4b9e-b2ac-568cd117b975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:43.839311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-44cbd5ba-c72d-49b1-99e5-ef97d663288b admin admin] The token cache is being invalidate because project dafc1d87ebee4bfc8edc83c3abb344f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:43.839559 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-44cbd5ba-c72d-49b1-99e5-ef97d663288b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:43.840888 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-44cbd5ba-c72d-49b1-99e5-ef97d663288b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:43.844887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667f5ba-27ac-4b9e-b2ac-568cd117b975 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:43.845975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 964/1940] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:43 2022] DELETE /identity/v3/projects/dafc1d87ebee4bfc8edc83c3abb344f1 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:43.847351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36399f02-2fb8-43c2-9530-b58fe0ed3a4e None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:43.847639 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36399f02-2fb8-43c2-9530-b58fe0ed3a4e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:43.848053 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36399f02-2fb8-43c2-9530-b58fe0ed3a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:43.875572 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-36399f02-2fb8-43c2-9530-b58fe0ed3a4e None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:43.876809 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-36399f02-2fb8-43c2-9530-b58fe0ed3a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:43.977569 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 965/1941] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:43.986486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d1bb5-caaa-428b-8eaf-1a1e1ea0a8e2 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:43.986854 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d1bb5-caaa-428b-8eaf-1a1e1ea0a8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:43.987204 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d1bb5-caaa-428b-8eaf-1a1e1ea0a8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:43.999891 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538b21a-09b1-4c07-8c53-e4521266eaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:44.001092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538b21a-09b1-4c07-8c53-e4521266eaf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:44.001540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538b21a-09b1-4c07-8c53-e4521266eaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:44.001986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538b21a-09b1-4c07-8c53-e4521266eaf5 admin admin] PATH_INFO: `/v3/projects/1b535e8e573f4bd48123466e37e553b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:44.006388 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538b21a-09b1-4c07-8c53-e4521266eaf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b535e8e573f4bd48123466e37e553b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:44.009041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538b21a-09b1-4c07-8c53-e4521266eaf5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:44.014079 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-037d1bb5-caaa-428b-8eaf-1a1e1ea0a8e2 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:44.016198 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-037d1bb5-caaa-428b-8eaf-1a1e1ea0a8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:44.031231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 966/1942] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:44.032396 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d1bb5-caaa-428b-8eaf-1a1e1ea0a8e2 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:44.044546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d1bb5-caaa-428b-8eaf-1a1e1ea0a8e2 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:44.053601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbe32b-8552-41b6-b454-585811650d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:44.054636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbe32b-8552-41b6-b454-585811650d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:44.055102 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbe32b-8552-41b6-b454-585811650d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:44.056079 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbe32b-8552-41b6-b454-585811650d7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:44.058408 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbe32b-8552-41b6-b454-585811650d7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:15:44.059083 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbe32b-8552-41b6-b454-585811650d7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:44.060778 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbe32b-8552-41b6-b454-585811650d7f admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:44.076484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:44.082692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 967/1943] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:15:44.084635 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbe32b-8552-41b6-b454-585811650d7f admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:44.099521 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbe32b-8552-41b6-b454-585811650d7f admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:44.113788 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1538b21a-09b1-4c07-8c53-e4521266eaf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b535e8e573f4bd48123466e37e553b1', 'request_id': 'req-1538b21a-09b1-4c07-8c53-e4521266eaf5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:44.128790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1538b21a-09b1-4c07-8c53-e4521266eaf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b535e8e573f4bd48123466e37e553b1', 'request_id': 'req-1538b21a-09b1-4c07-8c53-e4521266eaf5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:44.146451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1538b21a-09b1-4c07-8c53-e4521266eaf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b535e8e573f4bd48123466e37e553b1', 'request_id': 'req-1538b21a-09b1-4c07-8c53-e4521266eaf5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:44.170856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1538b21a-09b1-4c07-8c53-e4521266eaf5 admin admin] The token cache is being invalidate because project 1b535e8e573f4bd48123466e37e553b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:44.171711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1538b21a-09b1-4c07-8c53-e4521266eaf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:44.173058 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1538b21a-09b1-4c07-8c53-e4521266eaf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:44.175899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 977/1944] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:43 2022] DELETE /identity/v3/projects/1b535e8e573f4bd48123466e37e553b1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:44.179873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538b21a-09b1-4c07-8c53-e4521266eaf5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:44.181475 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a88577-ad5c-4bfd-9780-fe6a19bde7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:44.181948 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1538b21a-09b1-4c07-8c53-e4521266eaf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:44.182510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a88577-ad5c-4bfd-9780-fe6a19bde7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:44.182793 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a88577-ad5c-4bfd-9780-fe6a19bde7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:44.183064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a88577-ad5c-4bfd-9780-fe6a19bde7d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:44.186335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a88577-ad5c-4bfd-9780-fe6a19bde7d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:44.187701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a88577-ad5c-4bfd-9780-fe6a19bde7d7 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:44.210579 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:44.224244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538b21a-09b1-4c07-8c53-e4521266eaf5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:44.231562 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 968/1945] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:44 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:44.235873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a88577-ad5c-4bfd-9780-fe6a19bde7d7 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:44.236139 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1643279-0e05-4633-809a-506d311e3687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:44.237330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1643279-0e05-4633-809a-506d311e3687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:44.238128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1643279-0e05-4633-809a-506d311e3687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:44.238849 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1643279-0e05-4633-809a-506d311e3687 admin admin] PATH_INFO: `/v3/users/0d80350f677d4521bcae2f5b3e23b09c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:44.240524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1643279-0e05-4633-809a-506d311e3687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d80350f677d4521bcae2f5b3e23b09c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:44.241436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-64a88577-ad5c-4bfd-9780-fe6a19bde7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:44.245945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1643279-0e05-4633-809a-506d311e3687 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:44.368724 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a88577-ad5c-4bfd-9780-fe6a19bde7d7 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:44.374318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee84da3-193a-462c-8ea1-ee292944dde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:44.375173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee84da3-193a-462c-8ea1-ee292944dde5 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:44.375609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee84da3-193a-462c-8ea1-ee292944dde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:44.376914 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee84da3-193a-462c-8ea1-ee292944dde5 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:44.377767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee84da3-193a-462c-8ea1-ee292944dde5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:44.380014 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee84da3-193a-462c-8ea1-ee292944dde5 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:44.401952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f1643279-0e05-4633-809a-506d311e3687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d80350f677d4521bcae2f5b3e23b09c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:44.402786 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f1643279-0e05-4633-809a-506d311e3687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d80350f677d4521bcae2f5b3e23b09c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:44.403782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f1643279-0e05-4633-809a-506d311e3687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d80350f677d4521bcae2f5b3e23b09c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:44.415769 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 969/1946] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:44 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:44.420213 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee84da3-193a-462c-8ea1-ee292944dde5 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:44.425816 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-3ee84da3-193a-462c-8ea1-ee292944dde5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:44.435007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f1643279-0e05-4633-809a-506d311e3687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d80350f677d4521bcae2f5b3e23b09c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:44.448898 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee84da3-193a-462c-8ea1-ee292944dde5 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:44.455406 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f1643279-0e05-4633-809a-506d311e3687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d80350f677d4521bcae2f5b3e23b09c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:44.469106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e2104-99b5-4add-975b-e065a3fb91e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:44.472248 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e2104-99b5-4add-975b-e065a3fb91e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:44.472523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e2104-99b5-4add-975b-e065a3fb91e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:44.472799 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e2104-99b5-4add-975b-e065a3fb91e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:44.475044 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e2104-99b5-4add-975b-e065a3fb91e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:44.479727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e2104-99b5-4add-975b-e065a3fb91e5 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:44.482618 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 978/1947] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:44 2022] DELETE /identity/v3/users/0d80350f677d4521bcae2f5b3e23b09c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:44.509967 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1643279-0e05-4633-809a-506d311e3687 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:44.517410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 970/1948] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:44.662344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1643279-0e05-4633-809a-506d311e3687 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:44.684774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172c699-f892-435d-90c6-364852314f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:44.685854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172c699-f892-435d-90c6-364852314f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:44.686297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172c699-f892-435d-90c6-364852314f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:44.686725 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172c699-f892-435d-90c6-364852314f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:44.687601 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172c699-f892-435d-90c6-364852314f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:44.689584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172c699-f892-435d-90c6-364852314f5b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:44.710495 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 979/1949] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:44.715510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e2104-99b5-4add-975b-e065a3fb91e5 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:44.735546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e2104-99b5-4add-975b-e065a3fb91e5 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:44.753005 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a6f7e-1cc3-4e2f-85f3-85f3c19014b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:44.757018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a6f7e-1cc3-4e2f-85f3-85f3c19014b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:44.757018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a6f7e-1cc3-4e2f-85f3-85f3c19014b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:44.757018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a6f7e-1cc3-4e2f-85f3-85f3c19014b5 admin admin] PATH_INFO: `/v3/projects/606a645af11d48f7909bb4e61a124939/users/a89bd7ecea394e3a8602ede06fc5318b/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:44.786516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a6f7e-1cc3-4e2f-85f3-85f3c19014b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=606a645af11d48f7909bb4e61a124939, user_id=a89bd7ecea394e3a8602ede06fc5318b, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:44.790242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a6f7e-1cc3-4e2f-85f3-85f3c19014b5 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:44.806781 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 971/1950] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:44 2022] PUT /identity/v3/projects/606a645af11d48f7909bb4e61a124939/users/a89bd7ecea394e3a8602ede06fc5318b/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:44.820561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851152fe-c51a-49a2-a964-2ec85b289dae None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:44.820840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851152fe-c51a-49a2-a964-2ec85b289dae None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:44.821648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851152fe-c51a-49a2-a964-2ec85b289dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:44.856626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-851152fe-c51a-49a2-a964-2ec85b289dae None None] MFA Rules not processed for user `a89bd7ecea394e3a8602ede06fc5318b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:44.859353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-851152fe-c51a-49a2-a964-2ec85b289dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:44.872591 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:44.938733 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 980/1951] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:44.943453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a6f7e-1cc3-4e2f-85f3-85f3c19014b5 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:45.020373 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a6f7e-1cc3-4e2f-85f3-85f3c19014b5 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:45.025891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5685574-64f3-4799-b895-7c95ce6e0f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:45.026649 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5685574-64f3-4799-b895-7c95ce6e0f41 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.027014 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5685574-64f3-4799-b895-7c95ce6e0f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.027347 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5685574-64f3-4799-b895-7c95ce6e0f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.028322 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5685574-64f3-4799-b895-7c95ce6e0f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:45.030543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5685574-64f3-4799-b895-7c95ce6e0f41 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:45.051832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851152fe-c51a-49a2-a964-2ec85b289dae None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:45.053433 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-851152fe-c51a-49a2-a964-2ec85b289dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:45.066075 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 972/1952] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:44 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:45.071822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5685574-64f3-4799-b895-7c95ce6e0f41 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:45.085188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851152fe-c51a-49a2-a964-2ec85b289dae None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:45.124288 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:45.156129 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5685574-64f3-4799-b895-7c95ce6e0f41 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:45.158441 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188651d6-3444-4cef-ada3-a869e452f941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:45.159803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188651d6-3444-4cef-ada3-a869e452f941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.160093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188651d6-3444-4cef-ada3-a869e452f941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.160523 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188651d6-3444-4cef-ada3-a869e452f941 admin admin] PATH_INFO: `/v3/projects/9f4d5eb69d7542078ea06759a4c59eec` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.162351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f70a68-0b38-4ccd-87c3-4c95d569ff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:45.162494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188651d6-3444-4cef-ada3-a869e452f941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f4d5eb69d7542078ea06759a4c59eec)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:45.163231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f70a68-0b38-4ccd-87c3-4c95d569ff90 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.163659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f70a68-0b38-4ccd-87c3-4c95d569ff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.164084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f70a68-0b38-4ccd-87c3-4c95d569ff90 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.164321 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188651d6-3444-4cef-ada3-a869e452f941 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:45.164837 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f70a68-0b38-4ccd-87c3-4c95d569ff90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:45.166842 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f70a68-0b38-4ccd-87c3-4c95d569ff90 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:45.198638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 973/1953] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:45 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:45.202345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f70a68-0b38-4ccd-87c3-4c95d569ff90 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:45.216265 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f70a68-0b38-4ccd-87c3-4c95d569ff90 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:45.221134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-188651d6-3444-4cef-ada3-a869e452f941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f4d5eb69d7542078ea06759a4c59eec', 'request_id': 'req-188651d6-3444-4cef-ada3-a869e452f941'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:45.229908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-188651d6-3444-4cef-ada3-a869e452f941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f4d5eb69d7542078ea06759a4c59eec', 'request_id': 'req-188651d6-3444-4cef-ada3-a869e452f941'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:45.239230 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-188651d6-3444-4cef-ada3-a869e452f941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f4d5eb69d7542078ea06759a4c59eec', 'request_id': 'req-188651d6-3444-4cef-ada3-a869e452f941'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:45.260819 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-188651d6-3444-4cef-ada3-a869e452f941 admin admin] The token cache is being invalidate because project 9f4d5eb69d7542078ea06759a4c59eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:45.261224 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-188651d6-3444-4cef-ada3-a869e452f941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:45.270619 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-188651d6-3444-4cef-ada3-a869e452f941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:45.273012 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 981/1954] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:45 2022] DELETE /identity/v3/projects/9f4d5eb69d7542078ea06759a4c59eec => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:45.277686 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d27ee-bb5a-4794-9a76-926214ed3a47 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.278064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d27ee-bb5a-4794-9a76-926214ed3a47 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.278542 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d27ee-bb5a-4794-9a76-926214ed3a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.286184 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d048ac-43c2-491d-9f9c-5a5b285bd392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:45.287651 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d048ac-43c2-491d-9f9c-5a5b285bd392 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.287998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d048ac-43c2-491d-9f9c-5a5b285bd392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.288262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d048ac-43c2-491d-9f9c-5a5b285bd392 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.289044 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d048ac-43c2-491d-9f9c-5a5b285bd392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:45.291214 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d048ac-43c2-491d-9f9c-5a5b285bd392 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:45.300903 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0e6d27ee-bb5a-4794-9a76-926214ed3a47 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:45.302352 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0e6d27ee-bb5a-4794-9a76-926214ed3a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:45.303420 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 974/1955] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:45.308262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d048ac-43c2-491d-9f9c-5a5b285bd392 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:45.310306 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b9d048ac-43c2-491d-9f9c-5a5b285bd392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:45.318756 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 982/1956] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:45.320074 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d4c9e-634f-4c52-b6ac-7d84c74aa277 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.320368 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d4c9e-634f-4c52-b6ac-7d84c74aa277 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.320651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d4c9e-634f-4c52-b6ac-7d84c74aa277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.325947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d048ac-43c2-491d-9f9c-5a5b285bd392 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:45.331452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00e78c-503e-4a46-b3cc-b4d2dec158cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:45.332232 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00e78c-503e-4a46-b3cc-b4d2dec158cc admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.332627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00e78c-503e-4a46-b3cc-b4d2dec158cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.333008 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00e78c-503e-4a46-b3cc-b4d2dec158cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.333808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00e78c-503e-4a46-b3cc-b4d2dec158cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:45.335529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00e78c-503e-4a46-b3cc-b4d2dec158cc admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:45.342627 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c06d4c9e-634f-4c52-b6ac-7d84c74aa277 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:45.344037 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c06d4c9e-634f-4c52-b6ac-7d84c74aa277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:45.348991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 975/1957] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:15:45.353889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00e78c-503e-4a46-b3cc-b4d2dec158cc admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:45.357795 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 983/1958] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:15:45.358814 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d4c9e-634f-4c52-b6ac-7d84c74aa277 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:45.363897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00e78c-503e-4a46-b3cc-b4d2dec158cc admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:45.369458 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00d176-6a98-448f-a61a-6d6d1d591ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:45.369928 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d4c9e-634f-4c52-b6ac-7d84c74aa277 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:45.370379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00d176-6a98-448f-a61a-6d6d1d591ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.370666 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00d176-6a98-448f-a61a-6d6d1d591ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.370946 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00d176-6a98-448f-a61a-6d6d1d591ca6 admin admin] PATH_INFO: `/v3/projects/665e61a2714e4eea8f28c291b20d6e8d/users/252275bbfeff48d39711710d44a123b6/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.374790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce54ed-702e-440c-873e-6120409a954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:45.375579 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce54ed-702e-440c-873e-6120409a954e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.375860 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce54ed-702e-440c-873e-6120409a954e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.376132 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce54ed-702e-440c-873e-6120409a954e admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.376858 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce54ed-702e-440c-873e-6120409a954e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:15:45.377364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce54ed-702e-440c-873e-6120409a954e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:45.379042 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce54ed-702e-440c-873e-6120409a954e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:45.386510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00d176-6a98-448f-a61a-6d6d1d591ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=665e61a2714e4eea8f28c291b20d6e8d, user_id=252275bbfeff48d39711710d44a123b6, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:45.389160 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00d176-6a98-448f-a61a-6d6d1d591ca6 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:45.391646 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 984/1959] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:15:45.396435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce54ed-702e-440c-873e-6120409a954e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:45.406840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce54ed-702e-440c-873e-6120409a954e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:45.412328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 976/1960] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:45 2022] PUT /identity/v3/projects/665e61a2714e4eea8f28c291b20d6e8d/users/252275bbfeff48d39711710d44a123b6/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:45.424743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a6087-3dd1-4d76-97b9-2ce13bc11c4e None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.425143 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a6087-3dd1-4d76-97b9-2ce13bc11c4e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.425528 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a6087-3dd1-4d76-97b9-2ce13bc11c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.426829 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:45.471195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-c05a6087-3dd1-4d76-97b9-2ce13bc11c4e None None] MFA Rules not processed for user `252275bbfeff48d39711710d44a123b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:45.472680 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c05a6087-3dd1-4d76-97b9-2ce13bc11c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:45.492670 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5c9d3-9921-4f3d-9873-befb5a215c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:45.494190 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5c9d3-9921-4f3d-9873-befb5a215c4a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.494651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5c9d3-9921-4f3d-9873-befb5a215c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.495239 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5c9d3-9921-4f3d-9873-befb5a215c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.495945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5c9d3-9921-4f3d-9873-befb5a215c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:45.497980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5c9d3-9921-4f3d-9873-befb5a215c4a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:45.542546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 985/1961] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:45 2022] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:15:45.546486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5c9d3-9921-4f3d-9873-befb5a215c4a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:45.566132 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 977/1962] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:45.569919 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a6087-3dd1-4d76-97b9-2ce13bc11c4e None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:45.582184 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a6087-3dd1-4d76-97b9-2ce13bc11c4e None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:45.596527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:45.636145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5c9d3-9921-4f3d-9873-befb5a215c4a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:45.641710 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97f48d-0c3f-48eb-97cb-72b448d101fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:45.642514 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97f48d-0c3f-48eb-97cb-72b448d101fd admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.642793 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97f48d-0c3f-48eb-97cb-72b448d101fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.643063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97f48d-0c3f-48eb-97cb-72b448d101fd admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.643882 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97f48d-0c3f-48eb-97cb-72b448d101fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:45.646115 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97f48d-0c3f-48eb-97cb-72b448d101fd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:45.681372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d819e-fef4-428b-8148-898679bee52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:45.682127 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d819e-fef4-428b-8148-898679bee52c admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.682555 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d819e-fef4-428b-8148-898679bee52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.682841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d819e-fef4-428b-8148-898679bee52c admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.683608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d819e-fef4-428b-8148-898679bee52c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:45.686075 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d819e-fef4-428b-8148-898679bee52c admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:45.700429 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 986/1963] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:45 2022] POST /identity/v3/users => generated 283 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:15:45.701991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97f48d-0c3f-48eb-97cb-72b448d101fd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:45.723878 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97f48d-0c3f-48eb-97cb-72b448d101fd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:45.735835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c91932-6679-4c8b-80ae-7d90b0fc6b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:45.738390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c91932-6679-4c8b-80ae-7d90b0fc6b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.738675 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c91932-6679-4c8b-80ae-7d90b0fc6b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.738949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c91932-6679-4c8b-80ae-7d90b0fc6b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.740263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c91932-6679-4c8b-80ae-7d90b0fc6b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:45.742259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c91932-6679-4c8b-80ae-7d90b0fc6b3b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:45.751577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 978/1964] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:45 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:15:45.756841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d819e-fef4-428b-8148-898679bee52c admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:45.762991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 987/1965] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:45.767821 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c91932-6679-4c8b-80ae-7d90b0fc6b3b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:45.790232 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c91932-6679-4c8b-80ae-7d90b0fc6b3b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:45.853618 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d819e-fef4-428b-8148-898679bee52c admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:45.866284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a852c-baee-4be1-9bf9-46543ccfae34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:45.866284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a852c-baee-4be1-9bf9-46543ccfae34 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.866284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a852c-baee-4be1-9bf9-46543ccfae34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.866284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a852c-baee-4be1-9bf9-46543ccfae34 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.866670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a852c-baee-4be1-9bf9-46543ccfae34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:45.866670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a852c-baee-4be1-9bf9-46543ccfae34 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:45.884496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d8631-ac83-4cc6-b380-2921daf119cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:45.885316 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d8631-ac83-4cc6-b380-2921daf119cf admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.885719 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d8631-ac83-4cc6-b380-2921daf119cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.886090 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d8631-ac83-4cc6-b380-2921daf119cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.886951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d8631-ac83-4cc6-b380-2921daf119cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:45.889062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d8631-ac83-4cc6-b380-2921daf119cf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:45.894961 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 979/1966] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:45 2022] POST /identity/v3/users => generated 299 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:15:45.898599 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a852c-baee-4be1-9bf9-46543ccfae34 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:45.903823 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 988/1967] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:45.907635 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d8631-ac83-4cc6-b380-2921daf119cf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:45.910892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a852c-baee-4be1-9bf9-46543ccfae34 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:45.918438 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223402d9-3c29-4325-92d5-59d88da62b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:45.919644 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223402d9-3c29-4325-92d5-59d88da62b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.919794 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d8631-ac83-4cc6-b380-2921daf119cf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:45.920231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223402d9-3c29-4325-92d5-59d88da62b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.921241 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223402d9-3c29-4325-92d5-59d88da62b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.922049 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223402d9-3c29-4325-92d5-59d88da62b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:45.923768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223402d9-3c29-4325-92d5-59d88da62b0c admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:45.929208 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c5c82-81e3-431e-9c4f-229467a5a73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:45.930147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c5c82-81e3-431e-9c4f-229467a5a73b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.930995 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c5c82-81e3-431e-9c4f-229467a5a73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.931326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c5c82-81e3-431e-9c4f-229467a5a73b admin admin] PATH_INFO: `/v3/projects/ef3529f3aba64a31b5a27cd173ea8391/users/1fc3f5775d1a45a480ac90e0e9fdd2ff/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.937353 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 980/1968] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:45.942569 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223402d9-3c29-4325-92d5-59d88da62b0c admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:45.952134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c5c82-81e3-431e-9c4f-229467a5a73b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef3529f3aba64a31b5a27cd173ea8391, user_id=1fc3f5775d1a45a480ac90e0e9fdd2ff, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:45.954366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223402d9-3c29-4325-92d5-59d88da62b0c admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:45.955254 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c5c82-81e3-431e-9c4f-229467a5a73b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:45.959579 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:45.961133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f858ae-302b-49ce-a6c7-eba9734614e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:45.962434 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f858ae-302b-49ce-a6c7-eba9734614e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.962798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f858ae-302b-49ce-a6c7-eba9734614e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.963020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f858ae-302b-49ce-a6c7-eba9734614e7 admin admin] PATH_INFO: `/v3/projects/09299750be834ebaaa3187d353e4e55e/users/98822caa69d342d7b0d1fe3a1d660493/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:45.976094 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 989/1969] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:45 2022] PUT /identity/v3/projects/ef3529f3aba64a31b5a27cd173ea8391/users/1fc3f5775d1a45a480ac90e0e9fdd2ff/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:45.982475 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f858ae-302b-49ce-a6c7-eba9734614e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09299750be834ebaaa3187d353e4e55e, user_id=98822caa69d342d7b0d1fe3a1d660493, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:45.986674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f858ae-302b-49ce-a6c7-eba9734614e7 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:45.987987 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf1149-9456-402e-9e4f-acbe68027cec None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:45.988276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf1149-9456-402e-9e4f-acbe68027cec None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:45.988727 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf1149-9456-402e-9e4f-acbe68027cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:46.004922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 981/1970] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:45 2022] PUT /identity/v3/projects/09299750be834ebaaa3187d353e4e55e/users/98822caa69d342d7b0d1fe3a1d660493/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:46.012427 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f858ae-302b-49ce-a6c7-eba9734614e7 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:46.025911 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-33cf1149-9456-402e-9e4f-acbe68027cec None None] MFA Rules not processed for user `1fc3f5775d1a45a480ac90e0e9fdd2ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:46.038028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-33cf1149-9456-402e-9e4f-acbe68027cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:46.084521 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:46.091013 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f858ae-302b-49ce-a6c7-eba9734614e7 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:46.098759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449d014-b7f9-46b7-8bde-73a2eeaa044d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:46.099441 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449d014-b7f9-46b7-8bde-73a2eeaa044d admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:46.099730 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449d014-b7f9-46b7-8bde-73a2eeaa044d admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:46.100009 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449d014-b7f9-46b7-8bde-73a2eeaa044d admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:46.100767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449d014-b7f9-46b7-8bde-73a2eeaa044d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:46.103025 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449d014-b7f9-46b7-8bde-73a2eeaa044d admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:46.118817 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 982/1971] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:15:46.118976 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 990/1972] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:46.120045 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449d014-b7f9-46b7-8bde-73a2eeaa044d admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:46.120167 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf1149-9456-402e-9e4f-acbe68027cec None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:46.130547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449d014-b7f9-46b7-8bde-73a2eeaa044d admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:46.130784 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf1149-9456-402e-9e4f-acbe68027cec None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:46.135696 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828b9ba-6e19-44ee-b93b-e45f5628dfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:46.135825 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3f096-5f7e-4c11-9a1f-b665286b86cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:46.136365 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828b9ba-6e19-44ee-b93b-e45f5628dfc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:46.136597 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3f096-5f7e-4c11-9a1f-b665286b86cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:46.136694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828b9ba-6e19-44ee-b93b-e45f5628dfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:46.136877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3f096-5f7e-4c11-9a1f-b665286b86cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:46.136975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828b9ba-6e19-44ee-b93b-e45f5628dfc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:46.137622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3f096-5f7e-4c11-9a1f-b665286b86cb admin admin] PATH_INFO: `/v3/projects/09299750be834ebaaa3187d353e4e55e/users/98822caa69d342d7b0d1fe3a1d660493/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:46.137731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828b9ba-6e19-44ee-b93b-e45f5628dfc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:46.139606 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3f096-5f7e-4c11-9a1f-b665286b86cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=09299750be834ebaaa3187d353e4e55e, user_id=98822caa69d342d7b0d1fe3a1d660493, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:46.139717 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828b9ba-6e19-44ee-b93b-e45f5628dfc5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:46.141948 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3f096-5f7e-4c11-9a1f-b665286b86cb admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:46.152656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 983/1973] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:46 2022] PUT /identity/v3/projects/09299750be834ebaaa3187d353e4e55e/users/98822caa69d342d7b0d1fe3a1d660493/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:46.162883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9ee6f-68d8-4710-8095-82ebfe7d3291 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:46.163176 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9ee6f-68d8-4710-8095-82ebfe7d3291 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:46.163453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9ee6f-68d8-4710-8095-82ebfe7d3291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:46.172096 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 991/1974] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:46 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:15:46.176076 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828b9ba-6e19-44ee-b93b-e45f5628dfc5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:46.198624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-29b9ee6f-68d8-4710-8095-82ebfe7d3291 None None] MFA Rules not processed for user `98822caa69d342d7b0d1fe3a1d660493`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:46.199862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-29b9ee6f-68d8-4710-8095-82ebfe7d3291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:46.252250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828b9ba-6e19-44ee-b93b-e45f5628dfc5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:46.258237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e125f2-d360-4e0d-bb57-5f2741aeb110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:46.258944 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e125f2-d360-4e0d-bb57-5f2741aeb110 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:46.259224 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e125f2-d360-4e0d-bb57-5f2741aeb110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:46.259492 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e125f2-d360-4e0d-bb57-5f2741aeb110 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:46.260185 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e125f2-d360-4e0d-bb57-5f2741aeb110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:46.262111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e125f2-d360-4e0d-bb57-5f2741aeb110 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:46.288884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 984/1975] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:15:46.301261 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9ee6f-68d8-4710-8095-82ebfe7d3291 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:46.302601 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 992/1976] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:46 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:46.306525 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-29b9ee6f-68d8-4710-8095-82ebfe7d3291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:46.309901 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e125f2-d360-4e0d-bb57-5f2741aeb110 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:46.324855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e125f2-d360-4e0d-bb57-5f2741aeb110 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:46.331386 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce998db-96eb-44c0-ae17-3ba6b902f8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:46.333356 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce998db-96eb-44c0-ae17-3ba6b902f8ec admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:46.333650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce998db-96eb-44c0-ae17-3ba6b902f8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:46.335100 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce998db-96eb-44c0-ae17-3ba6b902f8ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:46.336293 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce998db-96eb-44c0-ae17-3ba6b902f8ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:46.340384 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce998db-96eb-44c0-ae17-3ba6b902f8ec admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:46.357981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 993/1977] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:46.362057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce998db-96eb-44c0-ae17-3ba6b902f8ec admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:46.376002 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce998db-96eb-44c0-ae17-3ba6b902f8ec admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:46.381370 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b9224-8056-472c-ac4d-7ab13e6aae65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:46.382480 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b9224-8056-472c-ac4d-7ab13e6aae65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:46.382878 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b9224-8056-472c-ac4d-7ab13e6aae65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:46.383240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b9224-8056-472c-ac4d-7ab13e6aae65 admin admin] PATH_INFO: `/v3/projects/99fb2295db4249059f88a6c105ebd3ca/users/7d7d509faf084f9d8d5387f2f0248145/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:46.401370 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b9224-8056-472c-ac4d-7ab13e6aae65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fb2295db4249059f88a6c105ebd3ca, user_id=7d7d509faf084f9d8d5387f2f0248145, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:46.404248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b9224-8056-472c-ac4d-7ab13e6aae65 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:46.407992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9ee6f-68d8-4710-8095-82ebfe7d3291 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:46.417959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f59533-1fc6-48f1-914b-3e61ea3db09b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:46.419055 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f59533-1fc6-48f1-914b-3e61ea3db09b service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:46.419352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f59533-1fc6-48f1-914b-3e61ea3db09b service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:46.419631 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f59533-1fc6-48f1-914b-3e61ea3db09b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:46.425911 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 994/1978] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:46 2022] PUT /identity/v3/projects/99fb2295db4249059f88a6c105ebd3ca/users/7d7d509faf084f9d8d5387f2f0248145/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:46.432136 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b9224-8056-472c-ac4d-7ab13e6aae65 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:46.442921 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f59533-1fc6-48f1-914b-3e61ea3db09b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:46.444424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f59533-1fc6-48f1-914b-3e61ea3db09b service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:46.457587 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 985/1979] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:15:46.471905 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:46.557913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b9224-8056-472c-ac4d-7ab13e6aae65 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:46.564702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de56aa-87df-4d91-b27e-66c8799970ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:46.565752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de56aa-87df-4d91-b27e-66c8799970ac admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:46.566164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de56aa-87df-4d91-b27e-66c8799970ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:46.566644 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de56aa-87df-4d91-b27e-66c8799970ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:46.567524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de56aa-87df-4d91-b27e-66c8799970ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:46.569282 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de56aa-87df-4d91-b27e-66c8799970ac admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:46.585668 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 995/1980] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:46.590606 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f59533-1fc6-48f1-914b-3e61ea3db09b service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:46.607017 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f59533-1fc6-48f1-914b-3e61ea3db09b service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:46.615459 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1967b43-0087-496c-813c-78adedee8cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:46.616682 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1967b43-0087-496c-813c-78adedee8cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:46.617183 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1967b43-0087-496c-813c-78adedee8cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:46.617694 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1967b43-0087-496c-813c-78adedee8cb0 admin admin] PATH_INFO: `/v3/projects/99fb2295db4249059f88a6c105ebd3ca/users/7d7d509faf084f9d8d5387f2f0248145/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:46.621440 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1967b43-0087-496c-813c-78adedee8cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fb2295db4249059f88a6c105ebd3ca, user_id=7d7d509faf084f9d8d5387f2f0248145, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:46.627964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1967b43-0087-496c-813c-78adedee8cb0 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:46.647173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 986/1981] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:46 2022] PUT /identity/v3/projects/99fb2295db4249059f88a6c105ebd3ca/users/7d7d509faf084f9d8d5387f2f0248145/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:46.657794 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd3662-d850-44e7-9f3e-9e6b378d15b6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:46.658345 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd3662-d850-44e7-9f3e-9e6b378d15b6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:46.658768 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd3662-d850-44e7-9f3e-9e6b378d15b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:46.727349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-48bd3662-d850-44e7-9f3e-9e6b378d15b6 None None] MFA Rules not processed for user `7d7d509faf084f9d8d5387f2f0248145`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:46.729093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-48bd3662-d850-44e7-9f3e-9e6b378d15b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:46.878431 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 996/1982] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:46 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:46.879650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1967b43-0087-496c-813c-78adedee8cb0 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:46.996847 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1967b43-0087-496c-813c-78adedee8cb0 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:47.010768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05404b-efe8-4284-bb8b-c7fb9041bec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:47.011610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05404b-efe8-4284-bb8b-c7fb9041bec2 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:47.011900 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05404b-efe8-4284-bb8b-c7fb9041bec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:47.012210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05404b-efe8-4284-bb8b-c7fb9041bec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:47.030807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:47.042309 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05404b-efe8-4284-bb8b-c7fb9041bec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:47.043813 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05404b-efe8-4284-bb8b-c7fb9041bec2 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:47.056981 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 987/1983] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:46 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:47.326553 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd3662-d850-44e7-9f3e-9e6b378d15b6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:47.341473 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd3662-d850-44e7-9f3e-9e6b378d15b6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:47.345818 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05779d32-665a-49a3-836b-03e5837c2f35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:47.346297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05779d32-665a-49a3-836b-03e5837c2f35 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:47.347050 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05779d32-665a-49a3-836b-03e5837c2f35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:47.347050 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05779d32-665a-49a3-836b-03e5837c2f35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:47.452061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05779d32-665a-49a3-836b-03e5837c2f35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:47.456840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05779d32-665a-49a3-836b-03e5837c2f35 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:47.491888 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 997/1984] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:47.688040 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05404b-efe8-4284-bb8b-c7fb9041bec2 service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:47.689453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5b05404b-efe8-4284-bb8b-c7fb9041bec2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:47.707892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05404b-efe8-4284-bb8b-c7fb9041bec2 service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:47.716717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b20d47-db1b-4ef3-acfd-9d2db91139bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:47.718784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b20d47-db1b-4ef3-acfd-9d2db91139bb service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:47.718784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b20d47-db1b-4ef3-acfd-9d2db91139bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:47.718784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b20d47-db1b-4ef3-acfd-9d2db91139bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:47.720937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-17b20d47-db1b-4ef3-acfd-9d2db91139bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:47.876333 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b20d47-db1b-4ef3-acfd-9d2db91139bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:47.877993 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b20d47-db1b-4ef3-acfd-9d2db91139bb service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:47.889575 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 988/1985] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:48.929859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05779d32-665a-49a3-836b-03e5837c2f35 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:48.931958 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-05779d32-665a-49a3-836b-03e5837c2f35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:48.973862 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:48.996825 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05779d32-665a-49a3-836b-03e5837c2f35 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:49.002177 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc4c2e-f24f-479f-a520-f4ba60b1f9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:49.003061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc4c2e-f24f-479f-a520-f4ba60b1f9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:49.003345 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc4c2e-f24f-479f-a520-f4ba60b1f9df admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:49.003614 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc4c2e-f24f-479f-a520-f4ba60b1f9df admin admin] PATH_INFO: `/v3/users/691199af3147422b909cf842fe545550` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:49.004829 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc4c2e-f24f-479f-a520-f4ba60b1f9df admin admin] RBAC: Authorizing `identity:delete_user(user_id=691199af3147422b909cf842fe545550)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:49.006970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc4c2e-f24f-479f-a520-f4ba60b1f9df admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:49.065845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-92dc4c2e-f24f-479f-a520-f4ba60b1f9df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '691199af3147422b909cf842fe545550'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:49.066538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-92dc4c2e-f24f-479f-a520-f4ba60b1f9df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '691199af3147422b909cf842fe545550'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:49.067206 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-92dc4c2e-f24f-479f-a520-f4ba60b1f9df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '691199af3147422b909cf842fe545550'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:49.084347 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-92dc4c2e-f24f-479f-a520-f4ba60b1f9df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '691199af3147422b909cf842fe545550'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:49.096391 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-92dc4c2e-f24f-479f-a520-f4ba60b1f9df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '691199af3147422b909cf842fe545550'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:49.114415 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 998/1986] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:48 2022] DELETE /identity/v3/users/691199af3147422b909cf842fe545550 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:49.119803 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51026543-40e4-4b85-8992-270862103279 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:49.120203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51026543-40e4-4b85-8992-270862103279 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:49.120406 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51026543-40e4-4b85-8992-270862103279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:49.141922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-51026543-40e4-4b85-8992-270862103279 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:49.143185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-51026543-40e4-4b85-8992-270862103279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:49.218452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 989/1987] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:49.228775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc4c2e-f24f-479f-a520-f4ba60b1f9df admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:49.230512 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-92dc4c2e-f24f-479f-a520-f4ba60b1f9df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:49.292083 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc4c2e-f24f-479f-a520-f4ba60b1f9df admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:49.295696 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5874f93-f5e5-4e8a-82d0-3f8d7fec2dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:49.296345 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5874f93-f5e5-4e8a-82d0-3f8d7fec2dbc service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:49.296622 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5874f93-f5e5-4e8a-82d0-3f8d7fec2dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:49.296895 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5874f93-f5e5-4e8a-82d0-3f8d7fec2dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:49.307180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5874f93-f5e5-4e8a-82d0-3f8d7fec2dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:49.308618 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5874f93-f5e5-4e8a-82d0-3f8d7fec2dbc service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:49.318759 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 999/1988] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:50.112007 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51026543-40e4-4b85-8992-270862103279 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:50.114622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-51026543-40e4-4b85-8992-270862103279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:50.131105 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51026543-40e4-4b85-8992-270862103279 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:50.156243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd2baf-c131-4482-a543-d64785081994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:50.157711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd2baf-c131-4482-a543-d64785081994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:50.158221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd2baf-c131-4482-a543-d64785081994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:50.158738 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd2baf-c131-4482-a543-d64785081994 admin admin] PATH_INFO: `/v3/projects/1dfddd29b46046388a87f02bcbbecffd` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:50.163424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd2baf-c131-4482-a543-d64785081994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dfddd29b46046388a87f02bcbbecffd)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:50.166498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd2baf-c131-4482-a543-d64785081994 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:50.266601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-82bd2baf-c131-4482-a543-d64785081994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dfddd29b46046388a87f02bcbbecffd', 'request_id': 'req-82bd2baf-c131-4482-a543-d64785081994'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:50.278344 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-82bd2baf-c131-4482-a543-d64785081994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dfddd29b46046388a87f02bcbbecffd', 'request_id': 'req-82bd2baf-c131-4482-a543-d64785081994'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:50.291738 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-82bd2baf-c131-4482-a543-d64785081994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dfddd29b46046388a87f02bcbbecffd', 'request_id': 'req-82bd2baf-c131-4482-a543-d64785081994'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:50.307743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-82bd2baf-c131-4482-a543-d64785081994 admin admin] The token cache is being invalidate because project 1dfddd29b46046388a87f02bcbbecffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:50.308038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-82bd2baf-c131-4482-a543-d64785081994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:50.308710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-82bd2baf-c131-4482-a543-d64785081994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:50.310868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 990/1989] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:50 2022] DELETE /identity/v3/projects/1dfddd29b46046388a87f02bcbbecffd => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:50.316429 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c125e-38df-4e9b-9781-cb4a769c2a00 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:50.317381 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c125e-38df-4e9b-9781-cb4a769c2a00 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:50.317817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c125e-38df-4e9b-9781-cb4a769c2a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:50.341699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-137c125e-38df-4e9b-9781-cb4a769c2a00 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:50.343094 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-137c125e-38df-4e9b-9781-cb4a769c2a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:50.410689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:50.430352 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1000/1990] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:15:50.431618 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aec68-0906-43d8-b9f0-aa8396072464 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:50.431910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aec68-0906-43d8-b9f0-aa8396072464 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:50.432190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aec68-0906-43d8-b9f0-aa8396072464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:50.453720 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-341aec68-0906-43d8-b9f0-aa8396072464 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:50.454982 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-341aec68-0906-43d8-b9f0-aa8396072464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:50.465190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 991/1991] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:15:50.469826 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c125e-38df-4e9b-9781-cb4a769c2a00 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:50.481749 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c125e-38df-4e9b-9781-cb4a769c2a00 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:50.486505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc7d3a-73f0-4366-88ca-2be2913ae73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:50.487311 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc7d3a-73f0-4366-88ca-2be2913ae73a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:50.487667 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc7d3a-73f0-4366-88ca-2be2913ae73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:50.488142 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc7d3a-73f0-4366-88ca-2be2913ae73a admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:50.489080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc7d3a-73f0-4366-88ca-2be2913ae73a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:15:50.489469 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc7d3a-73f0-4366-88ca-2be2913ae73a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:50.491174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc7d3a-73f0-4366-88ca-2be2913ae73a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:50.503315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1001/1992] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:15:50.507778 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341aec68-0906-43d8-b9f0-aa8396072464 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:50.517060 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341aec68-0906-43d8-b9f0-aa8396072464 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:50.521714 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d181f-bb01-48d1-b673-8391c98ca8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:50.522406 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d181f-bb01-48d1-b673-8391c98ca8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:50.522697 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d181f-bb01-48d1-b673-8391c98ca8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:50.523164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d181f-bb01-48d1-b673-8391c98ca8c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:50.523962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d181f-bb01-48d1-b673-8391c98ca8c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:50.526417 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d181f-bb01-48d1-b673-8391c98ca8c1 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:50.535964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:50.556114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 992/1993] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:50 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:15:50.560537 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc7d3a-73f0-4366-88ca-2be2913ae73a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:50.570360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc7d3a-73f0-4366-88ca-2be2913ae73a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:50.640746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930933d-36d2-43a1-8766-a73c141ff08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:50.640746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930933d-36d2-43a1-8766-a73c141ff08f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:50.640746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930933d-36d2-43a1-8766-a73c141ff08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:50.640746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930933d-36d2-43a1-8766-a73c141ff08f admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:50.641259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930933d-36d2-43a1-8766-a73c141ff08f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:50.642913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930933d-36d2-43a1-8766-a73c141ff08f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:50.677571 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1002/1994] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:50 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:15:50.682411 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d181f-bb01-48d1-b673-8391c98ca8c1 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:50.693052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d181f-bb01-48d1-b673-8391c98ca8c1 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:50.698672 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a1244-39c9-4124-9bca-4dc6f97ff165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:50.699340 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a1244-39c9-4124-9bca-4dc6f97ff165 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:50.699624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a1244-39c9-4124-9bca-4dc6f97ff165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:50.699903 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a1244-39c9-4124-9bca-4dc6f97ff165 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:50.700634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a1244-39c9-4124-9bca-4dc6f97ff165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:50.702465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a1244-39c9-4124-9bca-4dc6f97ff165 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:50.717697 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 993/1995] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:50.718507 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930933d-36d2-43a1-8766-a73c141ff08f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:50.729722 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930933d-36d2-43a1-8766-a73c141ff08f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:50.736247 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37333f45-47ba-4b39-9276-77994bccc150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:50.737105 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37333f45-47ba-4b39-9276-77994bccc150 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:50.737545 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37333f45-47ba-4b39-9276-77994bccc150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:50.737819 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37333f45-47ba-4b39-9276-77994bccc150 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:50.738592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37333f45-47ba-4b39-9276-77994bccc150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:50.740285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37333f45-47ba-4b39-9276-77994bccc150 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:50.751472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1003/1996] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:15:50.755829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a1244-39c9-4124-9bca-4dc6f97ff165 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:50.767016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a1244-39c9-4124-9bca-4dc6f97ff165 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:50.771865 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a3ba9-164d-4a45-bdcb-e6302689897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:50.772754 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a3ba9-164d-4a45-bdcb-e6302689897c admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:50.773047 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a3ba9-164d-4a45-bdcb-e6302689897c admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:50.773329 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a3ba9-164d-4a45-bdcb-e6302689897c admin admin] PATH_INFO: `/v3/projects/c97f07c04907452b9be9c779ba8d624d/users/dc07b6bedd6743dbb7e686d64dea87fc/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:50.788802 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a3ba9-164d-4a45-bdcb-e6302689897c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97f07c04907452b9be9c779ba8d624d, user_id=dc07b6bedd6743dbb7e686d64dea87fc, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:50.791503 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a3ba9-164d-4a45-bdcb-e6302689897c admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:50.804408 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 994/1997] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:50 2022] PUT /identity/v3/projects/c97f07c04907452b9be9c779ba8d624d/users/dc07b6bedd6743dbb7e686d64dea87fc/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:50.815341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067edd5-680f-46c3-82f8-8e281202ae24 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:50.815735 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067edd5-680f-46c3-82f8-8e281202ae24 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:50.816058 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067edd5-680f-46c3-82f8-8e281202ae24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:50.845799 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3067edd5-680f-46c3-82f8-8e281202ae24 None None] MFA Rules not processed for user `dc07b6bedd6743dbb7e686d64dea87fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:50.847046 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3067edd5-680f-46c3-82f8-8e281202ae24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:50.929084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1004/1998] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:50.942495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a3ba9-164d-4a45-bdcb-e6302689897c admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:50.944231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-658a3ba9-164d-4a45-bdcb-e6302689897c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:51.002267 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a3ba9-164d-4a45-bdcb-e6302689897c admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:51.005952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a3efc-7bac-43ff-a933-7b70cd509b31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:51.006620 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a3efc-7bac-43ff-a933-7b70cd509b31 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:51.006898 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a3efc-7bac-43ff-a933-7b70cd509b31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:51.007167 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a3efc-7bac-43ff-a933-7b70cd509b31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:51.016169 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a3efc-7bac-43ff-a933-7b70cd509b31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:51.017585 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a3efc-7bac-43ff-a933-7b70cd509b31 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:51.027306 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 995/1999] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:52.183678 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067edd5-680f-46c3-82f8-8e281202ae24 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:52.193612 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067edd5-680f-46c3-82f8-8e281202ae24 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:52.197790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa04697-88b1-4e82-8ac7-a7c7d176f1d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:52.198485 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa04697-88b1-4e82-8ac7-a7c7d176f1d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:52.198765 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa04697-88b1-4e82-8ac7-a7c7d176f1d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:52.199036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa04697-88b1-4e82-8ac7-a7c7d176f1d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:52.200859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6aa04697-88b1-4e82-8ac7-a7c7d176f1d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:52.311052 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:52.316045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa04697-88b1-4e82-8ac7-a7c7d176f1d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:52.317966 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa04697-88b1-4e82-8ac7-a7c7d176f1d7 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:52.327886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1005/2000] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:54.648232 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a3efc-7bac-43ff-a933-7b70cd509b31 service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:54.650993 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-661a3efc-7bac-43ff-a933-7b70cd509b31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:54.779420 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a3efc-7bac-43ff-a933-7b70cd509b31 service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:54.790617 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271ea68-1c03-4472-990a-92ee4aac0170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:54.793415 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271ea68-1c03-4472-990a-92ee4aac0170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:54.794058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271ea68-1c03-4472-990a-92ee4aac0170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:54.796848 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271ea68-1c03-4472-990a-92ee4aac0170 admin admin] PATH_INFO: `/v3/users/1fc3f5775d1a45a480ac90e0e9fdd2ff` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:54.798908 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271ea68-1c03-4472-990a-92ee4aac0170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc3f5775d1a45a480ac90e0e9fdd2ff)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:54.804074 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271ea68-1c03-4472-990a-92ee4aac0170 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:54.909197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7271ea68-1c03-4472-990a-92ee4aac0170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc3f5775d1a45a480ac90e0e9fdd2ff'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:54.911323 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7271ea68-1c03-4472-990a-92ee4aac0170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc3f5775d1a45a480ac90e0e9fdd2ff'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:54.915491 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7271ea68-1c03-4472-990a-92ee4aac0170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc3f5775d1a45a480ac90e0e9fdd2ff'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:54.930817 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:54.941236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7271ea68-1c03-4472-990a-92ee4aac0170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc3f5775d1a45a480ac90e0e9fdd2ff'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:54.976873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7271ea68-1c03-4472-990a-92ee4aac0170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc3f5775d1a45a480ac90e0e9fdd2ff'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:55.013480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 996/2001] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:54 2022] DELETE /identity/v3/users/1fc3f5775d1a45a480ac90e0e9fdd2ff => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:55.018238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a172f2-8412-49c8-aa3a-11768f8a932c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:55.019486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a172f2-8412-49c8-aa3a-11768f8a932c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:55.020031 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a172f2-8412-49c8-aa3a-11768f8a932c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:55.058580 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-85a172f2-8412-49c8-aa3a-11768f8a932c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:55.060282 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-85a172f2-8412-49c8-aa3a-11768f8a932c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:55.156035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1006/2002] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:55.179975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271ea68-1c03-4472-990a-92ee4aac0170 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:55.182495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-7271ea68-1c03-4472-990a-92ee4aac0170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:55.241513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a172f2-8412-49c8-aa3a-11768f8a932c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:55.244124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-85a172f2-8412-49c8-aa3a-11768f8a932c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:55.256794 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a172f2-8412-49c8-aa3a-11768f8a932c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:55.261851 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8d803-8935-4985-b4fb-b950196cf0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:55.262715 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8d803-8935-4985-b4fb-b950196cf0e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:55.262997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8d803-8935-4985-b4fb-b950196cf0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:55.263266 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8d803-8935-4985-b4fb-b950196cf0e1 admin admin] PATH_INFO: `/v3/users/a89bd7ecea394e3a8602ede06fc5318b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:55.264618 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8d803-8935-4985-b4fb-b950196cf0e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a89bd7ecea394e3a8602ede06fc5318b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:55.266571 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8d803-8935-4985-b4fb-b950196cf0e1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:55.278920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271ea68-1c03-4472-990a-92ee4aac0170 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:55.283041 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa5f79-7b23-4686-bacc-ef11ac036088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:55.283804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa5f79-7b23-4686-bacc-ef11ac036088 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:55.284193 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa5f79-7b23-4686-bacc-ef11ac036088 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:55.284585 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa5f79-7b23-4686-bacc-ef11ac036088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:55.298244 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa5f79-7b23-4686-bacc-ef11ac036088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:55.299842 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa5f79-7b23-4686-bacc-ef11ac036088 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:55.313413 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 997/2003] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:15:55.329111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2bd8d803-8935-4985-b4fb-b950196cf0e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a89bd7ecea394e3a8602ede06fc5318b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:55.330056 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2bd8d803-8935-4985-b4fb-b950196cf0e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a89bd7ecea394e3a8602ede06fc5318b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:55.330855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2bd8d803-8935-4985-b4fb-b950196cf0e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a89bd7ecea394e3a8602ede06fc5318b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:55.348332 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2bd8d803-8935-4985-b4fb-b950196cf0e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a89bd7ecea394e3a8602ede06fc5318b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:55.356285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2bd8d803-8935-4985-b4fb-b950196cf0e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a89bd7ecea394e3a8602ede06fc5318b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:55.369125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1007/2004] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:55 2022] DELETE /identity/v3/users/a89bd7ecea394e3a8602ede06fc5318b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:55.373762 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6333f-c435-49d3-a4d9-a43e2489527a None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:55.374105 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6333f-c435-49d3-a4d9-a43e2489527a None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:55.374387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6333f-c435-49d3-a4d9-a43e2489527a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:55.394147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-34e6333f-c435-49d3-a4d9-a43e2489527a None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:55.395361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-34e6333f-c435-49d3-a4d9-a43e2489527a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:55.474513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 998/2005] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:55.487861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8d803-8935-4985-b4fb-b950196cf0e1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:55.490482 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2bd8d803-8935-4985-b4fb-b950196cf0e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:55.543547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6376db-e2b1-4884-9987-446d8241c2c5 None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:55.543724 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6376db-e2b1-4884-9987-446d8241c2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:55.544010 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6376db-e2b1-4884-9987-446d8241c2c5 None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:55.546144 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 999/2006] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 12:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:15:55.584657 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c074b-9df3-4612-9fcd-eea3ea60f08f None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:55.584937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c074b-9df3-4612-9fcd-eea3ea60f08f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:55.585221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c074b-9df3-4612-9fcd-eea3ea60f08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:55.594488 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8d803-8935-4985-b4fb-b950196cf0e1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:55.598734 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d1bf4-d802-4672-a783-d7ac62611544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:55.599393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d1bf4-d802-4672-a783-d7ac62611544 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:55.599680 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d1bf4-d802-4672-a783-d7ac62611544 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:55.599957 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d1bf4-d802-4672-a783-d7ac62611544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:55.616225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d1bf4-d802-4672-a783-d7ac62611544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:55.617965 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d1bf4-d802-4672-a783-d7ac62611544 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:55.618664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-986c074b-9df3-4612-9fcd-eea3ea60f08f None None] MFA Rules not processed for user `40f748b0f6b1433c87012793f0dda307`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:55.620036 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-986c074b-9df3-4612-9fcd-eea3ea60f08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:55.640731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1008/2007] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:55.670795 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d1bf4-d802-4672-a783-d7ac62611544 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:55.672955 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a61d1bf4-d802-4672-a783-d7ac62611544 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:55.716505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d1bf4-d802-4672-a783-d7ac62611544 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:55.740182 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455b93f-4bf4-4834-8f99-45e5b0895a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:55.743920 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455b93f-4bf4-4834-8f99-45e5b0895a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:55.746609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455b93f-4bf4-4834-8f99-45e5b0895a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:55.746987 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455b93f-4bf4-4834-8f99-45e5b0895a37 admin admin] PATH_INFO: `/v3/users/6d58bfe99dfd4c79b7eabae6e1f5c536` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:55.754098 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455b93f-4bf4-4834-8f99-45e5b0895a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d58bfe99dfd4c79b7eabae6e1f5c536)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:55.758272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455b93f-4bf4-4834-8f99-45e5b0895a37 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:55.775515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:55.842565 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1000/2008] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 12:15:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:15:55.854683 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c074b-9df3-4612-9fcd-eea3ea60f08f None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:55.857843 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-986c074b-9df3-4612-9fcd-eea3ea60f08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:55.870169 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a455b93f-4bf4-4834-8f99-45e5b0895a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d58bfe99dfd4c79b7eabae6e1f5c536'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:55.871117 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a455b93f-4bf4-4834-8f99-45e5b0895a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d58bfe99dfd4c79b7eabae6e1f5c536'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:55.872607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a455b93f-4bf4-4834-8f99-45e5b0895a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d58bfe99dfd4c79b7eabae6e1f5c536'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:55.883206 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c074b-9df3-4612-9fcd-eea3ea60f08f None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:55.902163 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a455b93f-4bf4-4834-8f99-45e5b0895a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d58bfe99dfd4c79b7eabae6e1f5c536'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:55.902430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b183c-d9fc-426b-b3ec-2e79e8b9fd04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f748b0f6b1433c87012793f0dda307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:55.902430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b183c-d9fc-426b-b3ec-2e79e8b9fd04 service placement] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:55.902430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b183c-d9fc-426b-b3ec-2e79e8b9fd04 service placement] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:55.908001 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b183c-d9fc-426b-b3ec-2e79e8b9fd04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:55.921579 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-da1b183c-d9fc-426b-b3ec-2e79e8b9fd04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:55.929093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a455b93f-4bf4-4834-8f99-45e5b0895a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d58bfe99dfd4c79b7eabae6e1f5c536'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:55.952258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b183c-d9fc-426b-b3ec-2e79e8b9fd04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:55.956195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b183c-d9fc-426b-b3ec-2e79e8b9fd04 service placement] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:55.957200 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1009/2009] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:55 2022] DELETE /identity/v3/users/6d58bfe99dfd4c79b7eabae6e1f5c536 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:55.977449 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1001/2010] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:15:56.065127 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455b93f-4bf4-4834-8f99-45e5b0895a37 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:56.066684 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a455b93f-4bf4-4834-8f99-45e5b0895a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:56.152893 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455b93f-4bf4-4834-8f99-45e5b0895a37 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:56.159717 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d8723-4ee3-4416-972f-a22a40111d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:56.160723 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d8723-4ee3-4416-972f-a22a40111d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:56.161082 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d8723-4ee3-4416-972f-a22a40111d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:56.161454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d8723-4ee3-4416-972f-a22a40111d7f admin admin] PATH_INFO: `/v3/projects/ef3529f3aba64a31b5a27cd173ea8391` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:56.162831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d8723-4ee3-4416-972f-a22a40111d7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef3529f3aba64a31b5a27cd173ea8391)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:56.165556 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d8723-4ee3-4416-972f-a22a40111d7f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:56.300665 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-555d8723-4ee3-4416-972f-a22a40111d7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef3529f3aba64a31b5a27cd173ea8391', 'request_id': 'req-555d8723-4ee3-4416-972f-a22a40111d7f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.315593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-555d8723-4ee3-4416-972f-a22a40111d7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef3529f3aba64a31b5a27cd173ea8391', 'request_id': 'req-555d8723-4ee3-4416-972f-a22a40111d7f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.335182 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-555d8723-4ee3-4416-972f-a22a40111d7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef3529f3aba64a31b5a27cd173ea8391', 'request_id': 'req-555d8723-4ee3-4416-972f-a22a40111d7f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.355980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-555d8723-4ee3-4416-972f-a22a40111d7f admin admin] The token cache is being invalidate because project ef3529f3aba64a31b5a27cd173ea8391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:56.356947 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-555d8723-4ee3-4416-972f-a22a40111d7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.358104 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-555d8723-4ee3-4416-972f-a22a40111d7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.360408 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1010/2011] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:56 2022] DELETE /identity/v3/projects/ef3529f3aba64a31b5a27cd173ea8391 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:56.364072 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b183c-d9fc-426b-b3ec-2e79e8b9fd04 service placement] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:56.371894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:56.380236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b183c-d9fc-426b-b3ec-2e79e8b9fd04 service placement] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:56.473633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa7df8-6df4-4ed7-abdd-caf4e39b9fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:56.475006 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa7df8-6df4-4ed7-abdd-caf4e39b9fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:56.476298 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa7df8-6df4-4ed7-abdd-caf4e39b9fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:56.476790 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa7df8-6df4-4ed7-abdd-caf4e39b9fc8 admin admin] PATH_INFO: `/v3/users/7d7d509faf084f9d8d5387f2f0248145` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:56.479468 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa7df8-6df4-4ed7-abdd-caf4e39b9fc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d7d509faf084f9d8d5387f2f0248145)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:56.481951 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa7df8-6df4-4ed7-abdd-caf4e39b9fc8 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:56.558670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7aaa7df8-6df4-4ed7-abdd-caf4e39b9fc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d7d509faf084f9d8d5387f2f0248145'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.559639 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7aaa7df8-6df4-4ed7-abdd-caf4e39b9fc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d7d509faf084f9d8d5387f2f0248145'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.560343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7aaa7df8-6df4-4ed7-abdd-caf4e39b9fc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d7d509faf084f9d8d5387f2f0248145'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.566511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d8723-4ee3-4416-972f-a22a40111d7f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:56.569083 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-555d8723-4ee3-4416-972f-a22a40111d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:56.583184 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d8723-4ee3-4416-972f-a22a40111d7f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:56.588434 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7aaa7df8-6df4-4ed7-abdd-caf4e39b9fc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d7d509faf084f9d8d5387f2f0248145'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.596200 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c3ba1-5d7b-4ecb-9d6f-4804be1fd74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:56.597150 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c3ba1-5d7b-4ecb-9d6f-4804be1fd74a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:56.597936 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c3ba1-5d7b-4ecb-9d6f-4804be1fd74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:56.597936 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c3ba1-5d7b-4ecb-9d6f-4804be1fd74a admin admin] PATH_INFO: `/v3/projects/606a645af11d48f7909bb4e61a124939` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:56.599145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c3ba1-5d7b-4ecb-9d6f-4804be1fd74a admin admin] RBAC: Authorizing `identity:delete_project(project_id=606a645af11d48f7909bb4e61a124939)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:56.602672 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c3ba1-5d7b-4ecb-9d6f-4804be1fd74a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:56.620991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:56.634147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7aaa7df8-6df4-4ed7-abdd-caf4e39b9fc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d7d509faf084f9d8d5387f2f0248145'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.661100 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1002/2012] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:56 2022] DELETE /identity/v3/users/7d7d509faf084f9d8d5387f2f0248145 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:56.662114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa7df8-6df4-4ed7-abdd-caf4e39b9fc8 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:56.664213 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-7aaa7df8-6df4-4ed7-abdd-caf4e39b9fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:56.753376 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-336c3ba1-5d7b-4ecb-9d6f-4804be1fd74a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '606a645af11d48f7909bb4e61a124939', 'request_id': 'req-336c3ba1-5d7b-4ecb-9d6f-4804be1fd74a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.762179 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-336c3ba1-5d7b-4ecb-9d6f-4804be1fd74a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '606a645af11d48f7909bb4e61a124939', 'request_id': 'req-336c3ba1-5d7b-4ecb-9d6f-4804be1fd74a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.763966 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa7df8-6df4-4ed7-abdd-caf4e39b9fc8 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:56.773179 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-336c3ba1-5d7b-4ecb-9d6f-4804be1fd74a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '606a645af11d48f7909bb4e61a124939', 'request_id': 'req-336c3ba1-5d7b-4ecb-9d6f-4804be1fd74a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.789476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-336c3ba1-5d7b-4ecb-9d6f-4804be1fd74a admin admin] The token cache is being invalidate because project 606a645af11d48f7909bb4e61a124939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:56.790362 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-336c3ba1-5d7b-4ecb-9d6f-4804be1fd74a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.791027 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-336c3ba1-5d7b-4ecb-9d6f-4804be1fd74a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.793155 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1011/2013] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:56 2022] DELETE /identity/v3/projects/606a645af11d48f7909bb4e61a124939 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:56.797239 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c3ba1-5d7b-4ecb-9d6f-4804be1fd74a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:56.800158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-336c3ba1-5d7b-4ecb-9d6f-4804be1fd74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:56.803291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:56.865523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c09eab-b782-405f-b48d-22bf29683104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:56.866905 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c09eab-b782-405f-b48d-22bf29683104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:56.867481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c09eab-b782-405f-b48d-22bf29683104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:56.868684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c09eab-b782-405f-b48d-22bf29683104 admin admin] PATH_INFO: `/v3/projects/08eeaa8ec30b4f5eb2f8ced0796eec04` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:56.869960 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c09eab-b782-405f-b48d-22bf29683104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08eeaa8ec30b4f5eb2f8ced0796eec04)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:56.871959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c09eab-b782-405f-b48d-22bf29683104 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:56.897502 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c3ba1-5d7b-4ecb-9d6f-4804be1fd74a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:56.902366 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912a639-abae-4c63-835c-854f14cffb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:56.903259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912a639-abae-4c63-835c-854f14cffb6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:56.903680 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912a639-abae-4c63-835c-854f14cffb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:56.903961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912a639-abae-4c63-835c-854f14cffb6c admin admin] PATH_INFO: `/v3/users/252275bbfeff48d39711710d44a123b6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:56.905387 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912a639-abae-4c63-835c-854f14cffb6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=252275bbfeff48d39711710d44a123b6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:56.907431 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912a639-abae-4c63-835c-854f14cffb6c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:56.962649 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-49c09eab-b782-405f-b48d-22bf29683104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08eeaa8ec30b4f5eb2f8ced0796eec04', 'request_id': 'req-49c09eab-b782-405f-b48d-22bf29683104'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.968068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-49c09eab-b782-405f-b48d-22bf29683104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08eeaa8ec30b4f5eb2f8ced0796eec04', 'request_id': 'req-49c09eab-b782-405f-b48d-22bf29683104'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.976973 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-49c09eab-b782-405f-b48d-22bf29683104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08eeaa8ec30b4f5eb2f8ced0796eec04', 'request_id': 'req-49c09eab-b782-405f-b48d-22bf29683104'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.991624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-49c09eab-b782-405f-b48d-22bf29683104 admin admin] The token cache is being invalidate because project 08eeaa8ec30b4f5eb2f8ced0796eec04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:56.991801 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6912a639-abae-4c63-835c-854f14cffb6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252275bbfeff48d39711710d44a123b6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.992355 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-49c09eab-b782-405f-b48d-22bf29683104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.992471 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6912a639-abae-4c63-835c-854f14cffb6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252275bbfeff48d39711710d44a123b6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.993080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6912a639-abae-4c63-835c-854f14cffb6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252275bbfeff48d39711710d44a123b6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.993475 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-49c09eab-b782-405f-b48d-22bf29683104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:56.995689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1003/2014] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:56 2022] DELETE /identity/v3/projects/08eeaa8ec30b4f5eb2f8ced0796eec04 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:57.000731 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6504533-bef0-496c-a3db-3e34e8504d03 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:57.001019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6504533-bef0-496c-a3db-3e34e8504d03 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:57.001438 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6504533-bef0-496c-a3db-3e34e8504d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:57.015388 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6912a639-abae-4c63-835c-854f14cffb6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252275bbfeff48d39711710d44a123b6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:57.021531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-b6504533-bef0-496c-a3db-3e34e8504d03 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:57.023576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b6504533-bef0-496c-a3db-3e34e8504d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:57.034707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6912a639-abae-4c63-835c-854f14cffb6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252275bbfeff48d39711710d44a123b6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:57.050975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1012/2015] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:56 2022] DELETE /identity/v3/users/252275bbfeff48d39711710d44a123b6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:57.070376 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912a639-abae-4c63-835c-854f14cffb6c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:57.073331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6912a639-abae-4c63-835c-854f14cffb6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:57.099274 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:57.111416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1004/2016] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:57.120094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c89138-d29c-47c2-9206-9a4df09e6621 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:57.120814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c89138-d29c-47c2-9206-9a4df09e6621 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:57.121339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c89138-d29c-47c2-9206-9a4df09e6621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:57.146679 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-40c89138-d29c-47c2-9206-9a4df09e6621 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:57.148692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-40c89138-d29c-47c2-9206-9a4df09e6621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:57.192868 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912a639-abae-4c63-835c-854f14cffb6c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:57.198731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46dc21b-02b9-4a45-96da-285b8f3e19c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:57.199843 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dc21b-02b9-4a45-96da-285b8f3e19c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:57.199964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dc21b-02b9-4a45-96da-285b8f3e19c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:57.200147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dc21b-02b9-4a45-96da-285b8f3e19c6 admin admin] PATH_INFO: `/v3/projects/99fb2295db4249059f88a6c105ebd3ca` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:57.201705 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46dc21b-02b9-4a45-96da-285b8f3e19c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99fb2295db4249059f88a6c105ebd3ca)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:57.204282 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46dc21b-02b9-4a45-96da-285b8f3e19c6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:57.229555 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:57.255259 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1005/2017] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:57.260269 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c89138-d29c-47c2-9206-9a4df09e6621 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:57.273140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c89138-d29c-47c2-9206-9a4df09e6621 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:57.296230 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b46dc21b-02b9-4a45-96da-285b8f3e19c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99fb2295db4249059f88a6c105ebd3ca', 'request_id': 'req-b46dc21b-02b9-4a45-96da-285b8f3e19c6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:57.303152 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b46dc21b-02b9-4a45-96da-285b8f3e19c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99fb2295db4249059f88a6c105ebd3ca', 'request_id': 'req-b46dc21b-02b9-4a45-96da-285b8f3e19c6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:57.316393 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b46dc21b-02b9-4a45-96da-285b8f3e19c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99fb2295db4249059f88a6c105ebd3ca', 'request_id': 'req-b46dc21b-02b9-4a45-96da-285b8f3e19c6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:57.340400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b46dc21b-02b9-4a45-96da-285b8f3e19c6 admin admin] The token cache is being invalidate because project 99fb2295db4249059f88a6c105ebd3ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:57.341007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b46dc21b-02b9-4a45-96da-285b8f3e19c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:57.341831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b46dc21b-02b9-4a45-96da-285b8f3e19c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:57.344998 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1013/2018] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:57 2022] DELETE /identity/v3/projects/99fb2295db4249059f88a6c105ebd3ca => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:57.350232 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0a265-6cae-4d17-9ff6-7916b85291fe None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:57.350681 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0a265-6cae-4d17-9ff6-7916b85291fe None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:57.351095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0a265-6cae-4d17-9ff6-7916b85291fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:57.376124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e0e0a265-6cae-4d17-9ff6-7916b85291fe None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:57.377513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e0e0a265-6cae-4d17-9ff6-7916b85291fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:57.392166 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70b23b-5192-4762-bb15-48a1e8fd0c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:57.392848 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70b23b-5192-4762-bb15-48a1e8fd0c91 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:57.393134 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70b23b-5192-4762-bb15-48a1e8fd0c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:57.393414 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70b23b-5192-4762-bb15-48a1e8fd0c91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:57.394218 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70b23b-5192-4762-bb15-48a1e8fd0c91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:15:57.394645 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70b23b-5192-4762-bb15-48a1e8fd0c91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:57.396518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70b23b-5192-4762-bb15-48a1e8fd0c91 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:57.415130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1006/2019] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:15:57.416369 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70b23b-5192-4762-bb15-48a1e8fd0c91 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:57.419203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-1a70b23b-5192-4762-bb15-48a1e8fd0c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:57.435954 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70b23b-5192-4762-bb15-48a1e8fd0c91 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:57.441443 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de87fb-055b-400c-9e7c-1b054ef6c599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:57.442337 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de87fb-055b-400c-9e7c-1b054ef6c599 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:57.442968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de87fb-055b-400c-9e7c-1b054ef6c599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:57.443403 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de87fb-055b-400c-9e7c-1b054ef6c599 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:57.444345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de87fb-055b-400c-9e7c-1b054ef6c599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:57.450154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de87fb-055b-400c-9e7c-1b054ef6c599 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:57.469274 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1014/2020] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:57.476272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c42dd-47ee-40fc-923b-48ec03a4a304 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:57.476272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c42dd-47ee-40fc-923b-48ec03a4a304 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:57.476272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c42dd-47ee-40fc-923b-48ec03a4a304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:57.502412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f23c42dd-47ee-40fc-923b-48ec03a4a304 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:57.503729 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f23c42dd-47ee-40fc-923b-48ec03a4a304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:57.509848 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1007/2021] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:57 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:57.511300 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de87fb-055b-400c-9e7c-1b054ef6c599 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:57.513697 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-40de87fb-055b-400c-9e7c-1b054ef6c599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:57.559529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:57.586350 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1015/2022] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:57.588071 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c42dd-47ee-40fc-923b-48ec03a4a304 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:57.602227 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c42dd-47ee-40fc-923b-48ec03a4a304 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:57.607793 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a489eee-1485-43ef-9d05-f46d5e86457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:57.608462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a489eee-1485-43ef-9d05-f46d5e86457b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:57.608739 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a489eee-1485-43ef-9d05-f46d5e86457b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:57.609007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a489eee-1485-43ef-9d05-f46d5e86457b admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:57.609772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a489eee-1485-43ef-9d05-f46d5e86457b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:57.611803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a489eee-1485-43ef-9d05-f46d5e86457b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:57.619291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de87fb-055b-400c-9e7c-1b054ef6c599 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:57.624859 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6057d-6d35-4978-a356-1c238aa576fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:57.625838 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6057d-6d35-4978-a356-1c238aa576fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:57.626224 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6057d-6d35-4978-a356-1c238aa576fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:57.626480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6057d-6d35-4978-a356-1c238aa576fb admin admin] PATH_INFO: `/v3/projects/665e61a2714e4eea8f28c291b20d6e8d` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:57.627795 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6057d-6d35-4978-a356-1c238aa576fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=665e61a2714e4eea8f28c291b20d6e8d)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:57.629833 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6057d-6d35-4978-a356-1c238aa576fb admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:57.638416 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1016/2023] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:57 2022] POST /identity/v3/users => generated 294 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:57.639477 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a489eee-1485-43ef-9d05-f46d5e86457b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:57.649907 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a489eee-1485-43ef-9d05-f46d5e86457b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:57.659174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd9921-bbf4-47eb-b7b6-e68bbf7fb94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:57.659943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd9921-bbf4-47eb-b7b6-e68bbf7fb94b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:57.660226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd9921-bbf4-47eb-b7b6-e68bbf7fb94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:57.660500 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd9921-bbf4-47eb-b7b6-e68bbf7fb94b admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:57.661584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd9921-bbf4-47eb-b7b6-e68bbf7fb94b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:15:57.661826 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd9921-bbf4-47eb-b7b6-e68bbf7fb94b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:57.663749 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd9921-bbf4-47eb-b7b6-e68bbf7fb94b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:57.680114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1017/2024] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:15:57.680114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd9921-bbf4-47eb-b7b6-e68bbf7fb94b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:57.683689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d3a6057d-6d35-4978-a356-1c238aa576fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665e61a2714e4eea8f28c291b20d6e8d', 'request_id': 'req-d3a6057d-6d35-4978-a356-1c238aa576fb'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:57.688437 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd9921-bbf4-47eb-b7b6-e68bbf7fb94b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:57.693070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d3a6057d-6d35-4978-a356-1c238aa576fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665e61a2714e4eea8f28c291b20d6e8d', 'request_id': 'req-d3a6057d-6d35-4978-a356-1c238aa576fb'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:57.701752 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d3a6057d-6d35-4978-a356-1c238aa576fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665e61a2714e4eea8f28c291b20d6e8d', 'request_id': 'req-d3a6057d-6d35-4978-a356-1c238aa576fb'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:57.713217 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d3a6057d-6d35-4978-a356-1c238aa576fb admin admin] The token cache is being invalidate because project 665e61a2714e4eea8f28c291b20d6e8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:57.713764 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d3a6057d-6d35-4978-a356-1c238aa576fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:57.714325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d3a6057d-6d35-4978-a356-1c238aa576fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:57.716293 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1008/2025] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:57 2022] DELETE /identity/v3/projects/665e61a2714e4eea8f28c291b20d6e8d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:57.716754 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6057d-6d35-4978-a356-1c238aa576fb admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:57.718101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d3a6057d-6d35-4978-a356-1c238aa576fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:57.723138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:57.766673 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ccf9a-7c10-43f6-8d18-08c54fac08c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:57.767437 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ccf9a-7c10-43f6-8d18-08c54fac08c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:57.767791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ccf9a-7c10-43f6-8d18-08c54fac08c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:57.768133 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ccf9a-7c10-43f6-8d18-08c54fac08c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:57.768928 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ccf9a-7c10-43f6-8d18-08c54fac08c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:57.770638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ccf9a-7c10-43f6-8d18-08c54fac08c9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:57.784311 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1018/2026] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:57.784984 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ccf9a-7c10-43f6-8d18-08c54fac08c9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:57.786840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-024ccf9a-7c10-43f6-8d18-08c54fac08c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:57.797152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6057d-6d35-4978-a356-1c238aa576fb admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:57.799718 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ccf9a-7c10-43f6-8d18-08c54fac08c9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:57.801883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39468dc7-2e08-4da4-a404-23c336bed76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:57.802601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39468dc7-2e08-4da4-a404-23c336bed76b admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:57.803018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39468dc7-2e08-4da4-a404-23c336bed76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:57.803324 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39468dc7-2e08-4da4-a404-23c336bed76b admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:57.804019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39468dc7-2e08-4da4-a404-23c336bed76b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:57.805251 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c0fff-3881-45cc-baf0-17d5729c3c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:57.806775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39468dc7-2e08-4da4-a404-23c336bed76b admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:57.806908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c0fff-3881-45cc-baf0-17d5729c3c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:57.807281 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c0fff-3881-45cc-baf0-17d5729c3c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:57.807618 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c0fff-3881-45cc-baf0-17d5729c3c4b admin admin] PATH_INFO: `/v3/users/98822caa69d342d7b0d1fe3a1d660493` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:57.808865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c0fff-3881-45cc-baf0-17d5729c3c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=98822caa69d342d7b0d1fe3a1d660493)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:57.811199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c0fff-3881-45cc-baf0-17d5729c3c4b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:57.838888 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1009/2027] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:57 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:57.842661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39468dc7-2e08-4da4-a404-23c336bed76b admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:57.844763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-39468dc7-2e08-4da4-a404-23c336bed76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:57.864500 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6d0c0fff-3881-45cc-baf0-17d5729c3c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98822caa69d342d7b0d1fe3a1d660493'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:57.865230 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6d0c0fff-3881-45cc-baf0-17d5729c3c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98822caa69d342d7b0d1fe3a1d660493'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:57.865994 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6d0c0fff-3881-45cc-baf0-17d5729c3c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98822caa69d342d7b0d1fe3a1d660493'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:57.880238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6d0c0fff-3881-45cc-baf0-17d5729c3c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98822caa69d342d7b0d1fe3a1d660493'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:57.888770 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6d0c0fff-3881-45cc-baf0-17d5729c3c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98822caa69d342d7b0d1fe3a1d660493'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:57.902746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1019/2028] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:15:57 2022] DELETE /identity/v3/users/98822caa69d342d7b0d1fe3a1d660493 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:57.919206 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c0fff-3881-45cc-baf0-17d5729c3c4b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:57.921067 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6d0c0fff-3881-45cc-baf0-17d5729c3c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:57.929626 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39468dc7-2e08-4da4-a404-23c336bed76b admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:57.963101 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:58.043489 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c0fff-3881-45cc-baf0-17d5729c3c4b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:58.047851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1cef0-e0ec-44ce-a55c-bb9314d79a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:58.048649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fa42d-918a-45c2-90e9-0758deb56981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:58.049128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1cef0-e0ec-44ce-a55c-bb9314d79a36 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:58.049320 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fa42d-918a-45c2-90e9-0758deb56981 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:58.049603 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fa42d-918a-45c2-90e9-0758deb56981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:58.049879 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fa42d-918a-45c2-90e9-0758deb56981 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:58.050213 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1cef0-e0ec-44ce-a55c-bb9314d79a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:58.050612 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fa42d-918a-45c2-90e9-0758deb56981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:58.051763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1cef0-e0ec-44ce-a55c-bb9314d79a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:58.052559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fa42d-918a-45c2-90e9-0758deb56981 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:58.052920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1cef0-e0ec-44ce-a55c-bb9314d79a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:58.054988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1cef0-e0ec-44ce-a55c-bb9314d79a36 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:58.068162 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1010/2029] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:58.073108 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1cef0-e0ec-44ce-a55c-bb9314d79a36 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:58.076047 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-64e1cef0-e0ec-44ce-a55c-bb9314d79a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:58.083149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1020/2030] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:57 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:58.086828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fa42d-918a-45c2-90e9-0758deb56981 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:58.092812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1cef0-e0ec-44ce-a55c-bb9314d79a36 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:58.099568 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33df19-c0ab-4424-840a-2d11aeb2e17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:58.100026 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fa42d-918a-45c2-90e9-0758deb56981 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:58.101507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33df19-c0ab-4424-840a-2d11aeb2e17c admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:58.103607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33df19-c0ab-4424-840a-2d11aeb2e17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:58.104473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33df19-c0ab-4424-840a-2d11aeb2e17c admin admin] PATH_INFO: `/v3/projects/cfcaf6c159ea4fb88789953235ce5f67/users/333371fa736049e3ae21068a6bc6bd6d/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:58.107080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a465f-3846-4f87-aacf-092e51a698c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:58.107785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a465f-3846-4f87-aacf-092e51a698c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:58.108436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a465f-3846-4f87-aacf-092e51a698c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:58.110226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a465f-3846-4f87-aacf-092e51a698c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:58.111094 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a465f-3846-4f87-aacf-092e51a698c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:58.113038 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a465f-3846-4f87-aacf-092e51a698c2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:58.124558 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1021/2031] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:15:58.131416 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a465f-3846-4f87-aacf-092e51a698c2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:58.132913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33df19-c0ab-4424-840a-2d11aeb2e17c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfcaf6c159ea4fb88789953235ce5f67, user_id=333371fa736049e3ae21068a6bc6bd6d, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:58.138020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33df19-c0ab-4424-840a-2d11aeb2e17c admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:58.142775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a465f-3846-4f87-aacf-092e51a698c2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:58.150030 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e06f1-e4d6-4178-9aac-f59592f35f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:58.150874 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e06f1-e4d6-4178-9aac-f59592f35f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:58.151169 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e06f1-e4d6-4178-9aac-f59592f35f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:58.151562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e06f1-e4d6-4178-9aac-f59592f35f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:58.153007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e06f1-e4d6-4178-9aac-f59592f35f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:58.154875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e06f1-e4d6-4178-9aac-f59592f35f79 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:58.160175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1011/2032] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:58 2022] PUT /identity/v3/projects/cfcaf6c159ea4fb88789953235ce5f67/users/333371fa736049e3ae21068a6bc6bd6d/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:58.167810 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fdfb0-d690-4a53-b493-6696a0ad1d7f None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:58.169397 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fdfb0-d690-4a53-b493-6696a0ad1d7f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:58.170396 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1022/2033] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:58.170513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fdfb0-d690-4a53-b493-6696a0ad1d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:58.171402 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e06f1-e4d6-4178-9aac-f59592f35f79 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:58.182740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e06f1-e4d6-4178-9aac-f59592f35f79 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:58.209151 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:58.224989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-680fdfb0-d690-4a53-b493-6696a0ad1d7f None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:58.228072 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-680fdfb0-d690-4a53-b493-6696a0ad1d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:58.278555 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb339260-6919-46f9-a8be-7b298c5e97a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:58.280698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb339260-6919-46f9-a8be-7b298c5e97a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:58.281328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb339260-6919-46f9-a8be-7b298c5e97a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:58.281761 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb339260-6919-46f9-a8be-7b298c5e97a4 admin admin] PATH_INFO: `/v3/projects/69c1ec30c399485e87918d96876f8404/users/0856fbb1b5734bd49cdd559326f53da2/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:58.306423 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb339260-6919-46f9-a8be-7b298c5e97a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c1ec30c399485e87918d96876f8404, user_id=0856fbb1b5734bd49cdd559326f53da2, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:58.309939 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb339260-6919-46f9-a8be-7b298c5e97a4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:58.314241 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1012/2034] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:58.321793 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fdfb0-d690-4a53-b493-6696a0ad1d7f None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:58.324012 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-680fdfb0-d690-4a53-b493-6696a0ad1d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:58.368477 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1023/2035] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:58 2022] PUT /identity/v3/projects/69c1ec30c399485e87918d96876f8404/users/0856fbb1b5734bd49cdd559326f53da2/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:58.371179 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb339260-6919-46f9-a8be-7b298c5e97a4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:58.375715 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fb339260-6919-46f9-a8be-7b298c5e97a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:58.405453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fdfb0-d690-4a53-b493-6696a0ad1d7f None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:58.462035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb339260-6919-46f9-a8be-7b298c5e97a4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:58.476941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ac678-2989-436c-bab2-ac096f0fd67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:58.476941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ac678-2989-436c-bab2-ac096f0fd67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:58.476941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ac678-2989-436c-bab2-ac096f0fd67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:58.476941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ac678-2989-436c-bab2-ac096f0fd67b admin admin] PATH_INFO: `/v3/projects/09299750be834ebaaa3187d353e4e55e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:58.477854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ac678-2989-436c-bab2-ac096f0fd67b admin admin] RBAC: Authorizing `identity:delete_project(project_id=09299750be834ebaaa3187d353e4e55e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:58.477938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d577ad6-3e0b-4f83-906a-1b07383f75ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:58.477938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d577ad6-3e0b-4f83-906a-1b07383f75ac service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:58.477938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d577ad6-3e0b-4f83-906a-1b07383f75ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:58.477938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d577ad6-3e0b-4f83-906a-1b07383f75ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:58.478307 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ac678-2989-436c-bab2-ac096f0fd67b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:58.489104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d577ad6-3e0b-4f83-906a-1b07383f75ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:58.491254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d577ad6-3e0b-4f83-906a-1b07383f75ac service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:58.505014 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:58.506693 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1013/2036] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:15:58.508517 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243931d-4080-4595-971d-3f5d823f301a None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:58.508988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243931d-4080-4595-971d-3f5d823f301a None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:58.509292 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243931d-4080-4595-971d-3f5d823f301a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:58.548588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-a243931d-4080-4595-971d-3f5d823f301a None None] MFA Rules not processed for user `0856fbb1b5734bd49cdd559326f53da2`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:58.550953 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a243931d-4080-4595-971d-3f5d823f301a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:58.557169 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5c4ac678-2989-436c-bab2-ac096f0fd67b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09299750be834ebaaa3187d353e4e55e', 'request_id': 'req-5c4ac678-2989-436c-bab2-ac096f0fd67b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:58.569968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5c4ac678-2989-436c-bab2-ac096f0fd67b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09299750be834ebaaa3187d353e4e55e', 'request_id': 'req-5c4ac678-2989-436c-bab2-ac096f0fd67b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:58.579612 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5c4ac678-2989-436c-bab2-ac096f0fd67b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09299750be834ebaaa3187d353e4e55e', 'request_id': 'req-5c4ac678-2989-436c-bab2-ac096f0fd67b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:58.601217 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5c4ac678-2989-436c-bab2-ac096f0fd67b admin admin] The token cache is being invalidate because project 09299750be834ebaaa3187d353e4e55e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:15:58.601599 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5c4ac678-2989-436c-bab2-ac096f0fd67b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:58.603308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5c4ac678-2989-436c-bab2-ac096f0fd67b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:15:58.612453 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1024/2037] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:15:58 2022] DELETE /identity/v3/projects/09299750be834ebaaa3187d353e4e55e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:58.617060 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79110fb-8a46-4e42-8c1a-493f21d7b423 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:58.617459 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79110fb-8a46-4e42-8c1a-493f21d7b423 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:58.617851 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79110fb-8a46-4e42-8c1a-493f21d7b423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:58.649666 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c79110fb-8a46-4e42-8c1a-493f21d7b423 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:58.651139 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c79110fb-8a46-4e42-8c1a-493f21d7b423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:58.653711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:58.672188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1014/2038] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:58.676220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243931d-4080-4595-971d-3f5d823f301a None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:58.679066 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a243931d-4080-4595-971d-3f5d823f301a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:58.735945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1025/2039] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:15:58.744397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c77d8-52c1-44cc-8a03-23b309015714 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:58.744839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c77d8-52c1-44cc-8a03-23b309015714 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:58.745244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c77d8-52c1-44cc-8a03-23b309015714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:58.776947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243931d-4080-4595-971d-3f5d823f301a None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:58.780756 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-230c77d8-52c1-44cc-8a03-23b309015714 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:58.781985 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-230c77d8-52c1-44cc-8a03-23b309015714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:58.783217 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a84f1c-bb1b-4c79-b9e9-02ec9e12bd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:58.784223 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a84f1c-bb1b-4c79-b9e9-02ec9e12bd5c admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:58.784957 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a84f1c-bb1b-4c79-b9e9-02ec9e12bd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:58.785840 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a84f1c-bb1b-4c79-b9e9-02ec9e12bd5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:58.786543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a84f1c-bb1b-4c79-b9e9-02ec9e12bd5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:58.788884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a84f1c-bb1b-4c79-b9e9-02ec9e12bd5c admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:58.792243 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1026/2040] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:15:58.796443 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c77d8-52c1-44cc-8a03-23b309015714 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:58.806710 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c77d8-52c1-44cc-8a03-23b309015714 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:58.813398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7043110-e93f-4a8c-849c-1fa37a601e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:58.814545 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7043110-e93f-4a8c-849c-1fa37a601e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:58.814838 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7043110-e93f-4a8c-849c-1fa37a601e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:58.815127 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7043110-e93f-4a8c-849c-1fa37a601e96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:58.815853 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7043110-e93f-4a8c-849c-1fa37a601e96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:15:58.816168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7043110-e93f-4a8c-849c-1fa37a601e96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:58.818207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7043110-e93f-4a8c-849c-1fa37a601e96 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:58.832343 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1027/2041] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:15:58.837986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7043110-e93f-4a8c-849c-1fa37a601e96 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:58.851457 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1015/2042] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:58 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:58.854564 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7043110-e93f-4a8c-849c-1fa37a601e96 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:58.855526 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a84f1c-bb1b-4c79-b9e9-02ec9e12bd5c admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:58.940907 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f3ea2-e46d-4c1c-8b74-573afa7dcf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:58.941848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f3ea2-e46d-4c1c-8b74-573afa7dcf10 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:58.942223 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f3ea2-e46d-4c1c-8b74-573afa7dcf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:58.942832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f3ea2-e46d-4c1c-8b74-573afa7dcf10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:58.943531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f3ea2-e46d-4c1c-8b74-573afa7dcf10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:58.945452 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f3ea2-e46d-4c1c-8b74-573afa7dcf10 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:58.964240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a84f1c-bb1b-4c79-b9e9-02ec9e12bd5c admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:58.974527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3ca66-e292-400f-9ed7-d00b1c62668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:58.975670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3ca66-e292-400f-9ed7-d00b1c62668c admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:58.976125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3ca66-e292-400f-9ed7-d00b1c62668c admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:58.976580 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3ca66-e292-400f-9ed7-d00b1c62668c admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:58.977483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3ca66-e292-400f-9ed7-d00b1c62668c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:58.979609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3ca66-e292-400f-9ed7-d00b1c62668c admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:58.980818 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1028/2043] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:58 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:15:58.984713 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f3ea2-e46d-4c1c-8b74-573afa7dcf10 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:58.996148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:59.006200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1016/2044] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:58 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:59.011532 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3ca66-e292-400f-9ed7-d00b1c62668c admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:59.022131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3ca66-e292-400f-9ed7-d00b1c62668c admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:59.076062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f3ea2-e46d-4c1c-8b74-573afa7dcf10 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:59.081679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d7ee6-d959-4252-9309-0500ed63f528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:59.082397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d7ee6-d959-4252-9309-0500ed63f528 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:59.083374 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d7ee6-d959-4252-9309-0500ed63f528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:59.083374 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d7ee6-d959-4252-9309-0500ed63f528 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:59.084020 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d7ee6-d959-4252-9309-0500ed63f528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:59.085681 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d7ee6-d959-4252-9309-0500ed63f528 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:59.099220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc429a3-e58f-48de-8cb2-2c9175ae376a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:59.100061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc429a3-e58f-48de-8cb2-2c9175ae376a admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:59.100533 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc429a3-e58f-48de-8cb2-2c9175ae376a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:59.100871 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc429a3-e58f-48de-8cb2-2c9175ae376a admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:59.101754 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc429a3-e58f-48de-8cb2-2c9175ae376a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:59.103985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc429a3-e58f-48de-8cb2-2c9175ae376a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:59.115851 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1029/2045] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:58 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:15:59.122792 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1017/2046] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:15:59.122792 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc429a3-e58f-48de-8cb2-2c9175ae376a admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:59.124650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d7ee6-d959-4252-9309-0500ed63f528 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:59.136201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc429a3-e58f-48de-8cb2-2c9175ae376a admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:59.140270 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d7ee6-d959-4252-9309-0500ed63f528 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:59.142351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026234b-07c3-44ea-85af-3fa84913bc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:59.143027 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026234b-07c3-44ea-85af-3fa84913bc8e admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:59.143313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026234b-07c3-44ea-85af-3fa84913bc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:59.143602 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026234b-07c3-44ea-85af-3fa84913bc8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:59.144314 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026234b-07c3-44ea-85af-3fa84913bc8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:59.145956 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026234b-07c3-44ea-85af-3fa84913bc8e admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:59.148595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:59.149551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a606b6d-bea1-4057-aa1c-5dcec6f3dac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:59.151172 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a606b6d-bea1-4057-aa1c-5dcec6f3dac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:59.151510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a606b6d-bea1-4057-aa1c-5dcec6f3dac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:59.151951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a606b6d-bea1-4057-aa1c-5dcec6f3dac2 admin admin] PATH_INFO: `/v3/projects/4ebd105d59a54352966e849fc1cd86df/users/b3ba050ad6b348c5818da8e4d2dc69ff/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:59.169178 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1018/2047] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:59.172546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a606b6d-bea1-4057-aa1c-5dcec6f3dac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ebd105d59a54352966e849fc1cd86df, user_id=b3ba050ad6b348c5818da8e4d2dc69ff, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:59.172822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026234b-07c3-44ea-85af-3fa84913bc8e admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:59.175527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a606b6d-bea1-4057-aa1c-5dcec6f3dac2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:59.186317 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026234b-07c3-44ea-85af-3fa84913bc8e admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:59.192990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1030/2048] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:59 2022] PUT /identity/v3/projects/4ebd105d59a54352966e849fc1cd86df/users/b3ba050ad6b348c5818da8e4d2dc69ff/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:15:59.197148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a606b6d-bea1-4057-aa1c-5dcec6f3dac2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:59.269597 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d89f6e-64d0-483d-a75d-5c3714f8a0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:59.270508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d89f6e-64d0-483d-a75d-5c3714f8a0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:59.270983 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d89f6e-64d0-483d-a75d-5c3714f8a0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:59.271559 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d89f6e-64d0-483d-a75d-5c3714f8a0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:59.272554 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d89f6e-64d0-483d-a75d-5c3714f8a0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:59.275806 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d89f6e-64d0-483d-a75d-5c3714f8a0e5 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:59.279712 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a606b6d-bea1-4057-aa1c-5dcec6f3dac2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:59.285941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c781a1-6400-4aee-88df-0d203692aa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:59.286611 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c781a1-6400-4aee-88df-0d203692aa71 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:59.286940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c781a1-6400-4aee-88df-0d203692aa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:59.287234 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c781a1-6400-4aee-88df-0d203692aa71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:59.287994 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c781a1-6400-4aee-88df-0d203692aa71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:59.290700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c781a1-6400-4aee-88df-0d203692aa71 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:59.290873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1019/2049] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:15:59.295300 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d89f6e-64d0-483d-a75d-5c3714f8a0e5 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:59.305765 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1031/2050] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:59.308363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d89f6e-64d0-483d-a75d-5c3714f8a0e5 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:59.310144 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c781a1-6400-4aee-88df-0d203692aa71 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:59.313935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad265a95-0335-40aa-95ef-40d6d4ab8337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:59.314971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad265a95-0335-40aa-95ef-40d6d4ab8337 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:59.315352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad265a95-0335-40aa-95ef-40d6d4ab8337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:59.315727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad265a95-0335-40aa-95ef-40d6d4ab8337 admin admin] PATH_INFO: `/v3/projects/a0122609c9484316a6f6d80cc92831df/users/fb326638fa984bfa81c230e2b22ecb41/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:59.323378 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c781a1-6400-4aee-88df-0d203692aa71 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:59.330582 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25268f0-22a6-4a13-8358-b4066b75ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:59.331476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25268f0-22a6-4a13-8358-b4066b75ed0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:59.331758 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25268f0-22a6-4a13-8358-b4066b75ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:59.332033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25268f0-22a6-4a13-8358-b4066b75ed0b admin admin] PATH_INFO: `/v3/projects/4ebd105d59a54352966e849fc1cd86df/users/b3ba050ad6b348c5818da8e4d2dc69ff/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:59.334322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25268f0-22a6-4a13-8358-b4066b75ed0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ebd105d59a54352966e849fc1cd86df, user_id=b3ba050ad6b348c5818da8e4d2dc69ff, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:59.335165 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad265a95-0335-40aa-95ef-40d6d4ab8337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0122609c9484316a6f6d80cc92831df, user_id=fb326638fa984bfa81c230e2b22ecb41, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:59.338040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25268f0-22a6-4a13-8358-b4066b75ed0b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:59.341604 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad265a95-0335-40aa-95ef-40d6d4ab8337 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:59.351451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1032/2051] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:59 2022] PUT /identity/v3/projects/4ebd105d59a54352966e849fc1cd86df/users/b3ba050ad6b348c5818da8e4d2dc69ff/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:59.362081 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596106e8-d220-482e-870c-b3b52927d29a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:59.362373 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596106e8-d220-482e-870c-b3b52927d29a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:59.362657 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596106e8-d220-482e-870c-b3b52927d29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:59.368008 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1020/2052] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:59 2022] PUT /identity/v3/projects/a0122609c9484316a6f6d80cc92831df/users/fb326638fa984bfa81c230e2b22ecb41/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:59.379315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5d1f0-a390-49af-98bf-d12613631732 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:59.379608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5d1f0-a390-49af-98bf-d12613631732 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:59.379887 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5d1f0-a390-49af-98bf-d12613631732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:59.411538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-c2a5d1f0-a390-49af-98bf-d12613631732 None None] MFA Rules not processed for user `fb326638fa984bfa81c230e2b22ecb41`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:59.412617 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c2a5d1f0-a390-49af-98bf-d12613631732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:59.416333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-596106e8-d220-482e-870c-b3b52927d29a None None] MFA Rules not processed for user `b3ba050ad6b348c5818da8e4d2dc69ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:15:59.417549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-596106e8-d220-482e-870c-b3b52927d29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:59.487326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:59.522213 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1021/2053] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:15:59.526177 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5d1f0-a390-49af-98bf-d12613631732 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:59.554094 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1033/2054] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:15:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:15:59.566639 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596106e8-d220-482e-870c-b3b52927d29a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:59.569364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-596106e8-d220-482e-870c-b3b52927d29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:15:59.625617 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:15:59.635978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5d1f0-a390-49af-98bf-d12613631732 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:59.643586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39b817-684e-4547-91b7-db011b784fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:59.644480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39b817-684e-4547-91b7-db011b784fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:59.645044 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39b817-684e-4547-91b7-db011b784fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:59.645531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39b817-684e-4547-91b7-db011b784fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:59.646289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39b817-684e-4547-91b7-db011b784fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:59.651200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39b817-684e-4547-91b7-db011b784fe4 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:59.665635 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596106e8-d220-482e-870c-b3b52927d29a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:59.672968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e2225-d0be-4645-b384-567c7152aa77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:59.674211 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e2225-d0be-4645-b384-567c7152aa77 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:59.674719 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e2225-d0be-4645-b384-567c7152aa77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:59.675333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e2225-d0be-4645-b384-567c7152aa77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:59.686695 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e2225-d0be-4645-b384-567c7152aa77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:59.688749 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e2225-d0be-4645-b384-567c7152aa77 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:59.694038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1022/2055] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:15:59 2022] POST /identity/v3/projects => generated 389 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:15:59.698667 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39b817-684e-4547-91b7-db011b784fe4 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:59.705633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1034/2056] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:15:59.784805 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39b817-684e-4547-91b7-db011b784fe4 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:59.791223 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9f0ea-e7de-480e-a057-fd2b729ee193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:59.792409 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9f0ea-e7de-480e-a057-fd2b729ee193 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:59.792409 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9f0ea-e7de-480e-a057-fd2b729ee193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:59.792634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9f0ea-e7de-480e-a057-fd2b729ee193 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:59.793447 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9f0ea-e7de-480e-a057-fd2b729ee193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:59.795492 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9f0ea-e7de-480e-a057-fd2b729ee193 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:59.827368 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1023/2057] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:15:59 2022] POST /identity/v3/users => generated 301 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:15:59.833276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e2225-d0be-4645-b384-567c7152aa77 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:59.847727 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e2225-d0be-4645-b384-567c7152aa77 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:59.858822 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb93dc8-e308-49af-9d7d-184d1bfd1c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:59.859599 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb93dc8-e308-49af-9d7d-184d1bfd1c39 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:59.859891 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb93dc8-e308-49af-9d7d-184d1bfd1c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:59.860172 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb93dc8-e308-49af-9d7d-184d1bfd1c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:59.860906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb93dc8-e308-49af-9d7d-184d1bfd1c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:59.862581 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb93dc8-e308-49af-9d7d-184d1bfd1c39 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:59.868787 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9f0ea-e7de-480e-a057-fd2b729ee193 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:59.877010 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1035/2058] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:15:59.880500 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb93dc8-e308-49af-9d7d-184d1bfd1c39 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:15:59.893869 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb93dc8-e308-49af-9d7d-184d1bfd1c39 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:59.899980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ba233-6ab9-4f93-9326-52ba60ab793b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:59.900909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ba233-6ab9-4f93-9326-52ba60ab793b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:59.901197 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ba233-6ab9-4f93-9326-52ba60ab793b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:59.901733 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ba233-6ab9-4f93-9326-52ba60ab793b admin admin] PATH_INFO: `/v3/projects/9e376fd9483247249bc59624c9319e3b/users/8023f4d42b364f258ac42a7a3deaa6de/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:59.925268 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ba233-6ab9-4f93-9326-52ba60ab793b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e376fd9483247249bc59624c9319e3b, user_id=8023f4d42b364f258ac42a7a3deaa6de, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:15:59.943021 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ba233-6ab9-4f93-9326-52ba60ab793b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:15:59.943472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9f0ea-e7de-480e-a057-fd2b729ee193 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:15:59.949293 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7e768-cde5-4ca6-9f18-5de6f67e3ce1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:15:59.949959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7e768-cde5-4ca6-9f18-5de6f67e3ce1 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:15:59.950291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7e768-cde5-4ca6-9f18-5de6f67e3ce1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:15:59.950568 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7e768-cde5-4ca6-9f18-5de6f67e3ce1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:15:59.976045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1036/2059] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:15:59 2022] PUT /identity/v3/projects/9e376fd9483247249bc59624c9319e3b/users/8023f4d42b364f258ac42a7a3deaa6de/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:15:59.976961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ba233-6ab9-4f93-9326-52ba60ab793b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:00.053398 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7e768-cde5-4ca6-9f18-5de6f67e3ce1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:00.056686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7e768-cde5-4ca6-9f18-5de6f67e3ce1 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:00.085640 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1024/2060] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:15:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:00.119044 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ba233-6ab9-4f93-9326-52ba60ab793b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:00.136222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ac163-6f24-46a2-ba3c-b843ac64f8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:00.137097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ac163-6f24-46a2-ba3c-b843ac64f8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:00.137939 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ac163-6f24-46a2-ba3c-b843ac64f8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:00.138637 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ac163-6f24-46a2-ba3c-b843ac64f8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:00.139303 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ac163-6f24-46a2-ba3c-b843ac64f8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:00.142344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ac163-6f24-46a2-ba3c-b843ac64f8c8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:00.172024 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1037/2061] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:00.174290 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7e768-cde5-4ca6-9f18-5de6f67e3ce1 service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:00.208560 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7e768-cde5-4ca6-9f18-5de6f67e3ce1 service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:00.223862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79e30c-a416-40e5-a588-97bf1f7a4b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:00.225991 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79e30c-a416-40e5-a588-97bf1f7a4b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:00.228169 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79e30c-a416-40e5-a588-97bf1f7a4b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:00.229314 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79e30c-a416-40e5-a588-97bf1f7a4b64 admin admin] PATH_INFO: `/v3/projects/9e376fd9483247249bc59624c9319e3b/users/8023f4d42b364f258ac42a7a3deaa6de/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:00.234324 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79e30c-a416-40e5-a588-97bf1f7a4b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e376fd9483247249bc59624c9319e3b, user_id=8023f4d42b364f258ac42a7a3deaa6de, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:00.237919 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79e30c-a416-40e5-a588-97bf1f7a4b64 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:00.298185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1025/2062] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:00 2022] PUT /identity/v3/projects/9e376fd9483247249bc59624c9319e3b/users/8023f4d42b364f258ac42a7a3deaa6de/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:00.299309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf333de-e3b3-4915-a949-fa815c160ba7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:00.299707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf333de-e3b3-4915-a949-fa815c160ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:00.300084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf333de-e3b3-4915-a949-fa815c160ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:00.362063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5bf333de-e3b3-4915-a949-fa815c160ba7 None None] MFA Rules not processed for user `8023f4d42b364f258ac42a7a3deaa6de`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:00.363302 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5bf333de-e3b3-4915-a949-fa815c160ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:00.434596 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:00.495165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1038/2063] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:16:00.509194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79e30c-a416-40e5-a588-97bf1f7a4b64 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:00.529390 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:00.641242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79e30c-a416-40e5-a588-97bf1f7a4b64 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:00.650180 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb192a41-1925-45c6-8ce8-2f985d995bf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:00.650180 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb192a41-1925-45c6-8ce8-2f985d995bf1 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:00.650180 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb192a41-1925-45c6-8ce8-2f985d995bf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:00.650180 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb192a41-1925-45c6-8ce8-2f985d995bf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:00.669796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb192a41-1925-45c6-8ce8-2f985d995bf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:00.671647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb192a41-1925-45c6-8ce8-2f985d995bf1 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:00.685014 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1026/2064] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:00.841730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf333de-e3b3-4915-a949-fa815c160ba7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:00.948186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf333de-e3b3-4915-a949-fa815c160ba7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:00.953285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23aa8c-0906-4d9d-97b1-81ac395eb555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:00.954229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23aa8c-0906-4d9d-97b1-81ac395eb555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:00.954521 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23aa8c-0906-4d9d-97b1-81ac395eb555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:00.954800 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23aa8c-0906-4d9d-97b1-81ac395eb555 admin admin] PATH_INFO: `/v3/users/fb326638fa984bfa81c230e2b22ecb41` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:00.956776 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23aa8c-0906-4d9d-97b1-81ac395eb555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb326638fa984bfa81c230e2b22ecb41)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:00.958834 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23aa8c-0906-4d9d-97b1-81ac395eb555 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:01.014611 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4a23aa8c-0906-4d9d-97b1-81ac395eb555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb326638fa984bfa81c230e2b22ecb41'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:01.015299 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4a23aa8c-0906-4d9d-97b1-81ac395eb555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb326638fa984bfa81c230e2b22ecb41'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:01.015905 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4a23aa8c-0906-4d9d-97b1-81ac395eb555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb326638fa984bfa81c230e2b22ecb41'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:01.031342 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4a23aa8c-0906-4d9d-97b1-81ac395eb555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb326638fa984bfa81c230e2b22ecb41'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:01.041777 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4a23aa8c-0906-4d9d-97b1-81ac395eb555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb326638fa984bfa81c230e2b22ecb41'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:01.054705 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1039/2065] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:00 2022] DELETE /identity/v3/users/fb326638fa984bfa81c230e2b22ecb41 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:01.059946 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46e624-ab1f-4ef8-9cf9-c082df40ff8c None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:01.060970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46e624-ab1f-4ef8-9cf9-c082df40ff8c None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:01.061260 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46e624-ab1f-4ef8-9cf9-c082df40ff8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:01.080234 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-aa46e624-ab1f-4ef8-9cf9-c082df40ff8c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:01.081451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-aa46e624-ab1f-4ef8-9cf9-c082df40ff8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:01.143538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1027/2066] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:16:01.152878 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23aa8c-0906-4d9d-97b1-81ac395eb555 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:01.154355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4a23aa8c-0906-4d9d-97b1-81ac395eb555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:01.217579 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23aa8c-0906-4d9d-97b1-81ac395eb555 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:01.222145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3dabe-1647-4b07-b605-50984ffe140c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:01.222929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3dabe-1647-4b07-b605-50984ffe140c service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:01.223213 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3dabe-1647-4b07-b605-50984ffe140c service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:01.223494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3dabe-1647-4b07-b605-50984ffe140c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:01.231060 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:01.235367 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3dabe-1647-4b07-b605-50984ffe140c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:01.237321 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3dabe-1647-4b07-b605-50984ffe140c service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:01.249405 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1040/2067] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:02.207460 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46e624-ab1f-4ef8-9cf9-c082df40ff8c None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:02.209020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-aa46e624-ab1f-4ef8-9cf9-c082df40ff8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:02.231978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46e624-ab1f-4ef8-9cf9-c082df40ff8c None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:02.258185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded654a-d052-4d39-8319-a3cbeaeb0b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:02.259590 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded654a-d052-4d39-8319-a3cbeaeb0b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:02.262565 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded654a-d052-4d39-8319-a3cbeaeb0b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:02.263769 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded654a-d052-4d39-8319-a3cbeaeb0b2a admin admin] PATH_INFO: `/v3/projects/a0122609c9484316a6f6d80cc92831df` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:02.265221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded654a-d052-4d39-8319-a3cbeaeb0b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0122609c9484316a6f6d80cc92831df)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:02.267849 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded654a-d052-4d39-8319-a3cbeaeb0b2a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:02.344647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4ded654a-d052-4d39-8319-a3cbeaeb0b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0122609c9484316a6f6d80cc92831df', 'request_id': 'req-4ded654a-d052-4d39-8319-a3cbeaeb0b2a'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:02.359946 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4ded654a-d052-4d39-8319-a3cbeaeb0b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0122609c9484316a6f6d80cc92831df', 'request_id': 'req-4ded654a-d052-4d39-8319-a3cbeaeb0b2a'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:02.372634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4ded654a-d052-4d39-8319-a3cbeaeb0b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0122609c9484316a6f6d80cc92831df', 'request_id': 'req-4ded654a-d052-4d39-8319-a3cbeaeb0b2a'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:02.389819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4ded654a-d052-4d39-8319-a3cbeaeb0b2a admin admin] The token cache is being invalidate because project a0122609c9484316a6f6d80cc92831df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:02.390047 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4ded654a-d052-4d39-8319-a3cbeaeb0b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:02.390973 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4ded654a-d052-4d39-8319-a3cbeaeb0b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:02.397068 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3dabe-1647-4b07-b605-50984ffe140c service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:02.398188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1028/2068] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:02 2022] DELETE /identity/v3/projects/a0122609c9484316a6f6d80cc92831df => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:02.409974 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3dabe-1647-4b07-b605-50984ffe140c service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:02.481341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ae716-df82-44ba-9886-035549663572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:02.482242 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ae716-df82-44ba-9886-035549663572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:02.482512 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ae716-df82-44ba-9886-035549663572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:02.482789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ae716-df82-44ba-9886-035549663572 admin admin] PATH_INFO: `/v3/users/8023f4d42b364f258ac42a7a3deaa6de` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:02.483999 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ae716-df82-44ba-9886-035549663572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8023f4d42b364f258ac42a7a3deaa6de)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:02.485954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ae716-df82-44ba-9886-035549663572 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:02.575261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-df4ae716-df82-44ba-9886-035549663572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8023f4d42b364f258ac42a7a3deaa6de'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:02.576434 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-df4ae716-df82-44ba-9886-035549663572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8023f4d42b364f258ac42a7a3deaa6de'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:02.577542 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-df4ae716-df82-44ba-9886-035549663572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8023f4d42b364f258ac42a7a3deaa6de'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:02.596404 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-df4ae716-df82-44ba-9886-035549663572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8023f4d42b364f258ac42a7a3deaa6de'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:02.611492 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-df4ae716-df82-44ba-9886-035549663572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8023f4d42b364f258ac42a7a3deaa6de'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:02.637004 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1041/2069] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:02 2022] DELETE /identity/v3/users/8023f4d42b364f258ac42a7a3deaa6de => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:16:02.682192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded654a-d052-4d39-8319-a3cbeaeb0b2a admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:02.683412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-4ded654a-d052-4d39-8319-a3cbeaeb0b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:02.703203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded654a-d052-4d39-8319-a3cbeaeb0b2a admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:02.768118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:02.815320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74c5fe-c61c-45c6-96bb-509a1f16358e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:02.815320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74c5fe-c61c-45c6-96bb-509a1f16358e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:02.815685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74c5fe-c61c-45c6-96bb-509a1f16358e admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:02.817023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74c5fe-c61c-45c6-96bb-509a1f16358e admin admin] PATH_INFO: `/v3/users/dc07b6bedd6743dbb7e686d64dea87fc` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:02.817974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74c5fe-c61c-45c6-96bb-509a1f16358e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc07b6bedd6743dbb7e686d64dea87fc)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:02.821103 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74c5fe-c61c-45c6-96bb-509a1f16358e admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:02.964113 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-df74c5fe-c61c-45c6-96bb-509a1f16358e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc07b6bedd6743dbb7e686d64dea87fc'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:02.965913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-df74c5fe-c61c-45c6-96bb-509a1f16358e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc07b6bedd6743dbb7e686d64dea87fc'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:02.968663 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-df74c5fe-c61c-45c6-96bb-509a1f16358e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc07b6bedd6743dbb7e686d64dea87fc'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:03.003476 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-df74c5fe-c61c-45c6-96bb-509a1f16358e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc07b6bedd6743dbb7e686d64dea87fc'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:03.019678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-df74c5fe-c61c-45c6-96bb-509a1f16358e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc07b6bedd6743dbb7e686d64dea87fc'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:03.044427 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1029/2070] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:02 2022] DELETE /identity/v3/users/dc07b6bedd6743dbb7e686d64dea87fc => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:03.051084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d1cb6-ab3b-40b3-8c5c-297f092546ad None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:03.052186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d1cb6-ab3b-40b3-8c5c-297f092546ad None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:03.052502 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d1cb6-ab3b-40b3-8c5c-297f092546ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:03.083997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-271d1cb6-ab3b-40b3-8c5c-297f092546ad None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:03.085817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-271d1cb6-ab3b-40b3-8c5c-297f092546ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:03.225115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74c5fe-c61c-45c6-96bb-509a1f16358e admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:03.228006 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-df74c5fe-c61c-45c6-96bb-509a1f16358e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:03.235456 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1042/2071] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:03.255605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d1cb6-ab3b-40b3-8c5c-297f092546ad None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:03.259100 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-271d1cb6-ab3b-40b3-8c5c-297f092546ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:03.294903 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:03.302502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74c5fe-c61c-45c6-96bb-509a1f16358e admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:03.329940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fa151-7136-4f7d-b42d-b0db2c0aa6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:03.339541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fa151-7136-4f7d-b42d-b0db2c0aa6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:03.340380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fa151-7136-4f7d-b42d-b0db2c0aa6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:03.341136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fa151-7136-4f7d-b42d-b0db2c0aa6bb admin admin] PATH_INFO: `/v3/projects/9e376fd9483247249bc59624c9319e3b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:03.346952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0fa151-7136-4f7d-b42d-b0db2c0aa6bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e376fd9483247249bc59624c9319e3b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:03.351983 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0fa151-7136-4f7d-b42d-b0db2c0aa6bb admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:03.400215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d1cb6-ab3b-40b3-8c5c-297f092546ad None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:03.405860 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7299f16-37d6-4139-9d3c-4bb4b5f4a7a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:03.406940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7299f16-37d6-4139-9d3c-4bb4b5f4a7a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:03.407367 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7299f16-37d6-4139-9d3c-4bb4b5f4a7a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:03.408403 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7299f16-37d6-4139-9d3c-4bb4b5f4a7a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:03.426520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7299f16-37d6-4139-9d3c-4bb4b5f4a7a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:03.428488 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7299f16-37d6-4139-9d3c-4bb4b5f4a7a8 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:03.456298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1043/2072] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:03.457445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7299f16-37d6-4139-9d3c-4bb4b5f4a7a8 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:03.458743 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c7299f16-37d6-4139-9d3c-4bb4b5f4a7a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:03.480213 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7299f16-37d6-4139-9d3c-4bb4b5f4a7a8 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:03.503707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6e0fa151-7136-4f7d-b42d-b0db2c0aa6bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e376fd9483247249bc59624c9319e3b', 'request_id': 'req-6e0fa151-7136-4f7d-b42d-b0db2c0aa6bb'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:03.528708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6e0fa151-7136-4f7d-b42d-b0db2c0aa6bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e376fd9483247249bc59624c9319e3b', 'request_id': 'req-6e0fa151-7136-4f7d-b42d-b0db2c0aa6bb'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:03.539758 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6e0fa151-7136-4f7d-b42d-b0db2c0aa6bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e376fd9483247249bc59624c9319e3b', 'request_id': 'req-6e0fa151-7136-4f7d-b42d-b0db2c0aa6bb'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:03.573316 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fbb93-1d85-4d30-b481-cbdb8adbb2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:03.575178 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fbb93-1d85-4d30-b481-cbdb8adbb2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:03.575585 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fbb93-1d85-4d30-b481-cbdb8adbb2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:03.576302 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fbb93-1d85-4d30-b481-cbdb8adbb2fe admin admin] PATH_INFO: `/v3/users/0856fbb1b5734bd49cdd559326f53da2` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:03.577589 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6e0fa151-7136-4f7d-b42d-b0db2c0aa6bb admin admin] The token cache is being invalidate because project 9e376fd9483247249bc59624c9319e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:03.577886 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6e0fa151-7136-4f7d-b42d-b0db2c0aa6bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:03.579496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fbb93-1d85-4d30-b481-cbdb8adbb2fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=0856fbb1b5734bd49cdd559326f53da2)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:03.580576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6e0fa151-7136-4f7d-b42d-b0db2c0aa6bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:03.582902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fbb93-1d85-4d30-b481-cbdb8adbb2fe admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:03.587934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1030/2073] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:03 2022] DELETE /identity/v3/projects/9e376fd9483247249bc59624c9319e3b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:03.593374 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21279d-1926-41d0-bb8f-1416626f51a9 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:03.593663 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21279d-1926-41d0-bb8f-1416626f51a9 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:03.593942 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21279d-1926-41d0-bb8f-1416626f51a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:03.670882 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-9c21279d-1926-41d0-bb8f-1416626f51a9 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:03.674073 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-9c21279d-1926-41d0-bb8f-1416626f51a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:03.674479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c71fbb93-1d85-4d30-b481-cbdb8adbb2fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0856fbb1b5734bd49cdd559326f53da2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:03.676796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c71fbb93-1d85-4d30-b481-cbdb8adbb2fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0856fbb1b5734bd49cdd559326f53da2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:03.678320 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c71fbb93-1d85-4d30-b481-cbdb8adbb2fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0856fbb1b5734bd49cdd559326f53da2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:03.686650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1031/2074] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:03.696776 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337dec2-a816-41dd-9e26-06babf2ef685 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:03.697479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337dec2-a816-41dd-9e26-06babf2ef685 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:03.697951 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337dec2-a816-41dd-9e26-06babf2ef685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:03.719720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c71fbb93-1d85-4d30-b481-cbdb8adbb2fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0856fbb1b5734bd49cdd559326f53da2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:03.736929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c71fbb93-1d85-4d30-b481-cbdb8adbb2fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0856fbb1b5734bd49cdd559326f53da2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:03.747729 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-c337dec2-a816-41dd-9e26-06babf2ef685 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:03.748962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c337dec2-a816-41dd-9e26-06babf2ef685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:03.771437 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1044/2075] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:03 2022] DELETE /identity/v3/users/0856fbb1b5734bd49cdd559326f53da2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:03.776073 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f835baf-ce12-42fc-a670-efc874f4fc99 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:03.776368 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f835baf-ce12-42fc-a670-efc874f4fc99 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:03.776650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f835baf-ce12-42fc-a670-efc874f4fc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:03.782283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1032/2076] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:03.784941 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337dec2-a816-41dd-9e26-06babf2ef685 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:03.810224 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337dec2-a816-41dd-9e26-06babf2ef685 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:03.829746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7f835baf-ce12-42fc-a670-efc874f4fc99 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:03.833290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7f835baf-ce12-42fc-a670-efc874f4fc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:03.893208 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:03.932621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:03.999209 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a471f-21ee-45fd-85f3-36c653d602d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:04.003167 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a471f-21ee-45fd-85f3-36c653d602d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:04.003794 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a471f-21ee-45fd-85f3-36c653d602d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:04.006806 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a471f-21ee-45fd-85f3-36c653d602d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:04.007912 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a471f-21ee-45fd-85f3-36c653d602d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:16:04.009560 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a471f-21ee-45fd-85f3-36c653d602d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:04.013987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a471f-21ee-45fd-85f3-36c653d602d9 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:04.039113 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1045/2077] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:04.053310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1033/2078] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:16:04.059623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f835baf-ce12-42fc-a670-efc874f4fc99 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:04.072856 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a471f-21ee-45fd-85f3-36c653d602d9 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:04.076045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f835baf-ce12-42fc-a670-efc874f4fc99 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:04.076267 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-4d0a471f-21ee-45fd-85f3-36c653d602d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:04.088701 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ac844-a8ed-4c6e-90c9-42256effa103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:04.089795 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ac844-a8ed-4c6e-90c9-42256effa103 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:04.089795 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ac844-a8ed-4c6e-90c9-42256effa103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:04.089990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ac844-a8ed-4c6e-90c9-42256effa103 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:04.091082 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ac844-a8ed-4c6e-90c9-42256effa103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:04.093108 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ac844-a8ed-4c6e-90c9-42256effa103 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:04.186411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1046/2079] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:16:04 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:04.190727 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ac844-a8ed-4c6e-90c9-42256effa103 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:04.192776 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f74ac844-a8ed-4c6e-90c9-42256effa103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:04.248681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a471f-21ee-45fd-85f3-36c653d602d9 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:04.302960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ac844-a8ed-4c6e-90c9-42256effa103 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:04.308505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e587440-b161-455e-bbe1-7b4bfbbfb245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:04.309711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e587440-b161-455e-bbe1-7b4bfbbfb245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:04.310090 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e587440-b161-455e-bbe1-7b4bfbbfb245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:04.310438 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e587440-b161-455e-bbe1-7b4bfbbfb245 admin admin] PATH_INFO: `/v3/projects/c97f07c04907452b9be9c779ba8d624d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:04.312175 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e587440-b161-455e-bbe1-7b4bfbbfb245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c97f07c04907452b9be9c779ba8d624d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:04.314165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e587440-b161-455e-bbe1-7b4bfbbfb245 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:04.338949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27a06e-bc7b-4441-8916-e37864f9540e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:04.339559 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27a06e-bc7b-4441-8916-e37864f9540e service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:04.339842 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27a06e-bc7b-4441-8916-e37864f9540e service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:04.340116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27a06e-bc7b-4441-8916-e37864f9540e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:04.363591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27a06e-bc7b-4441-8916-e37864f9540e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:04.365448 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27a06e-bc7b-4441-8916-e37864f9540e service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:04.384386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1034/2080] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:04.391363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27a06e-bc7b-4441-8916-e37864f9540e service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:04.432081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27a06e-bc7b-4441-8916-e37864f9540e service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:04.443079 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6e587440-b161-455e-bbe1-7b4bfbbfb245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c97f07c04907452b9be9c779ba8d624d', 'request_id': 'req-6e587440-b161-455e-bbe1-7b4bfbbfb245'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:04.456895 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6e587440-b161-455e-bbe1-7b4bfbbfb245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c97f07c04907452b9be9c779ba8d624d', 'request_id': 'req-6e587440-b161-455e-bbe1-7b4bfbbfb245'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:04.467501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6e587440-b161-455e-bbe1-7b4bfbbfb245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c97f07c04907452b9be9c779ba8d624d', 'request_id': 'req-6e587440-b161-455e-bbe1-7b4bfbbfb245'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:04.494422 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6e587440-b161-455e-bbe1-7b4bfbbfb245 admin admin] The token cache is being invalidate because project c97f07c04907452b9be9c779ba8d624d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:04.495001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6e587440-b161-455e-bbe1-7b4bfbbfb245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:04.497929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6e587440-b161-455e-bbe1-7b4bfbbfb245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:04.501979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1047/2081] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:04 2022] DELETE /identity/v3/projects/c97f07c04907452b9be9c779ba8d624d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:04.510334 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dc3ce-154a-4d25-a353-bf7640bd7c45 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:04.510629 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dc3ce-154a-4d25-a353-bf7640bd7c45 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:04.510909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dc3ce-154a-4d25-a353-bf7640bd7c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:04.539013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-933dc3ce-154a-4d25-a353-bf7640bd7c45 None None] MFA Rules not processed for user `376d10540ec44065a7010c87d1c50dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:04.540548 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-933dc3ce-154a-4d25-a353-bf7640bd7c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:04.578092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf8faa-883e-4177-a132-79ef22692442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:04.579241 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf8faa-883e-4177-a132-79ef22692442 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:04.579534 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf8faa-883e-4177-a132-79ef22692442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:04.580103 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf8faa-883e-4177-a132-79ef22692442 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:04.581333 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf8faa-883e-4177-a132-79ef22692442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:04.584757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf8faa-883e-4177-a132-79ef22692442 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:04.606379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:04.629768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1035/2082] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:16:04 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:04.632151 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f61de-5831-47cc-8fd2-c398ae9274b1 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:04.632336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f61de-5831-47cc-8fd2-c398ae9274b1 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:04.632736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f61de-5831-47cc-8fd2-c398ae9274b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:04.640692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1048/2083] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:04.641695 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dc3ce-154a-4d25-a353-bf7640bd7c45 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:04.643059 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-933dc3ce-154a-4d25-a353-bf7640bd7c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:04.661686 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dc3ce-154a-4d25-a353-bf7640bd7c45 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:04.668384 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba41c8-2ea8-4642-880a-a00190638d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:04.669093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba41c8-2ea8-4642-880a-a00190638d8e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:04.669355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba41c8-2ea8-4642-880a-a00190638d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:04.669704 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba41c8-2ea8-4642-880a-a00190638d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:04.670688 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba41c8-2ea8-4642-880a-a00190638d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:04.672564 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba41c8-2ea8-4642-880a-a00190638d8e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:04.676086 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-003f61de-5831-47cc-8fd2-c398ae9274b1 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:04.677345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-003f61de-5831-47cc-8fd2-c398ae9274b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:04.684672 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1049/2084] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:04.689698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba41c8-2ea8-4642-880a-a00190638d8e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:04.701778 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba41c8-2ea8-4642-880a-a00190638d8e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:04.710104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1036/2085] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:04.712286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088433d6-229c-4f44-a853-48b48c4ae07a None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:04.712428 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32094e-20ed-49f9-97a5-9015662e5705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:04.712577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088433d6-229c-4f44-a853-48b48c4ae07a None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:04.712858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088433d6-229c-4f44-a853-48b48c4ae07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:04.713464 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32094e-20ed-49f9-97a5-9015662e5705 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:04.713854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32094e-20ed-49f9-97a5-9015662e5705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:04.714368 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32094e-20ed-49f9-97a5-9015662e5705 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:04.715674 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32094e-20ed-49f9-97a5-9015662e5705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:04.717464 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32094e-20ed-49f9-97a5-9015662e5705 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:04.729650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:04.745689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-088433d6-229c-4f44-a853-48b48c4ae07a None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:04.748411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1050/2086] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:04.754596 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32094e-20ed-49f9-97a5-9015662e5705 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:04.755620 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-088433d6-229c-4f44-a853-48b48c4ae07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:04.766920 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32094e-20ed-49f9-97a5-9015662e5705 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:04.773475 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e013e1-4b56-434b-baeb-f6039b717705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:04.774582 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1037/2087] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:16:04.775866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e013e1-4b56-434b-baeb-f6039b717705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:04.776254 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e013e1-4b56-434b-baeb-f6039b717705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:04.776760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e013e1-4b56-434b-baeb-f6039b717705 admin admin] PATH_INFO: `/v3/projects/2c0804defb8d4d478ab4571026497ab3/users/13f3f76f6ffc42af81873474e649b63e/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:04.778725 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088433d6-229c-4f44-a853-48b48c4ae07a None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:04.794289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088433d6-229c-4f44-a853-48b48c4ae07a None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:04.801017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e013e1-4b56-434b-baeb-f6039b717705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0804defb8d4d478ab4571026497ab3, user_id=13f3f76f6ffc42af81873474e649b63e, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:04.804148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e013e1-4b56-434b-baeb-f6039b717705 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:04.805513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7362992-f635-41f5-90f1-886ab9f6257d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:04.806229 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7362992-f635-41f5-90f1-886ab9f6257d admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:04.806518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7362992-f635-41f5-90f1-886ab9f6257d admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:04.806799 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7362992-f635-41f5-90f1-886ab9f6257d admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:04.807560 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7362992-f635-41f5-90f1-886ab9f6257d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:16:04.807866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7362992-f635-41f5-90f1-886ab9f6257d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:04.809746 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7362992-f635-41f5-90f1-886ab9f6257d admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:04.835207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1051/2088] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:04 2022] PUT /identity/v3/projects/2c0804defb8d4d478ab4571026497ab3/users/13f3f76f6ffc42af81873474e649b63e/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:04.838238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb4c49-df8f-4bdd-aa7e-7c0a398204ad None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:04.838631 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb4c49-df8f-4bdd-aa7e-7c0a398204ad None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:04.839010 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb4c49-df8f-4bdd-aa7e-7c0a398204ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:04.841876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1038/2089] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:16:04.846058 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7362992-f635-41f5-90f1-886ab9f6257d admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:04.857557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7362992-f635-41f5-90f1-886ab9f6257d admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:04.886906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ebcb4c49-df8f-4bdd-aa7e-7c0a398204ad None None] MFA Rules not processed for user `13f3f76f6ffc42af81873474e649b63e`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:04.888798 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ebcb4c49-df8f-4bdd-aa7e-7c0a398204ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:04.954200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbb616-05ee-4963-9d5f-b212b6f65b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:04.955221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbb616-05ee-4963-9d5f-b212b6f65b15 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:04.955745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbb616-05ee-4963-9d5f-b212b6f65b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:04.957077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbb616-05ee-4963-9d5f-b212b6f65b15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:04.958022 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbb616-05ee-4963-9d5f-b212b6f65b15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:04.960852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbb616-05ee-4963-9d5f-b212b6f65b15 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:05.001184 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1039/2090] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:16:04 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:05.005758 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbb616-05ee-4963-9d5f-b212b6f65b15 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:05.006447 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1052/2091] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:05.013947 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb4c49-df8f-4bdd-aa7e-7c0a398204ad None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:05.029272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb4c49-df8f-4bdd-aa7e-7c0a398204ad None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:05.088707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbb616-05ee-4963-9d5f-b212b6f65b15 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:05.095161 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0479ea8-cc72-4cf2-84d4-ed9b6d179b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:05.096074 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0479ea8-cc72-4cf2-84d4-ed9b6d179b6d admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:05.096425 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0479ea8-cc72-4cf2-84d4-ed9b6d179b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:05.096779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0479ea8-cc72-4cf2-84d4-ed9b6d179b6d admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:05.097670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0479ea8-cc72-4cf2-84d4-ed9b6d179b6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:05.101808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0479ea8-cc72-4cf2-84d4-ed9b6d179b6d admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:05.135221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1040/2092] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:16:05 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:16:05.136412 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0479ea8-cc72-4cf2-84d4-ed9b6d179b6d admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:05.149740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0479ea8-cc72-4cf2-84d4-ed9b6d179b6d admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:05.150825 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436ddfd-087c-4b38-8f7b-1e05fade5bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:05.151674 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436ddfd-087c-4b38-8f7b-1e05fade5bee admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:05.151967 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436ddfd-087c-4b38-8f7b-1e05fade5bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:05.152246 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436ddfd-087c-4b38-8f7b-1e05fade5bee admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:05.153158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436ddfd-087c-4b38-8f7b-1e05fade5bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:05.155161 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436ddfd-087c-4b38-8f7b-1e05fade5bee admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:05.156037 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779915d-9f13-4c74-aafa-17875b305c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:05.157023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779915d-9f13-4c74-aafa-17875b305c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:05.157489 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779915d-9f13-4c74-aafa-17875b305c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:05.157969 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779915d-9f13-4c74-aafa-17875b305c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:05.159082 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779915d-9f13-4c74-aafa-17875b305c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:05.161195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779915d-9f13-4c74-aafa-17875b305c98 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:05.175122 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1041/2093] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:05.178949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779915d-9f13-4c74-aafa-17875b305c98 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:05.193011 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1053/2094] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:16:05 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:05.200928 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436ddfd-087c-4b38-8f7b-1e05fade5bee admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:05.203352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779915d-9f13-4c74-aafa-17875b305c98 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:05.240721 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:05.275120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:05.292482 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc7d89-8053-4e34-9da8-6487a33b51c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:05.294335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc7d89-8053-4e34-9da8-6487a33b51c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:05.295022 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc7d89-8053-4e34-9da8-6487a33b51c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:05.295366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc7d89-8053-4e34-9da8-6487a33b51c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:05.296376 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc7d89-8053-4e34-9da8-6487a33b51c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:05.298163 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc7d89-8053-4e34-9da8-6487a33b51c7 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:05.314131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1042/2095] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:05.314131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc7d89-8053-4e34-9da8-6487a33b51c7 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:05.316627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c6fc7d89-8053-4e34-9da8-6487a33b51c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:05.335151 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc7d89-8053-4e34-9da8-6487a33b51c7 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:05.340934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d784c8-d506-4607-9f85-48940b6a2955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:05.341554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436ddfd-087c-4b38-8f7b-1e05fade5bee admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:05.341828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d784c8-d506-4607-9f85-48940b6a2955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:05.342173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d784c8-d506-4607-9f85-48940b6a2955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:05.343087 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d784c8-d506-4607-9f85-48940b6a2955 admin admin] PATH_INFO: `/v3/projects/69c1ec30c399485e87918d96876f8404` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:05.344877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d784c8-d506-4607-9f85-48940b6a2955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69c1ec30c399485e87918d96876f8404)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:05.347082 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d784c8-d506-4607-9f85-48940b6a2955 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:05.351050 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e48c1-85ed-4ac5-9a51-88b8cdb51ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:05.351863 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e48c1-85ed-4ac5-9a51-88b8cdb51ece admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:05.352559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e48c1-85ed-4ac5-9a51-88b8cdb51ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:05.352559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e48c1-85ed-4ac5-9a51-88b8cdb51ece admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:05.353528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e48c1-85ed-4ac5-9a51-88b8cdb51ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:05.356058 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e48c1-85ed-4ac5-9a51-88b8cdb51ece admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:05.393002 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1054/2096] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:16:05 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:05.393002 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e48c1-85ed-4ac5-9a51-88b8cdb51ece admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:05.405587 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e48c1-85ed-4ac5-9a51-88b8cdb51ece admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:05.419294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a7d784c8-d506-4607-9f85-48940b6a2955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69c1ec30c399485e87918d96876f8404', 'request_id': 'req-a7d784c8-d506-4607-9f85-48940b6a2955'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:05.431957 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a7d784c8-d506-4607-9f85-48940b6a2955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69c1ec30c399485e87918d96876f8404', 'request_id': 'req-a7d784c8-d506-4607-9f85-48940b6a2955'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:05.439707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a7d784c8-d506-4607-9f85-48940b6a2955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69c1ec30c399485e87918d96876f8404', 'request_id': 'req-a7d784c8-d506-4607-9f85-48940b6a2955'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:05.457496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a7d784c8-d506-4607-9f85-48940b6a2955 admin admin] The token cache is being invalidate because project 69c1ec30c399485e87918d96876f8404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:05.458110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a7d784c8-d506-4607-9f85-48940b6a2955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:05.459195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a7d784c8-d506-4607-9f85-48940b6a2955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:05.462413 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1043/2097] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:05 2022] DELETE /identity/v3/projects/69c1ec30c399485e87918d96876f8404 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:05.463590 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d784c8-d506-4607-9f85-48940b6a2955 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:05.471743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a7d784c8-d506-4607-9f85-48940b6a2955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:05.477110 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093b896-7dc4-4f53-88ce-72223850107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:05.478081 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093b896-7dc4-4f53-88ce-72223850107f admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:05.478368 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093b896-7dc4-4f53-88ce-72223850107f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:05.478642 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093b896-7dc4-4f53-88ce-72223850107f admin admin] PATH_INFO: `/v3/projects/ec30ba5559944ea5a691f413fc15b753/users/d054836ec0794823aaf005a35e8cae88/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:05.490150 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d784c8-d506-4607-9f85-48940b6a2955 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:05.495751 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093b896-7dc4-4f53-88ce-72223850107f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec30ba5559944ea5a691f413fc15b753, user_id=d054836ec0794823aaf005a35e8cae88, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:05.496796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb3129-5a6e-4264-8f7e-390bfe81790d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:05.497770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb3129-5a6e-4264-8f7e-390bfe81790d admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:05.498274 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb3129-5a6e-4264-8f7e-390bfe81790d admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:05.498544 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093b896-7dc4-4f53-88ce-72223850107f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:05.498733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb3129-5a6e-4264-8f7e-390bfe81790d admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:05.499987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb3129-5a6e-4264-8f7e-390bfe81790d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:05.502566 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb3129-5a6e-4264-8f7e-390bfe81790d admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:05.523027 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1044/2099] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:05.523027 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb3129-5a6e-4264-8f7e-390bfe81790d admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:05.523027 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-eebb3129-5a6e-4264-8f7e-390bfe81790d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:05.523616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1055/2099] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:05 2022] PUT /identity/v3/projects/ec30ba5559944ea5a691f413fc15b753/users/d054836ec0794823aaf005a35e8cae88/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:05.524638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093b896-7dc4-4f53-88ce-72223850107f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:05.531089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb3129-5a6e-4264-8f7e-390bfe81790d admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:05.627400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093b896-7dc4-4f53-88ce-72223850107f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:05.631247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c042574-99d9-4cec-9600-1f581440c853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:05.632371 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c042574-99d9-4cec-9600-1f581440c853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:05.634314 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c042574-99d9-4cec-9600-1f581440c853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:05.634881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c042574-99d9-4cec-9600-1f581440c853 admin admin] PATH_INFO: `/v3/users/b3ba050ad6b348c5818da8e4d2dc69ff` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:05.637013 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c042574-99d9-4cec-9600-1f581440c853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ba050ad6b348c5818da8e4d2dc69ff)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:05.639405 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeced0e-2046-4228-b20b-435bee2eb3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:05.640004 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeced0e-2046-4228-b20b-435bee2eb3cd admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:05.640335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeced0e-2046-4228-b20b-435bee2eb3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:05.640620 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeced0e-2046-4228-b20b-435bee2eb3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:05.641398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeced0e-2046-4228-b20b-435bee2eb3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:05.644224 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeced0e-2046-4228-b20b-435bee2eb3cd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:05.647127 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c042574-99d9-4cec-9600-1f581440c853 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:05.674224 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1056/2100] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:05.677319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ab8e5-af16-4f80-aeec-d99e4d545b32 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:05.677614 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ab8e5-af16-4f80-aeec-d99e4d545b32 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:05.677900 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ab8e5-af16-4f80-aeec-d99e4d545b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:05.723962 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4a9ab8e5-af16-4f80-aeec-d99e4d545b32 None None] MFA Rules not processed for user `d054836ec0794823aaf005a35e8cae88`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:05.725691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4a9ab8e5-af16-4f80-aeec-d99e4d545b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:05.741341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:05.752235 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-5c042574-99d9-4cec-9600-1f581440c853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ba050ad6b348c5818da8e4d2dc69ff'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:05.753110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-5c042574-99d9-4cec-9600-1f581440c853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ba050ad6b348c5818da8e4d2dc69ff'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:05.754085 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-5c042574-99d9-4cec-9600-1f581440c853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ba050ad6b348c5818da8e4d2dc69ff'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:05.769137 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:05.783002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-5c042574-99d9-4cec-9600-1f581440c853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ba050ad6b348c5818da8e4d2dc69ff'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:05.795466 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-5c042574-99d9-4cec-9600-1f581440c853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ba050ad6b348c5818da8e4d2dc69ff'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:05.817806 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1045/2101] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:05 2022] DELETE /identity/v3/users/b3ba050ad6b348c5818da8e4d2dc69ff => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:05.820101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208597e-21c0-46d4-9a67-386ee3f1ffed None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:05.820797 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208597e-21c0-46d4-9a67-386ee3f1ffed None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:05.833423 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208597e-21c0-46d4-9a67-386ee3f1ffed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:05.853579 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1057/2102] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:05.854528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ab8e5-af16-4f80-aeec-d99e4d545b32 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:05.857883 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4a9ab8e5-af16-4f80-aeec-d99e4d545b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:05.877481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-2208597e-21c0-46d4-9a67-386ee3f1ffed None None] MFA Rules not processed for user `333371fa736049e3ae21068a6bc6bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:05.878895 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-2208597e-21c0-46d4-9a67-386ee3f1ffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:05.895760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ab8e5-af16-4f80-aeec-d99e4d545b32 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:06.045417 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1046/2103] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:06.046524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208597e-21c0-46d4-9a67-386ee3f1ffed None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:06.047934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-2208597e-21c0-46d4-9a67-386ee3f1ffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:06.092978 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474b186-40ee-48a9-a4cd-95d15e692f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:06.093888 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474b186-40ee-48a9-a4cd-95d15e692f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:06.094195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474b186-40ee-48a9-a4cd-95d15e692f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:06.094481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474b186-40ee-48a9-a4cd-95d15e692f75 admin admin] PATH_INFO: `/v3/projects/57fe2ec3590e4381a4bb23b74d858f52/users/374a6a4451ba42249799b12b844d0e11/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:06.124697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474b186-40ee-48a9-a4cd-95d15e692f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57fe2ec3590e4381a4bb23b74d858f52, user_id=374a6a4451ba42249799b12b844d0e11, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:06.137504 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474b186-40ee-48a9-a4cd-95d15e692f75 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:06.153529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208597e-21c0-46d4-9a67-386ee3f1ffed None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:06.158745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1058/2104] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:05 2022] PUT /identity/v3/projects/57fe2ec3590e4381a4bb23b74d858f52/users/374a6a4451ba42249799b12b844d0e11/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:06.159747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474b186-40ee-48a9-a4cd-95d15e692f75 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:06.162949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2474b186-40ee-48a9-a4cd-95d15e692f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:06.246734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6183cd-2df9-481d-9687-390a6698c05d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:06.248730 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6183cd-2df9-481d-9687-390a6698c05d service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:06.249013 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6183cd-2df9-481d-9687-390a6698c05d service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:06.249360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6183cd-2df9-481d-9687-390a6698c05d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:06.296963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474b186-40ee-48a9-a4cd-95d15e692f75 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:06.308843 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:06.315605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876af91-65db-4f73-be97-071ae680e29d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:06.316397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876af91-65db-4f73-be97-071ae680e29d service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:06.316757 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876af91-65db-4f73-be97-071ae680e29d service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:06.317193 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876af91-65db-4f73-be97-071ae680e29d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:06.352049 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6183cd-2df9-481d-9687-390a6698c05d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:06.354069 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6183cd-2df9-481d-9687-390a6698c05d service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:06.376279 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1047/2105] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:06.377484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d01ed-1d53-4b45-9355-f48912895c6b None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:06.377787 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d01ed-1d53-4b45-9355-f48912895c6b None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:06.378093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d01ed-1d53-4b45-9355-f48912895c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:06.398072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:06.415694 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-969d01ed-1d53-4b45-9355-f48912895c6b None None] MFA Rules not processed for user `374a6a4451ba42249799b12b844d0e11`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:06.417025 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-969d01ed-1d53-4b45-9355-f48912895c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:06.438649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876af91-65db-4f73-be97-071ae680e29d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:06.440605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876af91-65db-4f73-be97-071ae680e29d service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:06.454723 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1059/2106] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:06.455735 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876af91-65db-4f73-be97-071ae680e29d service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:06.458282 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6876af91-65db-4f73-be97-071ae680e29d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:06.561829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1048/2107] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:06.566934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d01ed-1d53-4b45-9355-f48912895c6b None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:06.576351 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876af91-65db-4f73-be97-071ae680e29d service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:06.584372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d01ed-1d53-4b45-9355-f48912895c6b None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:06.591033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecd849-687c-4ca1-afbc-30c26932c0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:06.591813 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecd849-687c-4ca1-afbc-30c26932c0ce admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:06.592759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecd849-687c-4ca1-afbc-30c26932c0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:06.593231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecd849-687c-4ca1-afbc-30c26932c0ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:06.594201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecd849-687c-4ca1-afbc-30c26932c0ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:06.597803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0392f-3a95-4b09-bb42-a3b622002d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:06.598094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecd849-687c-4ca1-afbc-30c26932c0ce admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:06.602100 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0392f-3a95-4b09-bb42-a3b622002d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:06.603244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0392f-3a95-4b09-bb42-a3b622002d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:06.603790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0392f-3a95-4b09-bb42-a3b622002d4e admin admin] PATH_INFO: `/v3/projects/4ebd105d59a54352966e849fc1cd86df` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:06.605631 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0392f-3a95-4b09-bb42-a3b622002d4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ebd105d59a54352966e849fc1cd86df)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:06.622207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0392f-3a95-4b09-bb42-a3b622002d4e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:06.693146 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1049/2108] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:16:06 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:06.694387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecd849-687c-4ca1-afbc-30c26932c0ce admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:06.737829 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-eab0392f-3a95-4b09-bb42-a3b622002d4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ebd105d59a54352966e849fc1cd86df', 'request_id': 'req-eab0392f-3a95-4b09-bb42-a3b622002d4e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:06.757755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-eab0392f-3a95-4b09-bb42-a3b622002d4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ebd105d59a54352966e849fc1cd86df', 'request_id': 'req-eab0392f-3a95-4b09-bb42-a3b622002d4e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:06.766469 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-eab0392f-3a95-4b09-bb42-a3b622002d4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ebd105d59a54352966e849fc1cd86df', 'request_id': 'req-eab0392f-3a95-4b09-bb42-a3b622002d4e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:06.791459 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-eab0392f-3a95-4b09-bb42-a3b622002d4e admin admin] The token cache is being invalidate because project 4ebd105d59a54352966e849fc1cd86df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:06.791759 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-eab0392f-3a95-4b09-bb42-a3b622002d4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:06.794896 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-eab0392f-3a95-4b09-bb42-a3b622002d4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:06.798216 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1060/2109] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:06 2022] DELETE /identity/v3/projects/4ebd105d59a54352966e849fc1cd86df => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:06.806118 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f91b5-a018-47bc-9ef3-45310b028c14 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:06.806416 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f91b5-a018-47bc-9ef3-45310b028c14 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:06.806698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f91b5-a018-47bc-9ef3-45310b028c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:06.831870 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecd849-687c-4ca1-afbc-30c26932c0ce admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:06.887363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-186f91b5-a018-47bc-9ef3-45310b028c14 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:06.890211 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-186f91b5-a018-47bc-9ef3-45310b028c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:06.929951 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:06.982642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6bdb8-a1f7-4406-82e6-6a0b72627e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:06.983347 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6bdb8-a1f7-4406-82e6-6a0b72627e49 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:06.986918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6bdb8-a1f7-4406-82e6-6a0b72627e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:06.987249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6bdb8-a1f7-4406-82e6-6a0b72627e49 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:06.988178 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6bdb8-a1f7-4406-82e6-6a0b72627e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:06.995778 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6bdb8-a1f7-4406-82e6-6a0b72627e49 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:07.047899 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1050/2110] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:16:06 2022] POST /identity/v3/users => generated 295 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:16:07.051779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6bdb8-a1f7-4406-82e6-6a0b72627e49 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:07.056416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6be6bdb8-a1f7-4406-82e6-6a0b72627e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:07.074612 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6bdb8-a1f7-4406-82e6-6a0b72627e49 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:07.077787 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00726cfb-8923-4a14-b7c8-59942eb006d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:07.078497 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00726cfb-8923-4a14-b7c8-59942eb006d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:07.078780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00726cfb-8923-4a14-b7c8-59942eb006d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:07.079057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00726cfb-8923-4a14-b7c8-59942eb006d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:07.079848 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00726cfb-8923-4a14-b7c8-59942eb006d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:07.081461 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00726cfb-8923-4a14-b7c8-59942eb006d4 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:07.093574 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1051/2111] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:07.099625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00726cfb-8923-4a14-b7c8-59942eb006d4 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:07.118818 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00726cfb-8923-4a14-b7c8-59942eb006d4 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:07.134671 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158b9b4-4d63-40e4-bc33-c028be11c0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:07.135586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158b9b4-4d63-40e4-bc33-c028be11c0d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:07.135975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158b9b4-4d63-40e4-bc33-c028be11c0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:07.136157 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158b9b4-4d63-40e4-bc33-c028be11c0d3 admin admin] PATH_INFO: `/v3/projects/c4ca9ae0d78a47fea17221aedcffbfd2/users/780dfac7aa2142568f06a1c004e63061/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:07.138016 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1061/2112] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:07.149750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1301f2-1e28-4bc2-a066-51d2b902d97f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:07.150345 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1301f2-1e28-4bc2-a066-51d2b902d97f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:07.150994 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1301f2-1e28-4bc2-a066-51d2b902d97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:07.168455 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158b9b4-4d63-40e4-bc33-c028be11c0d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ca9ae0d78a47fea17221aedcffbfd2, user_id=780dfac7aa2142568f06a1c004e63061, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:07.174169 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158b9b4-4d63-40e4-bc33-c028be11c0d3 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:07.185575 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:07.192333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0b1301f2-1e28-4bc2-a066-51d2b902d97f None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:07.194468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0b1301f2-1e28-4bc2-a066-51d2b902d97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:07.205389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1052/2113] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:07 2022] PUT /identity/v3/projects/c4ca9ae0d78a47fea17221aedcffbfd2/users/780dfac7aa2142568f06a1c004e63061/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:07.210775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158b9b4-4d63-40e4-bc33-c028be11c0d3 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:07.345927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1062/2114] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:07.347159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1301f2-1e28-4bc2-a066-51d2b902d97f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:07.347352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158b9b4-4d63-40e4-bc33-c028be11c0d3 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:07.352638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f423aeb-6a71-4254-90de-a4a14512464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:07.353565 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f423aeb-6a71-4254-90de-a4a14512464b admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:07.353933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f423aeb-6a71-4254-90de-a4a14512464b admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:07.354465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f423aeb-6a71-4254-90de-a4a14512464b admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:07.355535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f423aeb-6a71-4254-90de-a4a14512464b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:07.357551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f423aeb-6a71-4254-90de-a4a14512464b admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:07.373528 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1053/2115] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:16:07.376933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f423aeb-6a71-4254-90de-a4a14512464b admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:07.377636 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1301f2-1e28-4bc2-a066-51d2b902d97f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:07.390172 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a292d1-9cf4-4055-b09d-d88081ccecc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:07.396975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a292d1-9cf4-4055-b09d-d88081ccecc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:07.397334 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a292d1-9cf4-4055-b09d-d88081ccecc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:07.397677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a292d1-9cf4-4055-b09d-d88081ccecc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:07.398547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a292d1-9cf4-4055-b09d-d88081ccecc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:16:07.398929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a292d1-9cf4-4055-b09d-d88081ccecc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:07.401237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a292d1-9cf4-4055-b09d-d88081ccecc8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:07.405878 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f423aeb-6a71-4254-90de-a4a14512464b admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:07.423366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe00248-dab7-45c5-9375-967b86e5da64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:07.424396 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe00248-dab7-45c5-9375-967b86e5da64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:07.424741 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe00248-dab7-45c5-9375-967b86e5da64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:07.425092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe00248-dab7-45c5-9375-967b86e5da64 admin admin] PATH_INFO: `/v3/projects/c4ca9ae0d78a47fea17221aedcffbfd2/users/780dfac7aa2142568f06a1c004e63061/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:07.428849 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe00248-dab7-45c5-9375-967b86e5da64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ca9ae0d78a47fea17221aedcffbfd2, user_id=780dfac7aa2142568f06a1c004e63061, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:07.433134 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe00248-dab7-45c5-9375-967b86e5da64 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:07.441319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1063/2116] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:16:07.443633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a292d1-9cf4-4055-b09d-d88081ccecc8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:07.470273 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1054/2117] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:07 2022] PUT /identity/v3/projects/c4ca9ae0d78a47fea17221aedcffbfd2/users/780dfac7aa2142568f06a1c004e63061/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:07.470742 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a292d1-9cf4-4055-b09d-d88081ccecc8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:07.473026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12224de7-3308-4f17-bf7b-8917d518bc2c None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:07.473317 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12224de7-3308-4f17-bf7b-8917d518bc2c None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:07.473595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12224de7-3308-4f17-bf7b-8917d518bc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:07.548360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-12224de7-3308-4f17-bf7b-8917d518bc2c None None] MFA Rules not processed for user `780dfac7aa2142568f06a1c004e63061`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:07.549552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-12224de7-3308-4f17-bf7b-8917d518bc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:07.604905 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d54f6-e22c-47a4-9aa6-d27dc7b110eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:07.608229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d54f6-e22c-47a4-9aa6-d27dc7b110eb admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:07.608819 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d54f6-e22c-47a4-9aa6-d27dc7b110eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:07.610209 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d54f6-e22c-47a4-9aa6-d27dc7b110eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:07.611511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d54f6-e22c-47a4-9aa6-d27dc7b110eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:07.620312 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d54f6-e22c-47a4-9aa6-d27dc7b110eb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:07.694291 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1064/2118] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:16:07 2022] POST /identity/v3/projects => generated 375 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:07.695548 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d54f6-e22c-47a4-9aa6-d27dc7b110eb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:07.792473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1055/2119] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:07.802363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12224de7-3308-4f17-bf7b-8917d518bc2c None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:07.806101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-12224de7-3308-4f17-bf7b-8917d518bc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:07.843740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:07.883469 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d54f6-e22c-47a4-9aa6-d27dc7b110eb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:07.902638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013b333-66c7-4012-a783-d817875d6b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:07.903372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013b333-66c7-4012-a783-d817875d6b73 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:07.903760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013b333-66c7-4012-a783-d817875d6b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:07.904041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013b333-66c7-4012-a783-d817875d6b73 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:07.904752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013b333-66c7-4012-a783-d817875d6b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:07.906773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013b333-66c7-4012-a783-d817875d6b73 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:07.962272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1065/2120] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:16:07 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:07.965846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013b333-66c7-4012-a783-d817875d6b73 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:07.971804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12224de7-3308-4f17-bf7b-8917d518bc2c None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:08.004682 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013b333-66c7-4012-a783-d817875d6b73 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:08.025840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e162e-cdc4-4c8b-9c64-fbb571246d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:08.026567 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e162e-cdc4-4c8b-9c64-fbb571246d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:08.026845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e162e-cdc4-4c8b-9c64-fbb571246d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:08.027115 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e162e-cdc4-4c8b-9c64-fbb571246d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:08.032439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e162e-cdc4-4c8b-9c64-fbb571246d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:08.034411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e162e-cdc4-4c8b-9c64-fbb571246d2c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:08.039309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:08.067487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1066/2121] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:08.071663 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e162e-cdc4-4c8b-9c64-fbb571246d2c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:08.086726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e162e-cdc4-4c8b-9c64-fbb571246d2c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:08.093238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3658e-6670-4ef1-8ec6-6185e3578dec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:08.094028 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3658e-6670-4ef1-8ec6-6185e3578dec service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:08.094335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3658e-6670-4ef1-8ec6-6185e3578dec service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:08.094598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3658e-6670-4ef1-8ec6-6185e3578dec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:08.100097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379995c3-62d0-46ed-8f88-be6da5403ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:08.101074 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379995c3-62d0-46ed-8f88-be6da5403ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:08.101438 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379995c3-62d0-46ed-8f88-be6da5403ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:08.101758 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379995c3-62d0-46ed-8f88-be6da5403ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:08.103152 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379995c3-62d0-46ed-8f88-be6da5403ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:08.104872 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379995c3-62d0-46ed-8f88-be6da5403ba6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:08.119103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1067/2122] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:16:08.123358 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379995c3-62d0-46ed-8f88-be6da5403ba6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:08.147510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379995c3-62d0-46ed-8f88-be6da5403ba6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:08.160362 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7bc68-f1b5-4054-a63a-05803d053581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:08.162905 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7bc68-f1b5-4054-a63a-05803d053581 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:08.167177 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7bc68-f1b5-4054-a63a-05803d053581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:08.168731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7bc68-f1b5-4054-a63a-05803d053581 admin admin] PATH_INFO: `/v3/projects/b0d7ddc9ed564d13bc6caeba4c79222f/users/9ff9ac0b4b094999909fd8dd0a4acf91/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:08.226119 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7bc68-f1b5-4054-a63a-05803d053581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d7ddc9ed564d13bc6caeba4c79222f, user_id=9ff9ac0b4b094999909fd8dd0a4acf91, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:08.226119 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7bc68-f1b5-4054-a63a-05803d053581 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:08.247976 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3658e-6670-4ef1-8ec6-6185e3578dec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:08.249448 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3658e-6670-4ef1-8ec6-6185e3578dec service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:08.263817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1068/2123] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:08 2022] PUT /identity/v3/projects/b0d7ddc9ed564d13bc6caeba4c79222f/users/9ff9ac0b4b094999909fd8dd0a4acf91/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:08.265899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33362bd1-5639-4ab9-9f81-1258670028ff None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:08.269254 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33362bd1-5639-4ab9-9f81-1258670028ff None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:08.271242 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33362bd1-5639-4ab9-9f81-1258670028ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:08.284205 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1056/2124] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:08.285762 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29db36c-bcfc-4526-9e61-85b749a655fb None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:08.285913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29db36c-bcfc-4526-9e61-85b749a655fb None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:08.286203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29db36c-bcfc-4526-9e61-85b749a655fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:08.329486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-e29db36c-bcfc-4526-9e61-85b749a655fb None None] MFA Rules not processed for user `9ff9ac0b4b094999909fd8dd0a4acf91`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:08.330775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-e29db36c-bcfc-4526-9e61-85b749a655fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:08.347608 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-33362bd1-5639-4ab9-9f81-1258670028ff None None] MFA Rules not processed for user `d054836ec0794823aaf005a35e8cae88`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:08.361186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-33362bd1-5639-4ab9-9f81-1258670028ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:08.477507 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1069/2125] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:08.478576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33362bd1-5639-4ab9-9f81-1258670028ff None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:08.480484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-33362bd1-5639-4ab9-9f81-1258670028ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:08.501142 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1057/2126] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:08.503619 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29db36c-bcfc-4526-9e61-85b749a655fb None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:08.521140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:08.623570 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29db36c-bcfc-4526-9e61-85b749a655fb None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:08.625308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33362bd1-5639-4ab9-9f81-1258670028ff None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:08.635625 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a0d7d-bdd8-4573-b24f-0009b2156390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:08.635959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92abc93-9ac8-46b8-9a41-6473dab1f6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:08.636556 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a0d7d-bdd8-4573-b24f-0009b2156390 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:08.636676 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92abc93-9ac8-46b8-9a41-6473dab1f6a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:08.636965 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92abc93-9ac8-46b8-9a41-6473dab1f6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:08.637253 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92abc93-9ac8-46b8-9a41-6473dab1f6a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:08.637633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a0d7d-bdd8-4573-b24f-0009b2156390 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:08.638202 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92abc93-9ac8-46b8-9a41-6473dab1f6a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:08.639964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92abc93-9ac8-46b8-9a41-6473dab1f6a1 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:08.654291 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a0d7d-bdd8-4573-b24f-0009b2156390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:08.662617 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2b5a0d7d-bdd8-4573-b24f-0009b2156390 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:08.699466 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1058/2127] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:16:08 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:08.703341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92abc93-9ac8-46b8-9a41-6473dab1f6a1 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:08.793925 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a0d7d-bdd8-4573-b24f-0009b2156390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:08.799197 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a0d7d-bdd8-4573-b24f-0009b2156390 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:08.835514 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1070/2128] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:08.863191 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92abc93-9ac8-46b8-9a41-6473dab1f6a1 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:08.870223 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecf4c4-e86c-47ca-89e9-37c581b577d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:08.871227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecf4c4-e86c-47ca-89e9-37c581b577d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:08.871746 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecf4c4-e86c-47ca-89e9-37c581b577d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:08.872253 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecf4c4-e86c-47ca-89e9-37c581b577d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:08.873430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecf4c4-e86c-47ca-89e9-37c581b577d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:08.877267 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecf4c4-e86c-47ca-89e9-37c581b577d5 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:08.910322 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1059/2129] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:16:08 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:08.914395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a0d7d-bdd8-4573-b24f-0009b2156390 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:08.929526 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a0d7d-bdd8-4573-b24f-0009b2156390 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:08.942442 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a50b4b-2ac3-4144-9698-ccee29c9a2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:08.944117 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a50b4b-2ac3-4144-9698-ccee29c9a2af admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:08.946748 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a50b4b-2ac3-4144-9698-ccee29c9a2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:08.947429 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a50b4b-2ac3-4144-9698-ccee29c9a2af admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:08.950247 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a50b4b-2ac3-4144-9698-ccee29c9a2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:08.952980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a50b4b-2ac3-4144-9698-ccee29c9a2af admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:08.994283 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1071/2130] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:08.999325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecf4c4-e86c-47ca-89e9-37c581b577d5 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:09.011696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecf4c4-e86c-47ca-89e9-37c581b577d5 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:09.017200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f018af2-8223-46c3-9bd4-cae89c16f7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:09.018251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f018af2-8223-46c3-9bd4-cae89c16f7da admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:09.018632 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f018af2-8223-46c3-9bd4-cae89c16f7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:09.019006 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f018af2-8223-46c3-9bd4-cae89c16f7da admin admin] PATH_INFO: `/v3/projects/474b44fb6cf444d1a132d5efe715dc47/users/8f2fdff368e5499d9e9ff8c401b54a33/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:09.037342 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f018af2-8223-46c3-9bd4-cae89c16f7da admin admin] RBAC: Authorizing `identity:create_grant(project_id=474b44fb6cf444d1a132d5efe715dc47, user_id=8f2fdff368e5499d9e9ff8c401b54a33, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:09.040882 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f018af2-8223-46c3-9bd4-cae89c16f7da admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:09.063922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1060/2131] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:08 2022] PUT /identity/v3/projects/474b44fb6cf444d1a132d5efe715dc47/users/8f2fdff368e5499d9e9ff8c401b54a33/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:09.068030 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a50b4b-2ac3-4144-9698-ccee29c9a2af admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:09.081415 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a50b4b-2ac3-4144-9698-ccee29c9a2af admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:09.094466 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:09.188763 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224d9f5-1cc4-4a8f-a7a7-26791c57f647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:09.189450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224d9f5-1cc4-4a8f-a7a7-26791c57f647 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:09.189753 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224d9f5-1cc4-4a8f-a7a7-26791c57f647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:09.190035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224d9f5-1cc4-4a8f-a7a7-26791c57f647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:09.190961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224d9f5-1cc4-4a8f-a7a7-26791c57f647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:09.192487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224d9f5-1cc4-4a8f-a7a7-26791c57f647 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:09.211261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1072/2132] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:09.215938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f018af2-8223-46c3-9bd4-cae89c16f7da admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:09.230883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f018af2-8223-46c3-9bd4-cae89c16f7da admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:09.243632 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f51f55-f4ee-4ca6-b15c-e6fa26322378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:09.244986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f51f55-f4ee-4ca6-b15c-e6fa26322378 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:09.245222 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f51f55-f4ee-4ca6-b15c-e6fa26322378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:09.245494 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f51f55-f4ee-4ca6-b15c-e6fa26322378 admin admin] PATH_INFO: `/v3/projects/474b44fb6cf444d1a132d5efe715dc47/users/8f2fdff368e5499d9e9ff8c401b54a33/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:09.248987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f51f55-f4ee-4ca6-b15c-e6fa26322378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=474b44fb6cf444d1a132d5efe715dc47, user_id=8f2fdff368e5499d9e9ff8c401b54a33, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:09.254043 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f51f55-f4ee-4ca6-b15c-e6fa26322378 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:09.274780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1061/2133] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:09 2022] PUT /identity/v3/projects/474b44fb6cf444d1a132d5efe715dc47/users/8f2fdff368e5499d9e9ff8c401b54a33/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:09.285062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac327a5-3e23-4ff8-86da-eb9a2ae5dcd7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:09.285361 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac327a5-3e23-4ff8-86da-eb9a2ae5dcd7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:09.285637 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac327a5-3e23-4ff8-86da-eb9a2ae5dcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:09.342535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3ac327a5-3e23-4ff8-86da-eb9a2ae5dcd7 None None] MFA Rules not processed for user `8f2fdff368e5499d9e9ff8c401b54a33`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:09.343843 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3ac327a5-3e23-4ff8-86da-eb9a2ae5dcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:09.434790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1073/2134] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:09.456053 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f51f55-f4ee-4ca6-b15c-e6fa26322378 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:09.554594 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:09.567254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f51f55-f4ee-4ca6-b15c-e6fa26322378 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:09.601365 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8d7bd-acdc-46e2-9cba-5eb629440f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:09.602750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8d7bd-acdc-46e2-9cba-5eb629440f9c service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:09.603048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8d7bd-acdc-46e2-9cba-5eb629440f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:09.603335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8d7bd-acdc-46e2-9cba-5eb629440f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:09.800560 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8d7bd-acdc-46e2-9cba-5eb629440f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:09.818083 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8d7bd-acdc-46e2-9cba-5eb629440f9c service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:09.839051 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1062/2135] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:09.867185 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de122463-e429-4dc5-927b-9203cfd1e9e7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:09.868200 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de122463-e429-4dc5-927b-9203cfd1e9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:09.869365 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de122463-e429-4dc5-927b-9203cfd1e9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:09.920432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-de122463-e429-4dc5-927b-9203cfd1e9e7 None None] MFA Rules not processed for user `333371fa736049e3ae21068a6bc6bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:09.922951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-de122463-e429-4dc5-927b-9203cfd1e9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:09.997702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1074/2136] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:12.194335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8d7bd-acdc-46e2-9cba-5eb629440f9c service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:12.263539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8d7bd-acdc-46e2-9cba-5eb629440f9c service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:12.277485 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3c95a-36f8-4653-9b1a-49059c3754e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:12.278406 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3c95a-36f8-4653-9b1a-49059c3754e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:12.278691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3c95a-36f8-4653-9b1a-49059c3754e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:12.280159 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3c95a-36f8-4653-9b1a-49059c3754e0 admin admin] PATH_INFO: `/v3/users/13f3f76f6ffc42af81873474e649b63e` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:12.280819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3c95a-36f8-4653-9b1a-49059c3754e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13f3f76f6ffc42af81873474e649b63e)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:12.283000 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3c95a-36f8-4653-9b1a-49059c3754e0 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:12.354346 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a3c3c95a-36f8-4653-9b1a-49059c3754e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13f3f76f6ffc42af81873474e649b63e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:12.354984 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a3c3c95a-36f8-4653-9b1a-49059c3754e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13f3f76f6ffc42af81873474e649b63e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:12.355648 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a3c3c95a-36f8-4653-9b1a-49059c3754e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13f3f76f6ffc42af81873474e649b63e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:12.372796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a3c3c95a-36f8-4653-9b1a-49059c3754e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13f3f76f6ffc42af81873474e649b63e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:12.382870 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a3c3c95a-36f8-4653-9b1a-49059c3754e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13f3f76f6ffc42af81873474e649b63e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:12.401285 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1063/2137] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:12 2022] DELETE /identity/v3/users/13f3f76f6ffc42af81873474e649b63e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:12.402725 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44e59d-8f2e-488a-9eb6-3b818519a600 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:12.403152 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44e59d-8f2e-488a-9eb6-3b818519a600 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:12.403254 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44e59d-8f2e-488a-9eb6-3b818519a600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:12.431188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ba44e59d-8f2e-488a-9eb6-3b818519a600 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:12.432653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ba44e59d-8f2e-488a-9eb6-3b818519a600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:12.480528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:12.507079 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1075/2138] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:12.517562 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3c95a-36f8-4653-9b1a-49059c3754e0 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:12.519321 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a3c3c95a-36f8-4653-9b1a-49059c3754e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:12.547715 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:12.586213 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3c95a-36f8-4653-9b1a-49059c3754e0 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:12.590654 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074316c-4d25-4a6a-ab24-fe4b3b11a559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:12.591335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074316c-4d25-4a6a-ab24-fe4b3b11a559 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:12.591623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074316c-4d25-4a6a-ab24-fe4b3b11a559 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:12.591906 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074316c-4d25-4a6a-ab24-fe4b3b11a559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:12.602124 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074316c-4d25-4a6a-ab24-fe4b3b11a559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:12.603665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074316c-4d25-4a6a-ab24-fe4b3b11a559 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:12.613817 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1064/2139] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:12.793065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44e59d-8f2e-488a-9eb6-3b818519a600 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:12.794574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ba44e59d-8f2e-488a-9eb6-3b818519a600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:12.863782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44e59d-8f2e-488a-9eb6-3b818519a600 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:12.867473 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94696560-2db5-4878-86a3-30889acbbf2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:12.868665 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94696560-2db5-4878-86a3-30889acbbf2a service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:12.868972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94696560-2db5-4878-86a3-30889acbbf2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:12.869207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94696560-2db5-4878-86a3-30889acbbf2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:12.871189 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-94696560-2db5-4878-86a3-30889acbbf2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:12.910989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074316c-4d25-4a6a-ab24-fe4b3b11a559 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:12.912509 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-4074316c-4d25-4a6a-ab24-fe4b3b11a559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:12.929563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074316c-4d25-4a6a-ab24-fe4b3b11a559 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:12.935461 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a85a8-a00a-4dd6-bc82-660939f43a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:12.936314 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a85a8-a00a-4dd6-bc82-660939f43a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:12.936598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a85a8-a00a-4dd6-bc82-660939f43a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:12.937349 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a85a8-a00a-4dd6-bc82-660939f43a59 admin admin] PATH_INFO: `/v3/projects/2c0804defb8d4d478ab4571026497ab3` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:12.938796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a85a8-a00a-4dd6-bc82-660939f43a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c0804defb8d4d478ab4571026497ab3)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:12.940822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a85a8-a00a-4dd6-bc82-660939f43a59 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:12.950910 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94696560-2db5-4878-86a3-30889acbbf2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:12.952237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94696560-2db5-4878-86a3-30889acbbf2a service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:12.964105 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1076/2140] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:13.013003 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c68a85a8-a00a-4dd6-bc82-660939f43a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c0804defb8d4d478ab4571026497ab3', 'request_id': 'req-c68a85a8-a00a-4dd6-bc82-660939f43a59'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.021781 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c68a85a8-a00a-4dd6-bc82-660939f43a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c0804defb8d4d478ab4571026497ab3', 'request_id': 'req-c68a85a8-a00a-4dd6-bc82-660939f43a59'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.029737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c68a85a8-a00a-4dd6-bc82-660939f43a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c0804defb8d4d478ab4571026497ab3', 'request_id': 'req-c68a85a8-a00a-4dd6-bc82-660939f43a59'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.046142 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c68a85a8-a00a-4dd6-bc82-660939f43a59 admin admin] The token cache is being invalidate because project 2c0804defb8d4d478ab4571026497ab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:13.046434 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c68a85a8-a00a-4dd6-bc82-660939f43a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.047547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c68a85a8-a00a-4dd6-bc82-660939f43a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.048858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1065/2141] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:12 2022] DELETE /identity/v3/projects/2c0804defb8d4d478ab4571026497ab3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:16:13.053001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94696560-2db5-4878-86a3-30889acbbf2a service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:13.068342 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94696560-2db5-4878-86a3-30889acbbf2a service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:13.164189 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c3bc7-1da9-4ffa-9de9-da64197e00ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:13.165859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c3bc7-1da9-4ffa-9de9-da64197e00ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:13.166251 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c3bc7-1da9-4ffa-9de9-da64197e00ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:13.166619 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c3bc7-1da9-4ffa-9de9-da64197e00ba admin admin] PATH_INFO: `/v3/users/374a6a4451ba42249799b12b844d0e11` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:13.167968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c3bc7-1da9-4ffa-9de9-da64197e00ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=374a6a4451ba42249799b12b844d0e11)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:13.170698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c3bc7-1da9-4ffa-9de9-da64197e00ba admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:13.217365 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:13.237111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d31c3bc7-1da9-4ffa-9de9-da64197e00ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '374a6a4451ba42249799b12b844d0e11'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.238512 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d31c3bc7-1da9-4ffa-9de9-da64197e00ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '374a6a4451ba42249799b12b844d0e11'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.239285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d31c3bc7-1da9-4ffa-9de9-da64197e00ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '374a6a4451ba42249799b12b844d0e11'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.259427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d31c3bc7-1da9-4ffa-9de9-da64197e00ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '374a6a4451ba42249799b12b844d0e11'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.271419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d31c3bc7-1da9-4ffa-9de9-da64197e00ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '374a6a4451ba42249799b12b844d0e11'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.294626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1077/2142] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:13 2022] DELETE /identity/v3/users/374a6a4451ba42249799b12b844d0e11 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:13.679222 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a85a8-a00a-4dd6-bc82-660939f43a59 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:13.680826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c68a85a8-a00a-4dd6-bc82-660939f43a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:13.696762 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a85a8-a00a-4dd6-bc82-660939f43a59 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:13.756664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e161598-9f28-4225-8703-dba7910f7e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:13.757518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e161598-9f28-4225-8703-dba7910f7e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:13.757803 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e161598-9f28-4225-8703-dba7910f7e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:13.758102 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e161598-9f28-4225-8703-dba7910f7e4c admin admin] PATH_INFO: `/v3/projects/57fe2ec3590e4381a4bb23b74d858f52` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:13.759355 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e161598-9f28-4225-8703-dba7910f7e4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=57fe2ec3590e4381a4bb23b74d858f52)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:13.761251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e161598-9f28-4225-8703-dba7910f7e4c admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:13.810492 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:13.811782 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4e161598-9f28-4225-8703-dba7910f7e4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57fe2ec3590e4381a4bb23b74d858f52', 'request_id': 'req-4e161598-9f28-4225-8703-dba7910f7e4c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.820696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4e161598-9f28-4225-8703-dba7910f7e4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57fe2ec3590e4381a4bb23b74d858f52', 'request_id': 'req-4e161598-9f28-4225-8703-dba7910f7e4c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.827327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4e161598-9f28-4225-8703-dba7910f7e4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57fe2ec3590e4381a4bb23b74d858f52', 'request_id': 'req-4e161598-9f28-4225-8703-dba7910f7e4c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.839663 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4e161598-9f28-4225-8703-dba7910f7e4c admin admin] The token cache is being invalidate because project 57fe2ec3590e4381a4bb23b74d858f52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:13.839955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4e161598-9f28-4225-8703-dba7910f7e4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.840615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4e161598-9f28-4225-8703-dba7910f7e4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.842618 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1066/2143] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:13 2022] DELETE /identity/v3/projects/57fe2ec3590e4381a4bb23b74d858f52 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:13.846526 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c3bc7-1da9-4ffa-9de9-da64197e00ba admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:13.848042 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d31c3bc7-1da9-4ffa-9de9-da64197e00ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:13.860865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c3bc7-1da9-4ffa-9de9-da64197e00ba admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:13.919548 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bb064-9da7-4a6a-a3be-bdc5dc2e802c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:13.920501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bb064-9da7-4a6a-a3be-bdc5dc2e802c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:13.920786 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bb064-9da7-4a6a-a3be-bdc5dc2e802c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:13.921063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bb064-9da7-4a6a-a3be-bdc5dc2e802c admin admin] PATH_INFO: `/v3/users/780dfac7aa2142568f06a1c004e63061` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:13.922451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bb064-9da7-4a6a-a3be-bdc5dc2e802c admin admin] RBAC: Authorizing `identity:delete_user(user_id=780dfac7aa2142568f06a1c004e63061)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:13.924380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bb064-9da7-4a6a-a3be-bdc5dc2e802c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:13.970749 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e78bb064-9da7-4a6a-a3be-bdc5dc2e802c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '780dfac7aa2142568f06a1c004e63061'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.971455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e78bb064-9da7-4a6a-a3be-bdc5dc2e802c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '780dfac7aa2142568f06a1c004e63061'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.972073 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e78bb064-9da7-4a6a-a3be-bdc5dc2e802c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '780dfac7aa2142568f06a1c004e63061'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.985313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e78bb064-9da7-4a6a-a3be-bdc5dc2e802c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '780dfac7aa2142568f06a1c004e63061'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:13.992648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e78bb064-9da7-4a6a-a3be-bdc5dc2e802c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '780dfac7aa2142568f06a1c004e63061'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:14.004806 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1078/2144] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:13 2022] DELETE /identity/v3/users/780dfac7aa2142568f06a1c004e63061 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:14.435802 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e161598-9f28-4225-8703-dba7910f7e4c admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:14.436889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-4e161598-9f28-4225-8703-dba7910f7e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:14.462266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e161598-9f28-4225-8703-dba7910f7e4c admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:14.626251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087c38d-53be-4de7-b389-6a670ff1ebd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:14.627436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087c38d-53be-4de7-b389-6a670ff1ebd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:14.627869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087c38d-53be-4de7-b389-6a670ff1ebd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:14.628294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087c38d-53be-4de7-b389-6a670ff1ebd9 admin admin] PATH_INFO: `/v3/projects/c4ca9ae0d78a47fea17221aedcffbfd2` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:14.630932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087c38d-53be-4de7-b389-6a670ff1ebd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ca9ae0d78a47fea17221aedcffbfd2)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:14.637094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087c38d-53be-4de7-b389-6a670ff1ebd9 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:14.772785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a087c38d-53be-4de7-b389-6a670ff1ebd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ca9ae0d78a47fea17221aedcffbfd2', 'request_id': 'req-a087c38d-53be-4de7-b389-6a670ff1ebd9'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:14.796444 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a087c38d-53be-4de7-b389-6a670ff1ebd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ca9ae0d78a47fea17221aedcffbfd2', 'request_id': 'req-a087c38d-53be-4de7-b389-6a670ff1ebd9'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:14.808522 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a087c38d-53be-4de7-b389-6a670ff1ebd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ca9ae0d78a47fea17221aedcffbfd2', 'request_id': 'req-a087c38d-53be-4de7-b389-6a670ff1ebd9'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:14.825753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a087c38d-53be-4de7-b389-6a670ff1ebd9 admin admin] The token cache is being invalidate because project c4ca9ae0d78a47fea17221aedcffbfd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:14.826155 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a087c38d-53be-4de7-b389-6a670ff1ebd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:14.826870 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a087c38d-53be-4de7-b389-6a670ff1ebd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:14.828494 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1067/2145] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:14 2022] DELETE /identity/v3/projects/c4ca9ae0d78a47fea17221aedcffbfd2 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:14.835031 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1822c-fa28-43f5-b1b4-3568b15bb584 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:14.835320 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1822c-fa28-43f5-b1b4-3568b15bb584 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:14.835599 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1822c-fa28-43f5-b1b4-3568b15bb584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:14.861058 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-eae1822c-fa28-43f5-b1b4-3568b15bb584 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:14.862325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-eae1822c-fa28-43f5-b1b4-3568b15bb584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:14.884812 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:14.929412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1079/2146] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:14.938871 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507b4a2-52c9-4756-b7cf-0c42d2745715 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:14.939214 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507b4a2-52c9-4756-b7cf-0c42d2745715 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:14.939557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507b4a2-52c9-4756-b7cf-0c42d2745715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:14.959783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-4507b4a2-52c9-4756-b7cf-0c42d2745715 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:14.961001 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-4507b4a2-52c9-4756-b7cf-0c42d2745715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:14.969716 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1068/2147] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:14.974809 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1822c-fa28-43f5-b1b4-3568b15bb584 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:14.986390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1822c-fa28-43f5-b1b4-3568b15bb584 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:14.991205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12035641-24cd-46d3-afce-9fe679a01f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:14.991961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12035641-24cd-46d3-afce-9fe679a01f63 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:14.992312 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12035641-24cd-46d3-afce-9fe679a01f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:14.992711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12035641-24cd-46d3-afce-9fe679a01f63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:14.993546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12035641-24cd-46d3-afce-9fe679a01f63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:16:14.993914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12035641-24cd-46d3-afce-9fe679a01f63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:14.995786 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12035641-24cd-46d3-afce-9fe679a01f63 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:15.011966 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1080/2148] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:16:15.013430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507b4a2-52c9-4756-b7cf-0c42d2745715 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:15.024881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507b4a2-52c9-4756-b7cf-0c42d2745715 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:15.030968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0d1b9-82f3-40aa-8ea7-baaeccb342bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:15.031586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0d1b9-82f3-40aa-8ea7-baaeccb342bf admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:15.031931 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0d1b9-82f3-40aa-8ea7-baaeccb342bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:15.032279 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0d1b9-82f3-40aa-8ea7-baaeccb342bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:15.033048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0d1b9-82f3-40aa-8ea7-baaeccb342bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:15.034999 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0d1b9-82f3-40aa-8ea7-baaeccb342bf admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:15.069241 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1069/2149] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:16:15 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:15.070868 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12035641-24cd-46d3-afce-9fe679a01f63 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:15.081873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12035641-24cd-46d3-afce-9fe679a01f63 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:15.154383 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9c211-5791-400d-8303-434e4c7a82f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:15.154998 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9c211-5791-400d-8303-434e4c7a82f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:15.155287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9c211-5791-400d-8303-434e4c7a82f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:15.155565 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9c211-5791-400d-8303-434e4c7a82f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:15.156266 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9c211-5791-400d-8303-434e4c7a82f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:15.158253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9c211-5791-400d-8303-434e4c7a82f7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:15.186132 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1081/2150] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:16:15 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:15.187619 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0d1b9-82f3-40aa-8ea7-baaeccb342bf admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:15.199103 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0d1b9-82f3-40aa-8ea7-baaeccb342bf admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:15.206217 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eae82-1d31-4215-a978-a9e16a1ef34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:15.206909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eae82-1d31-4215-a978-a9e16a1ef34f admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:15.207194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eae82-1d31-4215-a978-a9e16a1ef34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:15.207475 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eae82-1d31-4215-a978-a9e16a1ef34f admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:15.208216 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eae82-1d31-4215-a978-a9e16a1ef34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:15.209837 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eae82-1d31-4215-a978-a9e16a1ef34f admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:15.234246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1070/2151] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:15.244325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9c211-5791-400d-8303-434e4c7a82f7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:15.261565 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9c211-5791-400d-8303-434e4c7a82f7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:15.269840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e48a6-2368-4d28-a7c0-b3b810fbdbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:15.270712 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e48a6-2368-4d28-a7c0-b3b810fbdbeb admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:15.271599 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e48a6-2368-4d28-a7c0-b3b810fbdbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:15.271890 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e48a6-2368-4d28-a7c0-b3b810fbdbeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:15.273326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e48a6-2368-4d28-a7c0-b3b810fbdbeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:15.275268 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e48a6-2368-4d28-a7c0-b3b810fbdbeb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:15.288638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1082/2152] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:15.293349 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eae82-1d31-4215-a978-a9e16a1ef34f admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:15.305830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eae82-1d31-4215-a978-a9e16a1ef34f admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:15.312403 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dad5e-7c27-455c-9add-b2d48e3bd08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:15.313410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dad5e-7c27-455c-9add-b2d48e3bd08b admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:15.313709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dad5e-7c27-455c-9add-b2d48e3bd08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:15.313984 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dad5e-7c27-455c-9add-b2d48e3bd08b admin admin] PATH_INFO: `/v3/projects/4f023bfad93340839a7c5cc7c8588e56/users/52e8425829d14f55bb004e6d16993b78/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:15.334210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737dad5e-7c27-455c-9add-b2d48e3bd08b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f023bfad93340839a7c5cc7c8588e56, user_id=52e8425829d14f55bb004e6d16993b78, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:15.337396 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737dad5e-7c27-455c-9add-b2d48e3bd08b admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:15.349938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1071/2153] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:15 2022] PUT /identity/v3/projects/4f023bfad93340839a7c5cc7c8588e56/users/52e8425829d14f55bb004e6d16993b78/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:15.424621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248aa77-27b9-4c4f-be38-fdb6fcef569b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:15.424940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248aa77-27b9-4c4f-be38-fdb6fcef569b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:15.425187 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248aa77-27b9-4c4f-be38-fdb6fcef569b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:15.471427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d248aa77-27b9-4c4f-be38-fdb6fcef569b None None] MFA Rules not processed for user `52e8425829d14f55bb004e6d16993b78`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:15.472715 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d248aa77-27b9-4c4f-be38-fdb6fcef569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:15.569185 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1083/2154] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:15.574035 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dad5e-7c27-455c-9add-b2d48e3bd08b admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:15.580011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:15.707631 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dad5e-7c27-455c-9add-b2d48e3bd08b admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:15.712406 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e4001-72e5-47e9-870e-f0daf5b1736b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:15.713078 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e4001-72e5-47e9-870e-f0daf5b1736b admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:15.713367 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e4001-72e5-47e9-870e-f0daf5b1736b admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:15.713648 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e4001-72e5-47e9-870e-f0daf5b1736b admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:15.714400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e4001-72e5-47e9-870e-f0daf5b1736b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:15.716352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e4001-72e5-47e9-870e-f0daf5b1736b admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:15.752665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1072/2155] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:16:15 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:15.757034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248aa77-27b9-4c4f-be38-fdb6fcef569b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:15.771886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248aa77-27b9-4c4f-be38-fdb6fcef569b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:15.806378 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:15.869027 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eb25e-65cd-4048-9053-7164e77033ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:15.869717 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eb25e-65cd-4048-9053-7164e77033ff admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:15.870023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eb25e-65cd-4048-9053-7164e77033ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:15.870302 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eb25e-65cd-4048-9053-7164e77033ff admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:15.870994 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2eb25e-65cd-4048-9053-7164e77033ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:15.872917 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2eb25e-65cd-4048-9053-7164e77033ff admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:15.900091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1084/2156] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:16:15 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:15.901523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e4001-72e5-47e9-870e-f0daf5b1736b admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:15.912880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e4001-72e5-47e9-870e-f0daf5b1736b admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:15.918475 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad080b4f-2b18-4694-8ad9-01d2f92a401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:15.919148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad080b4f-2b18-4694-8ad9-01d2f92a401f admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:15.919749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad080b4f-2b18-4694-8ad9-01d2f92a401f admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:15.920227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad080b4f-2b18-4694-8ad9-01d2f92a401f admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:15.921142 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad080b4f-2b18-4694-8ad9-01d2f92a401f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:15.923752 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad080b4f-2b18-4694-8ad9-01d2f92a401f admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:15.938902 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1073/2157] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:15.941408 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eb25e-65cd-4048-9053-7164e77033ff admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:15.965384 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eb25e-65cd-4048-9053-7164e77033ff admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:15.973452 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f79e57-d3d7-418f-9171-a103990cef35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:15.975559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f79e57-d3d7-418f-9171-a103990cef35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:15.975865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f79e57-d3d7-418f-9171-a103990cef35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:15.976298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f79e57-d3d7-418f-9171-a103990cef35 admin admin] PATH_INFO: `/v3/projects/0e059f807fef42e9bf24d623d50c4a52/users/362761240c6148f48e9a52c7a81f2a1e/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:15.996839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f79e57-d3d7-418f-9171-a103990cef35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e059f807fef42e9bf24d623d50c4a52, user_id=362761240c6148f48e9a52c7a81f2a1e, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:15.999843 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f79e57-d3d7-418f-9171-a103990cef35 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:16.022284 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1085/2158] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:15 2022] PUT /identity/v3/projects/0e059f807fef42e9bf24d623d50c4a52/users/362761240c6148f48e9a52c7a81f2a1e/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:16.026198 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad080b4f-2b18-4694-8ad9-01d2f92a401f admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:16.041183 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad080b4f-2b18-4694-8ad9-01d2f92a401f admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:16.132294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371c7c2-15be-433a-9860-ce8b2c48b368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:16.133491 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371c7c2-15be-433a-9860-ce8b2c48b368 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:16.133491 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371c7c2-15be-433a-9860-ce8b2c48b368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:16.134224 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371c7c2-15be-433a-9860-ce8b2c48b368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:16.135087 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371c7c2-15be-433a-9860-ce8b2c48b368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:16.137131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371c7c2-15be-433a-9860-ce8b2c48b368 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:16.158504 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1074/2159] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:16.162039 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f79e57-d3d7-418f-9171-a103990cef35 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:16.182310 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f79e57-d3d7-418f-9171-a103990cef35 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:16.191868 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a44354-e726-4384-9e4a-8954821b9af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:16.192875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a44354-e726-4384-9e4a-8954821b9af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:16.193395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a44354-e726-4384-9e4a-8954821b9af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:16.193744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a44354-e726-4384-9e4a-8954821b9af5 admin admin] PATH_INFO: `/v3/projects/0e059f807fef42e9bf24d623d50c4a52/users/362761240c6148f48e9a52c7a81f2a1e/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:16.196215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a44354-e726-4384-9e4a-8954821b9af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e059f807fef42e9bf24d623d50c4a52, user_id=362761240c6148f48e9a52c7a81f2a1e, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:16.199593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a44354-e726-4384-9e4a-8954821b9af5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:16.211672 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1086/2160] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:16 2022] PUT /identity/v3/projects/0e059f807fef42e9bf24d623d50c4a52/users/362761240c6148f48e9a52c7a81f2a1e/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:16.223054 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544e99f-2da5-46f8-b1ca-5122b03bfbd8 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:16.224539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544e99f-2da5-46f8-b1ca-5122b03bfbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:16.224539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544e99f-2da5-46f8-b1ca-5122b03bfbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:16.279688 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-6544e99f-2da5-46f8-b1ca-5122b03bfbd8 None None] MFA Rules not processed for user `362761240c6148f48e9a52c7a81f2a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:16.280936 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6544e99f-2da5-46f8-b1ca-5122b03bfbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:16.400123 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:16.410168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1075/2161] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:16.421658 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a44354-e726-4384-9e4a-8954821b9af5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:16.423717 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-79a44354-e726-4384-9e4a-8954821b9af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:16.501831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a44354-e726-4384-9e4a-8954821b9af5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:16.512508 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a46a0-14cb-405b-a655-4af3066b635d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:16.513175 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a46a0-14cb-405b-a655-4af3066b635d service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:16.513450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a46a0-14cb-405b-a655-4af3066b635d service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:16.513723 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a46a0-14cb-405b-a655-4af3066b635d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:16.573704 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a46a0-14cb-405b-a655-4af3066b635d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:16.575807 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a46a0-14cb-405b-a655-4af3066b635d service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:16.587930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1087/2162] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:21.014772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544e99f-2da5-46f8-b1ca-5122b03bfbd8 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:21.016395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6544e99f-2da5-46f8-b1ca-5122b03bfbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:21.029449 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544e99f-2da5-46f8-b1ca-5122b03bfbd8 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:21.034041 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508c0cd-33b0-40fe-9571-c732b5ee7d91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:21.034505 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508c0cd-33b0-40fe-9571-c732b5ee7d91 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:21.034731 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508c0cd-33b0-40fe-9571-c732b5ee7d91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:21.034940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508c0cd-33b0-40fe-9571-c732b5ee7d91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:21.046820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508c0cd-33b0-40fe-9571-c732b5ee7d91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:21.048879 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508c0cd-33b0-40fe-9571-c732b5ee7d91 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:21.060339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1076/2163] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:26.118534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a46a0-14cb-405b-a655-4af3066b635d service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:26.151322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:26.189943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a46a0-14cb-405b-a655-4af3066b635d service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:26.194812 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e03db6-b037-44a6-a68a-3a28a191bd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:26.195746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e03db6-b037-44a6-a68a-3a28a191bd51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:26.196502 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e03db6-b037-44a6-a68a-3a28a191bd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:26.196502 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e03db6-b037-44a6-a68a-3a28a191bd51 admin admin] PATH_INFO: `/v3/users/52e8425829d14f55bb004e6d16993b78` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:26.197797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e03db6-b037-44a6-a68a-3a28a191bd51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e8425829d14f55bb004e6d16993b78)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:26.200015 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e03db6-b037-44a6-a68a-3a28a191bd51 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:26.252513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-62e03db6-b037-44a6-a68a-3a28a191bd51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e8425829d14f55bb004e6d16993b78'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:26.253085 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-62e03db6-b037-44a6-a68a-3a28a191bd51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e8425829d14f55bb004e6d16993b78'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:26.253687 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-62e03db6-b037-44a6-a68a-3a28a191bd51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e8425829d14f55bb004e6d16993b78'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:26.265472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-62e03db6-b037-44a6-a68a-3a28a191bd51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e8425829d14f55bb004e6d16993b78'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:26.273187 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-62e03db6-b037-44a6-a68a-3a28a191bd51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e8425829d14f55bb004e6d16993b78'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:26.275871 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508c0cd-33b0-40fe-9571-c732b5ee7d91 service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:26.277891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-0508c0cd-33b0-40fe-9571-c732b5ee7d91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:26.286372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1088/2164] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:26 2022] DELETE /identity/v3/users/52e8425829d14f55bb004e6d16993b78 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:26.291306 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7f24f-d327-4d87-b03f-f5de1d1ab0de None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:26.291598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7f24f-d327-4d87-b03f-f5de1d1ab0de None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:26.291878 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7f24f-d327-4d87-b03f-f5de1d1ab0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:26.292495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508c0cd-33b0-40fe-9571-c732b5ee7d91 service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:26.311697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-34c7f24f-d327-4d87-b03f-f5de1d1ab0de None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:26.312934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-34c7f24f-d327-4d87-b03f-f5de1d1ab0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:26.350277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cece4b-0a34-4832-aad0-7b11644c4350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:26.351166 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cece4b-0a34-4832-aad0-7b11644c4350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:26.351447 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cece4b-0a34-4832-aad0-7b11644c4350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:26.351832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cece4b-0a34-4832-aad0-7b11644c4350 admin admin] PATH_INFO: `/v3/users/9ff9ac0b4b094999909fd8dd0a4acf91` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:26.353683 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cece4b-0a34-4832-aad0-7b11644c4350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ff9ac0b4b094999909fd8dd0a4acf91)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:26.355635 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cece4b-0a34-4832-aad0-7b11644c4350 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:26.371792 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1089/2165] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:16:26.381431 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7f24f-d327-4d87-b03f-f5de1d1ab0de None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:26.382821 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-34c7f24f-d327-4d87-b03f-f5de1d1ab0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:26.403394 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-81cece4b-0a34-4832-aad0-7b11644c4350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ff9ac0b4b094999909fd8dd0a4acf91'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:26.404044 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-81cece4b-0a34-4832-aad0-7b11644c4350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ff9ac0b4b094999909fd8dd0a4acf91'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:26.404676 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-81cece4b-0a34-4832-aad0-7b11644c4350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ff9ac0b4b094999909fd8dd0a4acf91'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:26.417246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-81cece4b-0a34-4832-aad0-7b11644c4350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ff9ac0b4b094999909fd8dd0a4acf91'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:26.424336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-81cece4b-0a34-4832-aad0-7b11644c4350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ff9ac0b4b094999909fd8dd0a4acf91'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:26.437165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:26.437590 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1077/2166] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:26 2022] DELETE /identity/v3/users/9ff9ac0b4b094999909fd8dd0a4acf91 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:26.441151 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7f24f-d327-4d87-b03f-f5de1d1ab0de None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:26.443406 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3d2ad-23c4-4e9d-a88d-f793a6a4e6e6 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:26.443721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3d2ad-23c4-4e9d-a88d-f793a6a4e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:26.444009 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3d2ad-23c4-4e9d-a88d-f793a6a4e6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:26.463869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-b4d3d2ad-23c4-4e9d-a88d-f793a6a4e6e6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:26.465088 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b4d3d2ad-23c4-4e9d-a88d-f793a6a4e6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:26.494545 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4abd8-61aa-4e91-868a-927a512d0458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:26.495246 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4abd8-61aa-4e91-868a-927a512d0458 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:26.495525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4abd8-61aa-4e91-868a-927a512d0458 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:26.495795 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4abd8-61aa-4e91-868a-927a512d0458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:26.497620 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ffb4abd8-61aa-4e91-868a-927a512d0458 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:26.524994 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1078/2167] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:16:26.534531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3d2ad-23c4-4e9d-a88d-f793a6a4e6e6 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:26.535989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b4d3d2ad-23c4-4e9d-a88d-f793a6a4e6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:26.544882 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:26.548970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3d2ad-23c4-4e9d-a88d-f793a6a4e6e6 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:26.554369 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c683c-6596-4c3a-8b99-1d53e207657c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:26.555027 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c683c-6596-4c3a-8b99-1d53e207657c service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:26.555792 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c683c-6596-4c3a-8b99-1d53e207657c service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:26.556426 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c683c-6596-4c3a-8b99-1d53e207657c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:26.562290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4abd8-61aa-4e91-868a-927a512d0458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:26.563767 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4abd8-61aa-4e91-868a-927a512d0458 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:26.566668 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c683c-6596-4c3a-8b99-1d53e207657c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:26.568081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c683c-6596-4c3a-8b99-1d53e207657c service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:26.573874 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1090/2168] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:26.578210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1079/2169] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:16:27.040341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4abd8-61aa-4e91-868a-927a512d0458 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:27.041916 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c683c-6596-4c3a-8b99-1d53e207657c service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:27.042991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ffb4abd8-61aa-4e91-868a-927a512d0458 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:27.043461 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-af8c683c-6596-4c3a-8b99-1d53e207657c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:27.064831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4abd8-61aa-4e91-868a-927a512d0458 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:27.065553 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c683c-6596-4c3a-8b99-1d53e207657c service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:27.080378 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f61d1-2d1b-4860-b33a-77547c865343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:27.081315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f61d1-2d1b-4860-b33a-77547c865343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:27.081541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f61d1-2d1b-4860-b33a-77547c865343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:27.081887 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f61d1-2d1b-4860-b33a-77547c865343 admin admin] PATH_INFO: `/v3/projects/4f023bfad93340839a7c5cc7c8588e56` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:27.083974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f61d1-2d1b-4860-b33a-77547c865343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f023bfad93340839a7c5cc7c8588e56)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:27.085893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f61d1-2d1b-4860-b33a-77547c865343 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:27.094916 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd98f8b-8bdd-4c07-b45b-fe1729a9f294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:27.095806 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd98f8b-8bdd-4c07-b45b-fe1729a9f294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:27.096094 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd98f8b-8bdd-4c07-b45b-fe1729a9f294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:27.096372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd98f8b-8bdd-4c07-b45b-fe1729a9f294 admin admin] PATH_INFO: `/v3/projects/b0d7ddc9ed564d13bc6caeba4c79222f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:27.099003 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd98f8b-8bdd-4c07-b45b-fe1729a9f294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d7ddc9ed564d13bc6caeba4c79222f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:27.104179 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd98f8b-8bdd-4c07-b45b-fe1729a9f294 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:27.184538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-088f61d1-2d1b-4860-b33a-77547c865343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f023bfad93340839a7c5cc7c8588e56', 'request_id': 'req-088f61d1-2d1b-4860-b33a-77547c865343'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.191465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7dd98f8b-8bdd-4c07-b45b-fe1729a9f294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d7ddc9ed564d13bc6caeba4c79222f', 'request_id': 'req-7dd98f8b-8bdd-4c07-b45b-fe1729a9f294'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.193945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-088f61d1-2d1b-4860-b33a-77547c865343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f023bfad93340839a7c5cc7c8588e56', 'request_id': 'req-088f61d1-2d1b-4860-b33a-77547c865343'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.198249 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7dd98f8b-8bdd-4c07-b45b-fe1729a9f294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d7ddc9ed564d13bc6caeba4c79222f', 'request_id': 'req-7dd98f8b-8bdd-4c07-b45b-fe1729a9f294'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.203011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-088f61d1-2d1b-4860-b33a-77547c865343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f023bfad93340839a7c5cc7c8588e56', 'request_id': 'req-088f61d1-2d1b-4860-b33a-77547c865343'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.204515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7dd98f8b-8bdd-4c07-b45b-fe1729a9f294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d7ddc9ed564d13bc6caeba4c79222f', 'request_id': 'req-7dd98f8b-8bdd-4c07-b45b-fe1729a9f294'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.218178 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7dd98f8b-8bdd-4c07-b45b-fe1729a9f294 admin admin] The token cache is being invalidate because project b0d7ddc9ed564d13bc6caeba4c79222f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:27.218308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-088f61d1-2d1b-4860-b33a-77547c865343 admin admin] The token cache is being invalidate because project 4f023bfad93340839a7c5cc7c8588e56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:27.218454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7dd98f8b-8bdd-4c07-b45b-fe1729a9f294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.218573 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-088f61d1-2d1b-4860-b33a-77547c865343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.219122 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-088f61d1-2d1b-4860-b33a-77547c865343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.219255 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7dd98f8b-8bdd-4c07-b45b-fe1729a9f294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.222039 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1080/2171] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:27 2022] DELETE /identity/v3/projects/4f023bfad93340839a7c5cc7c8588e56 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:27.222194 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1091/2171] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:27 2022] DELETE /identity/v3/projects/b0d7ddc9ed564d13bc6caeba4c79222f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:27.224831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd98f8b-8bdd-4c07-b45b-fe1729a9f294 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:27.225014 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f61d1-2d1b-4860-b33a-77547c865343 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:27.226191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7dd98f8b-8bdd-4c07-b45b-fe1729a9f294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:27.226548 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-088f61d1-2d1b-4860-b33a-77547c865343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:27.287541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:27.319744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd98f8b-8bdd-4c07-b45b-fe1729a9f294 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:27.324689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe209a3-fbac-4bc2-b0ef-f59c2eedd5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:27.325685 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe209a3-fbac-4bc2-b0ef-f59c2eedd5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:27.325972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe209a3-fbac-4bc2-b0ef-f59c2eedd5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:27.326285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe209a3-fbac-4bc2-b0ef-f59c2eedd5a4 admin admin] PATH_INFO: `/v3/users/8f2fdff368e5499d9e9ff8c401b54a33` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:27.327506 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe209a3-fbac-4bc2-b0ef-f59c2eedd5a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f2fdff368e5499d9e9ff8c401b54a33)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:27.329444 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe209a3-fbac-4bc2-b0ef-f59c2eedd5a4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:27.344849 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f61d1-2d1b-4860-b33a-77547c865343 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:27.356046 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0745ae-8f15-45c6-815d-4f8af52fa62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:27.356929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0745ae-8f15-45c6-815d-4f8af52fa62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:27.357238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0745ae-8f15-45c6-815d-4f8af52fa62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:27.357472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0745ae-8f15-45c6-815d-4f8af52fa62a admin admin] PATH_INFO: `/v3/users/362761240c6148f48e9a52c7a81f2a1e` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:27.358718 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0745ae-8f15-45c6-815d-4f8af52fa62a admin admin] RBAC: Authorizing `identity:delete_user(user_id=362761240c6148f48e9a52c7a81f2a1e)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:27.360775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0745ae-8f15-45c6-815d-4f8af52fa62a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:27.380766 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8fe209a3-fbac-4bc2-b0ef-f59c2eedd5a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f2fdff368e5499d9e9ff8c401b54a33'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.381583 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8fe209a3-fbac-4bc2-b0ef-f59c2eedd5a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f2fdff368e5499d9e9ff8c401b54a33'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.382838 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8fe209a3-fbac-4bc2-b0ef-f59c2eedd5a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f2fdff368e5499d9e9ff8c401b54a33'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.398016 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8fe209a3-fbac-4bc2-b0ef-f59c2eedd5a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f2fdff368e5499d9e9ff8c401b54a33'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.408095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8fe209a3-fbac-4bc2-b0ef-f59c2eedd5a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f2fdff368e5499d9e9ff8c401b54a33'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.425475 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cb0745ae-8f15-45c6-815d-4f8af52fa62a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '362761240c6148f48e9a52c7a81f2a1e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.426447 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cb0745ae-8f15-45c6-815d-4f8af52fa62a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '362761240c6148f48e9a52c7a81f2a1e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.427267 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cb0745ae-8f15-45c6-815d-4f8af52fa62a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '362761240c6148f48e9a52c7a81f2a1e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.434039 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1092/2172] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:27 2022] DELETE /identity/v3/users/8f2fdff368e5499d9e9ff8c401b54a33 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:27.453609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cb0745ae-8f15-45c6-815d-4f8af52fa62a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '362761240c6148f48e9a52c7a81f2a1e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.462247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cb0745ae-8f15-45c6-815d-4f8af52fa62a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '362761240c6148f48e9a52c7a81f2a1e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:27.471816 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:27.487906 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1081/2173] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:27 2022] DELETE /identity/v3/users/362761240c6148f48e9a52c7a81f2a1e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:16:27.805871 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe209a3-fbac-4bc2-b0ef-f59c2eedd5a4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:27.807429 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8fe209a3-fbac-4bc2-b0ef-f59c2eedd5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:27.881753 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe209a3-fbac-4bc2-b0ef-f59c2eedd5a4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:27.950185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0745ae-8f15-45c6-815d-4f8af52fa62a admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:27.951761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-cb0745ae-8f15-45c6-815d-4f8af52fa62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:27.954215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782025b7-c376-4b4e-b854-38d982a4b8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:27.955125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782025b7-c376-4b4e-b854-38d982a4b8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:27.955403 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782025b7-c376-4b4e-b854-38d982a4b8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:27.955674 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782025b7-c376-4b4e-b854-38d982a4b8b0 admin admin] PATH_INFO: `/v3/projects/0e059f807fef42e9bf24d623d50c4a52` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:27.956869 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782025b7-c376-4b4e-b854-38d982a4b8b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e059f807fef42e9bf24d623d50c4a52)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:27.958912 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782025b7-c376-4b4e-b854-38d982a4b8b0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:27.966523 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:27.968291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0745ae-8f15-45c6-815d-4f8af52fa62a admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:27.975473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0f895-aec3-4f1a-ad80-1b2ee9889972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:27.978710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0f895-aec3-4f1a-ad80-1b2ee9889972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:27.978857 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0f895-aec3-4f1a-ad80-1b2ee9889972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:27.979170 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0f895-aec3-4f1a-ad80-1b2ee9889972 admin admin] PATH_INFO: `/v3/projects/474b44fb6cf444d1a132d5efe715dc47` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:27.980476 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0f895-aec3-4f1a-ad80-1b2ee9889972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=474b44fb6cf444d1a132d5efe715dc47)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:27.982504 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0f895-aec3-4f1a-ad80-1b2ee9889972 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:28.011131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-782025b7-c376-4b4e-b854-38d982a4b8b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e059f807fef42e9bf24d623d50c4a52', 'request_id': 'req-782025b7-c376-4b4e-b854-38d982a4b8b0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:28.017213 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-782025b7-c376-4b4e-b854-38d982a4b8b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e059f807fef42e9bf24d623d50c4a52', 'request_id': 'req-782025b7-c376-4b4e-b854-38d982a4b8b0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:28.023710 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-782025b7-c376-4b4e-b854-38d982a4b8b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e059f807fef42e9bf24d623d50c4a52', 'request_id': 'req-782025b7-c376-4b4e-b854-38d982a4b8b0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:28.030678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cff0f895-aec3-4f1a-ad80-1b2ee9889972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '474b44fb6cf444d1a132d5efe715dc47', 'request_id': 'req-cff0f895-aec3-4f1a-ad80-1b2ee9889972'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:28.036661 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-782025b7-c376-4b4e-b854-38d982a4b8b0 admin admin] The token cache is being invalidate because project 0e059f807fef42e9bf24d623d50c4a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:28.036951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-782025b7-c376-4b4e-b854-38d982a4b8b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:28.037577 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-782025b7-c376-4b4e-b854-38d982a4b8b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:28.038248 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cff0f895-aec3-4f1a-ad80-1b2ee9889972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '474b44fb6cf444d1a132d5efe715dc47', 'request_id': 'req-cff0f895-aec3-4f1a-ad80-1b2ee9889972'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:28.039154 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1093/2174] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:27 2022] DELETE /identity/v3/projects/0e059f807fef42e9bf24d623d50c4a52 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:28.045285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4787f1-2c92-45a8-819f-2eeecc0cefce None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.045654 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4787f1-2c92-45a8-819f-2eeecc0cefce None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.045977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4787f1-2c92-45a8-819f-2eeecc0cefce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.049116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cff0f895-aec3-4f1a-ad80-1b2ee9889972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '474b44fb6cf444d1a132d5efe715dc47', 'request_id': 'req-cff0f895-aec3-4f1a-ad80-1b2ee9889972'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:28.061439 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cff0f895-aec3-4f1a-ad80-1b2ee9889972 admin admin] The token cache is being invalidate because project 474b44fb6cf444d1a132d5efe715dc47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:28.061875 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cff0f895-aec3-4f1a-ad80-1b2ee9889972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:28.062654 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cff0f895-aec3-4f1a-ad80-1b2ee9889972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:28.064246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1082/2175] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:27 2022] DELETE /identity/v3/projects/474b44fb6cf444d1a132d5efe715dc47 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:16:28.067930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4f4787f1-2c92-45a8-819f-2eeecc0cefce None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:28.067930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4f4787f1-2c92-45a8-819f-2eeecc0cefce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:28.069104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a4da0-a3a0-45e3-926e-ce817d28d161 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.069393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a4da0-a3a0-45e3-926e-ce817d28d161 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.069669 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a4da0-a3a0-45e3-926e-ce817d28d161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.094966 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-697a4da0-a3a0-45e3-926e-ce817d28d161 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:28.096566 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-697a4da0-a3a0-45e3-926e-ce817d28d161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:28.150036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1094/2176] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:16:28.155165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bea12d-9fbc-4681-b339-e06de8b218d4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.155735 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bea12d-9fbc-4681-b339-e06de8b218d4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.156197 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bea12d-9fbc-4681-b339-e06de8b218d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.188624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-35bea12d-9fbc-4681-b339-e06de8b218d4 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:28.189849 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-35bea12d-9fbc-4681-b339-e06de8b218d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:28.194127 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1083/2177] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:16:28.202595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26907e-7c73-466a-92f1-8f1d0676b0b9 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.202595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26907e-7c73-466a-92f1-8f1d0676b0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.202595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26907e-7c73-466a-92f1-8f1d0676b0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.205748 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1095/2178] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:28.208709 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bea12d-9fbc-4681-b339-e06de8b218d4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:28.218742 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bea12d-9fbc-4681-b339-e06de8b218d4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:28.228442 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83537b-0c80-48c9-8cf3-72f0951c419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:28.228604 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-4a26907e-7c73-466a-92f1-8f1d0676b0b9 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:28.229425 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83537b-0c80-48c9-8cf3-72f0951c419b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.229704 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83537b-0c80-48c9-8cf3-72f0951c419b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.229826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-4a26907e-7c73-466a-92f1-8f1d0676b0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:28.229968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83537b-0c80-48c9-8cf3-72f0951c419b admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.230754 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83537b-0c80-48c9-8cf3-72f0951c419b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:16:28.231821 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83537b-0c80-48c9-8cf3-72f0951c419b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:28.233917 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83537b-0c80-48c9-8cf3-72f0951c419b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:28.245591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1084/2179] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:28.249634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26907e-7c73-466a-92f1-8f1d0676b0b9 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:28.259842 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1096/2180] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:16:28.261095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83537b-0c80-48c9-8cf3-72f0951c419b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:28.264775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26907e-7c73-466a-92f1-8f1d0676b0b9 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:28.272155 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb92b7-7e78-4d9a-943d-bb32ec37727d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:28.274029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb92b7-7e78-4d9a-943d-bb32ec37727d admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.274881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb92b7-7e78-4d9a-943d-bb32ec37727d admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.275256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb92b7-7e78-4d9a-943d-bb32ec37727d admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.275729 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83537b-0c80-48c9-8cf3-72f0951c419b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:28.277411 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb92b7-7e78-4d9a-943d-bb32ec37727d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:16:28.277525 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb92b7-7e78-4d9a-943d-bb32ec37727d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:28.279648 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb92b7-7e78-4d9a-943d-bb32ec37727d admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:28.287539 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc316c32-5f74-4bd3-8799-72e75cf6fe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:28.288253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc316c32-5f74-4bd3-8799-72e75cf6fe14 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.288544 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc316c32-5f74-4bd3-8799-72e75cf6fe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.288821 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc316c32-5f74-4bd3-8799-72e75cf6fe14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.289556 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc316c32-5f74-4bd3-8799-72e75cf6fe14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:28.291572 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc316c32-5f74-4bd3-8799-72e75cf6fe14 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:28.309258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1085/2181] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:16:28.313821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb92b7-7e78-4d9a-943d-bb32ec37727d admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:28.327313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb92b7-7e78-4d9a-943d-bb32ec37727d admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:28.333969 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f222ad4-9a73-41c3-a4cb-2ef6167c9776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:28.334964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f222ad4-9a73-41c3-a4cb-2ef6167c9776 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.335386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f222ad4-9a73-41c3-a4cb-2ef6167c9776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.335735 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f222ad4-9a73-41c3-a4cb-2ef6167c9776 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.336566 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f222ad4-9a73-41c3-a4cb-2ef6167c9776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:28.339425 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f222ad4-9a73-41c3-a4cb-2ef6167c9776 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:28.340538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1097/2182] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:16:28 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:28.344842 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc316c32-5f74-4bd3-8799-72e75cf6fe14 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:28.372198 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1086/2183] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:16:28 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:28.376097 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f222ad4-9a73-41c3-a4cb-2ef6167c9776 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:28.414523 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:28.418487 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:28.428259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc316c32-5f74-4bd3-8799-72e75cf6fe14 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:28.461361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f222ad4-9a73-41c3-a4cb-2ef6167c9776 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:28.466395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826441bc-7710-4661-ab36-a607bb7d35ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:28.467077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826441bc-7710-4661-ab36-a607bb7d35ee admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.467363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826441bc-7710-4661-ab36-a607bb7d35ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.467642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826441bc-7710-4661-ab36-a607bb7d35ee admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.468354 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826441bc-7710-4661-ab36-a607bb7d35ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:28.470304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826441bc-7710-4661-ab36-a607bb7d35ee admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:28.498553 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1087/2184] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:16:28 2022] POST /identity/v3/users => generated 284 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:16:28.505551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77c9a1-ec8c-499c-b472-092a750af206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:28.506345 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77c9a1-ec8c-499c-b472-092a750af206 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.506746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77c9a1-ec8c-499c-b472-092a750af206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.507142 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77c9a1-ec8c-499c-b472-092a750af206 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.507286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826441bc-7710-4661-ab36-a607bb7d35ee admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:28.507963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77c9a1-ec8c-499c-b472-092a750af206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:28.510676 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77c9a1-ec8c-499c-b472-092a750af206 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:28.522634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826441bc-7710-4661-ab36-a607bb7d35ee admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:28.528968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0233f-93b0-4246-842b-cb9edd54dec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:28.529580 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0233f-93b0-4246-842b-cb9edd54dec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.529861 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0233f-93b0-4246-842b-cb9edd54dec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.530194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0233f-93b0-4246-842b-cb9edd54dec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.530903 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0233f-93b0-4246-842b-cb9edd54dec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:28.532542 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0233f-93b0-4246-842b-cb9edd54dec3 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:28.538781 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1098/2185] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:16:28 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:16:28.542657 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77c9a1-ec8c-499c-b472-092a750af206 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:28.546033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1088/2186] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:16:28.549443 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0233f-93b0-4246-842b-cb9edd54dec3 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:28.556892 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77c9a1-ec8c-499c-b472-092a750af206 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:28.559856 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0233f-93b0-4246-842b-cb9edd54dec3 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:28.563143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c33d9-f7ce-4999-9281-eee79cb01b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:28.563938 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c33d9-f7ce-4999-9281-eee79cb01b13 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.564227 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c33d9-f7ce-4999-9281-eee79cb01b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.566613 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c33d9-f7ce-4999-9281-eee79cb01b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.566763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94237bf-8b92-4d51-8ea3-179c2bc611b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:28.566866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c33d9-f7ce-4999-9281-eee79cb01b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:28.566942 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94237bf-8b92-4d51-8ea3-179c2bc611b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.566942 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94237bf-8b92-4d51-8ea3-179c2bc611b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.566942 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94237bf-8b92-4d51-8ea3-179c2bc611b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.566942 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94237bf-8b92-4d51-8ea3-179c2bc611b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:28.567288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c33d9-f7ce-4999-9281-eee79cb01b13 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:28.568271 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94237bf-8b92-4d51-8ea3-179c2bc611b1 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:28.581141 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1099/2187] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:28.581333 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1089/2188] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:16:28.582227 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c33d9-f7ce-4999-9281-eee79cb01b13 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:28.583957 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94237bf-8b92-4d51-8ea3-179c2bc611b1 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:28.592268 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c33d9-f7ce-4999-9281-eee79cb01b13 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:28.595458 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94237bf-8b92-4d51-8ea3-179c2bc611b1 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:28.598265 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed7f6d-5a04-4c85-9a66-fd0a4a16c5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:28.598935 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed7f6d-5a04-4c85-9a66-fd0a4a16c5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.599225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed7f6d-5a04-4c85-9a66-fd0a4a16c5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.599527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed7f6d-5a04-4c85-9a66-fd0a4a16c5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.600283 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed7f6d-5a04-4c85-9a66-fd0a4a16c5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:28.600850 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff78dc-5475-4855-bcaa-5f72e0a36f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:28.601824 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff78dc-5475-4855-bcaa-5f72e0a36f40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.601942 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed7f6d-5a04-4c85-9a66-fd0a4a16c5b9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:28.602443 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff78dc-5475-4855-bcaa-5f72e0a36f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.602813 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff78dc-5475-4855-bcaa-5f72e0a36f40 admin admin] PATH_INFO: `/v3/projects/97c2098ba03c4d52a21233a6220887ca/users/108a7c66ab674033a51b599845d4be73/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.613529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1100/2189] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:28.617514 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed7f6d-5a04-4c85-9a66-fd0a4a16c5b9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:28.626283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff78dc-5475-4855-bcaa-5f72e0a36f40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c2098ba03c4d52a21233a6220887ca, user_id=108a7c66ab674033a51b599845d4be73, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:28.629210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff78dc-5475-4855-bcaa-5f72e0a36f40 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:28.629681 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed7f6d-5a04-4c85-9a66-fd0a4a16c5b9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:28.635960 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572ff2d-041e-4b7a-ae87-d9dc09c33c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:28.636857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572ff2d-041e-4b7a-ae87-d9dc09c33c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.637135 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572ff2d-041e-4b7a-ae87-d9dc09c33c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.637438 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572ff2d-041e-4b7a-ae87-d9dc09c33c8c admin admin] PATH_INFO: `/v3/projects/4d6c46b1b2f5442db735ba5946a5d332/users/d8784f1930b74680bbbe82124dd14672/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.648325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1090/2190] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:28 2022] PUT /identity/v3/projects/97c2098ba03c4d52a21233a6220887ca/users/108a7c66ab674033a51b599845d4be73/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:28.655729 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572ff2d-041e-4b7a-ae87-d9dc09c33c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6c46b1b2f5442db735ba5946a5d332, user_id=d8784f1930b74680bbbe82124dd14672, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:28.658566 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572ff2d-041e-4b7a-ae87-d9dc09c33c8c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:28.660578 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408818a-8400-4e5e-97d4-dddfd588ced6 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.660884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408818a-8400-4e5e-97d4-dddfd588ced6 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.661168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408818a-8400-4e5e-97d4-dddfd588ced6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.675361 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1101/2191] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:28 2022] PUT /identity/v3/projects/4d6c46b1b2f5442db735ba5946a5d332/users/d8784f1930b74680bbbe82124dd14672/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:16:28.688202 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149e408-23bd-4fb2-9bd0-33915619a4ec None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.688498 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149e408-23bd-4fb2-9bd0-33915619a4ec None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.688772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149e408-23bd-4fb2-9bd0-33915619a4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.694462 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-3408818a-8400-4e5e-97d4-dddfd588ced6 None None] MFA Rules not processed for user `108a7c66ab674033a51b599845d4be73`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:28.695677 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-3408818a-8400-4e5e-97d4-dddfd588ced6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:28.718642 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4149e408-23bd-4fb2-9bd0-33915619a4ec None None] MFA Rules not processed for user `d8784f1930b74680bbbe82124dd14672`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:28.719926 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4149e408-23bd-4fb2-9bd0-33915619a4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:28.776976 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1091/2192] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:16:28.781546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408818a-8400-4e5e-97d4-dddfd588ced6 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:28.792897 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1102/2193] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:28.797108 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149e408-23bd-4fb2-9bd0-33915619a4ec None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:28.834015 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:28.856932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408818a-8400-4e5e-97d4-dddfd588ced6 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:28.862741 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba5450-c44c-40a8-bf47-972fbe230508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:28.863635 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba5450-c44c-40a8-bf47-972fbe230508 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.864028 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba5450-c44c-40a8-bf47-972fbe230508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.864407 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba5450-c44c-40a8-bf47-972fbe230508 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.865212 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba5450-c44c-40a8-bf47-972fbe230508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:28.866934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149e408-23bd-4fb2-9bd0-33915619a4ec None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:28.867689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba5450-c44c-40a8-bf47-972fbe230508 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:28.872474 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b46fc-7d03-4ad3-9e41-fd05c388f142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:28.872808 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b46fc-7d03-4ad3-9e41-fd05c388f142 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:28.873089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b46fc-7d03-4ad3-9e41-fd05c388f142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:28.873364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b46fc-7d03-4ad3-9e41-fd05c388f142 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:28.874149 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b46fc-7d03-4ad3-9e41-fd05c388f142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:28.875991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b46fc-7d03-4ad3-9e41-fd05c388f142 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:28.887740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:28.905071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1092/2194] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:16:28 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:16:28.909079 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba5450-c44c-40a8-bf47-972fbe230508 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:28.912955 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1103/2195] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:16:28 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:16:28.913977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b46fc-7d03-4ad3-9e41-fd05c388f142 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:28.984118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba5450-c44c-40a8-bf47-972fbe230508 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:29.000556 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b46fc-7d03-4ad3-9e41-fd05c388f142 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:29.007365 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742f97b-e379-44e3-b5c5-d3acd884fecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:29.009739 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742f97b-e379-44e3-b5c5-d3acd884fecd admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:29.010155 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742f97b-e379-44e3-b5c5-d3acd884fecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:29.010908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742f97b-e379-44e3-b5c5-d3acd884fecd admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:29.012221 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742f97b-e379-44e3-b5c5-d3acd884fecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:29.014846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742f97b-e379-44e3-b5c5-d3acd884fecd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:29.054845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1104/2196] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:16:28 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:29.056064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742f97b-e379-44e3-b5c5-d3acd884fecd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:29.068327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa98a25-5cc2-4dae-9b9f-4b3145d3f68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:29.069056 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98a25-5cc2-4dae-9b9f-4b3145d3f68f admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:29.069337 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98a25-5cc2-4dae-9b9f-4b3145d3f68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:29.069611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98a25-5cc2-4dae-9b9f-4b3145d3f68f admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:29.070352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa98a25-5cc2-4dae-9b9f-4b3145d3f68f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:29.072937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa98a25-5cc2-4dae-9b9f-4b3145d3f68f admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:29.073061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742f97b-e379-44e3-b5c5-d3acd884fecd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:29.079135 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edb5ef-5305-4f72-910b-b161e89cc685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:29.079814 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edb5ef-5305-4f72-910b-b161e89cc685 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:29.080107 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edb5ef-5305-4f72-910b-b161e89cc685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:29.080389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edb5ef-5305-4f72-910b-b161e89cc685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:29.081298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edb5ef-5305-4f72-910b-b161e89cc685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:29.084377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edb5ef-5305-4f72-910b-b161e89cc685 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:29.103246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1093/2197] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:16:28 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:16:29.106138 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1105/2198] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:29.107095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edb5ef-5305-4f72-910b-b161e89cc685 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:29.108052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa98a25-5cc2-4dae-9b9f-4b3145d3f68f admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:29.118534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edb5ef-5305-4f72-910b-b161e89cc685 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:29.125182 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836507d-2a2e-4fb9-8123-4711dceef223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:29.125498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa98a25-5cc2-4dae-9b9f-4b3145d3f68f admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:29.125886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836507d-2a2e-4fb9-8123-4711dceef223 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:29.126217 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836507d-2a2e-4fb9-8123-4711dceef223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:29.126497 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836507d-2a2e-4fb9-8123-4711dceef223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:29.127237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836507d-2a2e-4fb9-8123-4711dceef223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:29.129379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836507d-2a2e-4fb9-8123-4711dceef223 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:29.131248 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44e7c4-ebcc-4fc0-abc0-aa4ddb851f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:29.132684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44e7c4-ebcc-4fc0-abc0-aa4ddb851f10 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:29.133174 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44e7c4-ebcc-4fc0-abc0-aa4ddb851f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:29.134403 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44e7c4-ebcc-4fc0-abc0-aa4ddb851f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:29.135281 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44e7c4-ebcc-4fc0-abc0-aa4ddb851f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:29.137555 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44e7c4-ebcc-4fc0-abc0-aa4ddb851f10 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:29.145447 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1106/2199] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:29.150232 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836507d-2a2e-4fb9-8123-4711dceef223 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:29.150922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1094/2200] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:16:29.154959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44e7c4-ebcc-4fc0-abc0-aa4ddb851f10 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:29.163371 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836507d-2a2e-4fb9-8123-4711dceef223 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:29.165666 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44e7c4-ebcc-4fc0-abc0-aa4ddb851f10 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:29.168124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2963fd-2534-483f-b604-c08a0f371cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:29.169009 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2963fd-2534-483f-b604-c08a0f371cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:29.169296 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2963fd-2534-483f-b604-c08a0f371cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:29.169663 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2963fd-2534-483f-b604-c08a0f371cd8 admin admin] PATH_INFO: `/v3/projects/0a214e67d653423a89593019afba2293/users/e7675d7f486949c2a2be8ce9c9f79050/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:29.171268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1749c-e108-47ff-8e75-e4d176c594b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:29.172497 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1749c-e108-47ff-8e75-e4d176c594b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:29.173018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1749c-e108-47ff-8e75-e4d176c594b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:29.173347 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1749c-e108-47ff-8e75-e4d176c594b9 admin admin] PATH_INFO: `/v3/projects/5527fed5bfed466a8dc78ffcfe9dcb5e/users/325ff5da5ebf471ebd8fb5dd39bd24be/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:29.186977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2963fd-2534-483f-b604-c08a0f371cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a214e67d653423a89593019afba2293, user_id=e7675d7f486949c2a2be8ce9c9f79050, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:29.190266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1749c-e108-47ff-8e75-e4d176c594b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5527fed5bfed466a8dc78ffcfe9dcb5e, user_id=325ff5da5ebf471ebd8fb5dd39bd24be, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:29.191574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2963fd-2534-483f-b604-c08a0f371cd8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:29.193071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1749c-e108-47ff-8e75-e4d176c594b9 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:29.207559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1107/2201] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:29 2022] PUT /identity/v3/projects/0a214e67d653423a89593019afba2293/users/e7675d7f486949c2a2be8ce9c9f79050/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:16:29.211121 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1095/2202] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:29 2022] PUT /identity/v3/projects/5527fed5bfed466a8dc78ffcfe9dcb5e/users/325ff5da5ebf471ebd8fb5dd39bd24be/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:16:29.215095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2963fd-2534-483f-b604-c08a0f371cd8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:29.219711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa0690-48c3-460c-8910-6f653b9e67bc None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:29.220152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa0690-48c3-460c-8910-6f653b9e67bc None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:29.220269 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa0690-48c3-460c-8910-6f653b9e67bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:29.254578 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-d9aa0690-48c3-460c-8910-6f653b9e67bc None None] MFA Rules not processed for user `325ff5da5ebf471ebd8fb5dd39bd24be`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:29.255815 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d9aa0690-48c3-460c-8910-6f653b9e67bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:29.288162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2963fd-2534-483f-b604-c08a0f371cd8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:29.293547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:29.302947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:29.337984 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1096/2203] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:29.343231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa0690-48c3-460c-8910-6f653b9e67bc None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:29.356068 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ae4bd-8b42-4e85-a9ac-8e9297db7c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:29.356976 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ae4bd-8b42-4e85-a9ac-8e9297db7c7b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:29.357364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ae4bd-8b42-4e85-a9ac-8e9297db7c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:29.357832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ae4bd-8b42-4e85-a9ac-8e9297db7c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:29.358723 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ae4bd-8b42-4e85-a9ac-8e9297db7c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:29.361348 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ae4bd-8b42-4e85-a9ac-8e9297db7c7b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:29.378021 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1108/2204] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:29.379404 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ae4bd-8b42-4e85-a9ac-8e9297db7c7b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:29.403987 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ae4bd-8b42-4e85-a9ac-8e9297db7c7b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:29.408955 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7b327-e1df-47e3-a074-3bddac9b54ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:29.410227 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7b327-e1df-47e3-a074-3bddac9b54ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:29.410615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7b327-e1df-47e3-a074-3bddac9b54ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:29.411230 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7b327-e1df-47e3-a074-3bddac9b54ca admin admin] PATH_INFO: `/v3/projects/0a214e67d653423a89593019afba2293/users/e7675d7f486949c2a2be8ce9c9f79050/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:29.415005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7b327-e1df-47e3-a074-3bddac9b54ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a214e67d653423a89593019afba2293, user_id=e7675d7f486949c2a2be8ce9c9f79050, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:29.417661 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7b327-e1df-47e3-a074-3bddac9b54ca admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:29.435355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1109/2205] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:29 2022] PUT /identity/v3/projects/0a214e67d653423a89593019afba2293/users/e7675d7f486949c2a2be8ce9c9f79050/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:29.449081 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7a0ce-5474-49ed-8ef2-a865f8ca7986 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:29.449473 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7a0ce-5474-49ed-8ef2-a865f8ca7986 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:29.449762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7a0ce-5474-49ed-8ef2-a865f8ca7986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:29.464047 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa0690-48c3-460c-8910-6f653b9e67bc None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:29.482669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-69a7a0ce-5474-49ed-8ef2-a865f8ca7986 None None] MFA Rules not processed for user `e7675d7f486949c2a2be8ce9c9f79050`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:29.483972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-69a7a0ce-5474-49ed-8ef2-a865f8ca7986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:29.556542 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff8b5b-8a65-43dc-b319-81f34f7f90ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:29.557245 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff8b5b-8a65-43dc-b319-81f34f7f90ec admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:29.557521 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff8b5b-8a65-43dc-b319-81f34f7f90ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:29.557801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff8b5b-8a65-43dc-b319-81f34f7f90ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:29.563673 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff8b5b-8a65-43dc-b319-81f34f7f90ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:29.565642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff8b5b-8a65-43dc-b319-81f34f7f90ec admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:29.626823 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1110/2206] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:29.636702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1097/2207] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:16:29 2022] POST /identity/v3/projects => generated 385 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:16:29.643306 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7a0ce-5474-49ed-8ef2-a865f8ca7986 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:29.645094 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-69a7a0ce-5474-49ed-8ef2-a865f8ca7986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:29.652341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff8b5b-8a65-43dc-b319-81f34f7f90ec admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:29.733569 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7a0ce-5474-49ed-8ef2-a865f8ca7986 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:29.783661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff8b5b-8a65-43dc-b319-81f34f7f90ec admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:29.807503 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e681d-85bf-4c3d-8714-131252258e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:29.808190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e681d-85bf-4c3d-8714-131252258e01 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:29.808477 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e681d-85bf-4c3d-8714-131252258e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:29.808759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e681d-85bf-4c3d-8714-131252258e01 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:29.810503 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e681d-85bf-4c3d-8714-131252258e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:29.811440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:29.813684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e681d-85bf-4c3d-8714-131252258e01 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:29.844985 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07075d10-7ba2-4717-b583-d698ac39f9ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:29.845726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07075d10-7ba2-4717-b583-d698ac39f9ca service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:29.846263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07075d10-7ba2-4717-b583-d698ac39f9ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:29.846565 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07075d10-7ba2-4717-b583-d698ac39f9ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:29.856478 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1098/2208] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:16:29 2022] POST /identity/v3/users => generated 299 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:29.860565 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e681d-85bf-4c3d-8714-131252258e01 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:29.887075 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e681d-85bf-4c3d-8714-131252258e01 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:29.903238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64375f1d-e75d-411f-9b67-06ab11dd2a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:29.903949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64375f1d-e75d-411f-9b67-06ab11dd2a4f admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:29.904238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64375f1d-e75d-411f-9b67-06ab11dd2a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:29.904517 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64375f1d-e75d-411f-9b67-06ab11dd2a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:29.905632 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64375f1d-e75d-411f-9b67-06ab11dd2a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:29.907322 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64375f1d-e75d-411f-9b67-06ab11dd2a4f admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:29.913244 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:29.938206 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1099/2209] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:16:29.941899 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64375f1d-e75d-411f-9b67-06ab11dd2a4f admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:29.952063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07075d10-7ba2-4717-b583-d698ac39f9ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:29.954379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07075d10-7ba2-4717-b583-d698ac39f9ca service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:29.963261 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64375f1d-e75d-411f-9b67-06ab11dd2a4f admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:29.968728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fb911-034a-4e6a-abc3-5f871321eeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:29.969385 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1111/2210] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:29 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:29.969741 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fb911-034a-4e6a-abc3-5f871321eeb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:29.970056 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fb911-034a-4e6a-abc3-5f871321eeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:29.970335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fb911-034a-4e6a-abc3-5f871321eeb8 admin admin] PATH_INFO: `/v3/projects/717b45f7ad734939a9495e6ebf61707d/users/affe479b6d114108aa21c6f4a5d08d05/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:29.987327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fb911-034a-4e6a-abc3-5f871321eeb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=717b45f7ad734939a9495e6ebf61707d, user_id=affe479b6d114108aa21c6f4a5d08d05, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:29.991275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fb911-034a-4e6a-abc3-5f871321eeb8 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:30.016660 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1100/2211] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:29 2022] PUT /identity/v3/projects/717b45f7ad734939a9495e6ebf61707d/users/affe479b6d114108aa21c6f4a5d08d05/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:30.021469 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07075d10-7ba2-4717-b583-d698ac39f9ca service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:30.040507 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07075d10-7ba2-4717-b583-d698ac39f9ca service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:30.087566 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fb911-034a-4e6a-abc3-5f871321eeb8 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:30.207391 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6da66-397d-4bd8-a00a-22a334e37d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:30.209237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6da66-397d-4bd8-a00a-22a334e37d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:30.209783 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6da66-397d-4bd8-a00a-22a334e37d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:30.210701 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6da66-397d-4bd8-a00a-22a334e37d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:30.211461 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6da66-397d-4bd8-a00a-22a334e37d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:30.216304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fb911-034a-4e6a-abc3-5f871321eeb8 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:30.217051 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6da66-397d-4bd8-a00a-22a334e37d26 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:30.223161 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f743ea-e563-45de-af30-b72f1623c628 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:30.224366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f743ea-e563-45de-af30-b72f1623c628 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:30.224756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f743ea-e563-45de-af30-b72f1623c628 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:30.225139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f743ea-e563-45de-af30-b72f1623c628 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:30.243636 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1112/2212] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:30.248481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6da66-397d-4bd8-a00a-22a334e37d26 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:30.277440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6da66-397d-4bd8-a00a-22a334e37d26 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:30.293838 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad76b1-9a1d-4ebe-a997-2efbc039ba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:30.294162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad76b1-9a1d-4ebe-a997-2efbc039ba10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:30.294479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad76b1-9a1d-4ebe-a997-2efbc039ba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:30.295239 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad76b1-9a1d-4ebe-a997-2efbc039ba10 admin admin] PATH_INFO: `/v3/projects/717b45f7ad734939a9495e6ebf61707d/users/affe479b6d114108aa21c6f4a5d08d05/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:30.302272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad76b1-9a1d-4ebe-a997-2efbc039ba10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=717b45f7ad734939a9495e6ebf61707d, user_id=affe479b6d114108aa21c6f4a5d08d05, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:30.305080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad76b1-9a1d-4ebe-a997-2efbc039ba10 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:30.314719 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f743ea-e563-45de-af30-b72f1623c628 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:30.315999 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f743ea-e563-45de-af30-b72f1623c628 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:30.330922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1101/2213] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:16:30.345900 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1113/2214] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:30 2022] PUT /identity/v3/projects/717b45f7ad734939a9495e6ebf61707d/users/affe479b6d114108aa21c6f4a5d08d05/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:30.361383 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f25b8-6b74-4a2b-b1ca-014cdd5199a3 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:30.361717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f25b8-6b74-4a2b-b1ca-014cdd5199a3 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:30.362017 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f25b8-6b74-4a2b-b1ca-014cdd5199a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:30.426284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-218f25b8-6b74-4a2b-b1ca-014cdd5199a3 None None] MFA Rules not processed for user `affe479b6d114108aa21c6f4a5d08d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:30.430794 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-218f25b8-6b74-4a2b-b1ca-014cdd5199a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:30.637540 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1102/2215] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:30.670231 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad76b1-9a1d-4ebe-a997-2efbc039ba10 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:30.672354 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b6ad76b1-9a1d-4ebe-a997-2efbc039ba10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:30.889540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad76b1-9a1d-4ebe-a997-2efbc039ba10 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:30.901777 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325472d-3a2d-4a7c-8f07-8f6983a3ece6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:30.907213 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325472d-3a2d-4a7c-8f07-8f6983a3ece6 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:30.909066 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325472d-3a2d-4a7c-8f07-8f6983a3ece6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:30.909459 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325472d-3a2d-4a7c-8f07-8f6983a3ece6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:30.978425 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:31.080504 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325472d-3a2d-4a7c-8f07-8f6983a3ece6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:31.084055 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325472d-3a2d-4a7c-8f07-8f6983a3ece6 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:31.099300 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1114/2216] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:32.886081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f25b8-6b74-4a2b-b1ca-014cdd5199a3 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:32.896452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f25b8-6b74-4a2b-b1ca-014cdd5199a3 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:32.900126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e145f0-b4af-4aba-aa06-f54a0f61609b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:32.900774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e145f0-b4af-4aba-aa06-f54a0f61609b service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:32.901057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e145f0-b4af-4aba-aa06-f54a0f61609b service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:32.901330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e145f0-b4af-4aba-aa06-f54a0f61609b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:32.918370 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:32.982134 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e145f0-b4af-4aba-aa06-f54a0f61609b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:32.983776 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e145f0-b4af-4aba-aa06-f54a0f61609b service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:32.995083 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1103/2217] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:33.040756 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18a051-f9f5-492e-ade0-6e38910f58a1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:33.041402 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18a051-f9f5-492e-ade0-6e38910f58a1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:33.042350 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18a051-f9f5-492e-ade0-6e38910f58a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:33.065751 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-db18a051-f9f5-492e-ade0-6e38910f58a1 None None] MFA Rules not processed for user `30c0516b85e74bdb829a3019e71e6ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:33.067021 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-db18a051-f9f5-492e-ade0-6e38910f58a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:33.107026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d05864-5d5e-45b0-8841-eab0d7a7cfc5 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:33.107315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d05864-5d5e-45b0-8841-eab0d7a7cfc5 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:33.107598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d05864-5d5e-45b0-8841-eab0d7a7cfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:33.132018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-58d05864-5d5e-45b0-8841-eab0d7a7cfc5 None None] MFA Rules not processed for user `30c0516b85e74bdb829a3019e71e6ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:33.133849 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-58d05864-5d5e-45b0-8841-eab0d7a7cfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:33.144634 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1115/2218] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 12:16:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:16:33.189832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18a051-f9f5-492e-ade0-6e38910f58a1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:33.191649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-db18a051-f9f5-492e-ade0-6e38910f58a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:33.208052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1104/2219] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 12:16:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:16:33.221267 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d05864-5d5e-45b0-8841-eab0d7a7cfc5 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:33.222647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-58d05864-5d5e-45b0-8841-eab0d7a7cfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:33.279130 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18a051-f9f5-492e-ade0-6e38910f58a1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:33.284557 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e531c-be01-4ad0-aa9e-95265582fe57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71de21b4b6d4971953f0c1ca92d9f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:33.285303 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e531c-be01-4ad0-aa9e-95265582fe57 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:33.285645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e531c-be01-4ad0-aa9e-95265582fe57 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:33.285987 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e531c-be01-4ad0-aa9e-95265582fe57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:33.295375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e531c-be01-4ad0-aa9e-95265582fe57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:33.297038 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e531c-be01-4ad0-aa9e-95265582fe57 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:33.304349 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d05864-5d5e-45b0-8841-eab0d7a7cfc5 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:33.305875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1116/2220] 10.222.0.48 () {60 vars in 1384 bytes} [Mon Jul 25 12:16:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:16:33.310473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0dc5c-2bf7-41a2-afad-42a98564b3d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71de21b4b6d4971953f0c1ca92d9f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:33.311136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0dc5c-2bf7-41a2-afad-42a98564b3d0 service swift] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:33.311430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0dc5c-2bf7-41a2-afad-42a98564b3d0 service swift] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:33.311884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0dc5c-2bf7-41a2-afad-42a98564b3d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:33.323791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0dc5c-2bf7-41a2-afad-42a98564b3d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:33.325711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0dc5c-2bf7-41a2-afad-42a98564b3d0 service swift] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:33.335562 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1105/2221] 10.222.0.48 () {60 vars in 1384 bytes} [Mon Jul 25 12:16:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 12:16:34.093802 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e531c-be01-4ad0-aa9e-95265582fe57 service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:34.104423 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e531c-be01-4ad0-aa9e-95265582fe57 service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:34.108952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2dcd5-0e49-4daf-82fc-f9b20537e825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:34.110133 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2dcd5-0e49-4daf-82fc-f9b20537e825 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:34.110621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2dcd5-0e49-4daf-82fc-f9b20537e825 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:34.111072 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2dcd5-0e49-4daf-82fc-f9b20537e825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:34.124074 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2dcd5-0e49-4daf-82fc-f9b20537e825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:34.126087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2dcd5-0e49-4daf-82fc-f9b20537e825 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:34.140515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1117/2222] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:34.381255 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8e42-4e26-49f4-9498-53e3c822e964 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:34.382423 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8e42-4e26-49f4-9498-53e3c822e964 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:34.383246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8e42-4e26-49f4-9498-53e3c822e964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:34.420318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-506c8e42-4e26-49f4-9498-53e3c822e964 None None] MFA Rules not processed for user `30c0516b85e74bdb829a3019e71e6ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:34.423582 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-506c8e42-4e26-49f4-9498-53e3c822e964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:34.455934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1106/2223] 10.222.0.48 () {58 vars in 967 bytes} [Mon Jul 25 12:16:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:34.483202 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2dcd5-0e49-4daf-82fc-f9b20537e825 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:34.515130 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2dcd5-0e49-4daf-82fc-f9b20537e825 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:34.533046 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773053c-9a57-4681-a211-b8bb137893a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71de21b4b6d4971953f0c1ca92d9f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:34.534217 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773053c-9a57-4681-a211-b8bb137893a9 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:34.534624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773053c-9a57-4681-a211-b8bb137893a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:34.535244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773053c-9a57-4681-a211-b8bb137893a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:34.550567 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773053c-9a57-4681-a211-b8bb137893a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:34.552317 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773053c-9a57-4681-a211-b8bb137893a9 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:34.564765 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1118/2224] 10.222.0.48 () {60 vars in 1384 bytes} [Mon Jul 25 12:16:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:16:35.113158 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52949b16-618d-432f-ad61-a26d8f387236 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:35.113669 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52949b16-618d-432f-ad61-a26d8f387236 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:35.114118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52949b16-618d-432f-ad61-a26d8f387236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:35.150716 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-52949b16-618d-432f-ad61-a26d8f387236 None None] MFA Rules not processed for user `30c0516b85e74bdb829a3019e71e6ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:35.156292 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-52949b16-618d-432f-ad61-a26d8f387236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:35.172010 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1107/2225] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 12:16:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:16:35.212647 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773053c-9a57-4681-a211-b8bb137893a9 service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:35.231394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773053c-9a57-4681-a211-b8bb137893a9 service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:35.242153 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153d252-4717-4481-a57e-1ab9936520fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71de21b4b6d4971953f0c1ca92d9f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:35.243454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153d252-4717-4481-a57e-1ab9936520fd service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:35.243954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153d252-4717-4481-a57e-1ab9936520fd service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:35.244878 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153d252-4717-4481-a57e-1ab9936520fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:35.256218 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153d252-4717-4481-a57e-1ab9936520fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:35.259109 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153d252-4717-4481-a57e-1ab9936520fd service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:35.275560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1119/2226] 10.222.0.48 () {60 vars in 1384 bytes} [Mon Jul 25 12:16:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 12:16:36.314572 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04f957-a52c-43a3-a3a0-784d1ea2d363 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:36.315793 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04f957-a52c-43a3-a3a0-784d1ea2d363 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:36.316286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04f957-a52c-43a3-a3a0-784d1ea2d363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:36.340208 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-cd04f957-a52c-43a3-a3a0-784d1ea2d363 None None] MFA Rules not processed for user `30c0516b85e74bdb829a3019e71e6ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:36.341652 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-cd04f957-a52c-43a3-a3a0-784d1ea2d363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:36.355550 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1108/2227] 10.222.0.48 () {58 vars in 967 bytes} [Mon Jul 25 12:16:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:16:36.363122 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153d252-4717-4481-a57e-1ab9936520fd service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:36.378031 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153d252-4717-4481-a57e-1ab9936520fd service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:36.384551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb715e9e-dd27-4f62-b0d8-04f7c2228c2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71de21b4b6d4971953f0c1ca92d9f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:36.385762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb715e9e-dd27-4f62-b0d8-04f7c2228c2d service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:36.386294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb715e9e-dd27-4f62-b0d8-04f7c2228c2d service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:36.386793 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb715e9e-dd27-4f62-b0d8-04f7c2228c2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:36.397324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb715e9e-dd27-4f62-b0d8-04f7c2228c2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:36.399572 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb715e9e-dd27-4f62-b0d8-04f7c2228c2d service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:36.416183 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1120/2228] 10.222.0.48 () {60 vars in 1384 bytes} [Mon Jul 25 12:16:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:16:37.541915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04f957-a52c-43a3-a3a0-784d1ea2d363 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:37.713680 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:37.873658 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04f957-a52c-43a3-a3a0-784d1ea2d363 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:37.888384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870347c-9fe0-48e9-bd28-975a29b954e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:37.890288 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870347c-9fe0-48e9-bd28-975a29b954e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:37.893648 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870347c-9fe0-48e9-bd28-975a29b954e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:37.894288 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870347c-9fe0-48e9-bd28-975a29b954e8 admin admin] PATH_INFO: `/v3/users/108a7c66ab674033a51b599845d4be73` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:37.897335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870347c-9fe0-48e9-bd28-975a29b954e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=108a7c66ab674033a51b599845d4be73)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:37.909384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870347c-9fe0-48e9-bd28-975a29b954e8 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:37.986095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a7154-1aa7-4153-8f69-5bdfa5334ec2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:37.986623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a7154-1aa7-4153-8f69-5bdfa5334ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:37.986949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a7154-1aa7-4153-8f69-5bdfa5334ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:38.001723 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:38.038587 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-131a7154-1aa7-4153-8f69-5bdfa5334ec2 None None] MFA Rules not processed for user `0dd62c26ee6a438495abdc3ca489b85e`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:38.043232 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-131a7154-1aa7-4153-8f69-5bdfa5334ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:38.068030 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d870347c-9fe0-48e9-bd28-975a29b954e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '108a7c66ab674033a51b599845d4be73'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:38.069016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d870347c-9fe0-48e9-bd28-975a29b954e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '108a7c66ab674033a51b599845d4be73'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:38.070825 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d870347c-9fe0-48e9-bd28-975a29b954e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '108a7c66ab674033a51b599845d4be73'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:38.108575 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d870347c-9fe0-48e9-bd28-975a29b954e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '108a7c66ab674033a51b599845d4be73'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:38.126711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d870347c-9fe0-48e9-bd28-975a29b954e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '108a7c66ab674033a51b599845d4be73'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:38.150308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1109/2229] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:37 2022] DELETE /identity/v3/users/108a7c66ab674033a51b599845d4be73 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:16:38.155152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f2c1a-8eb9-4a0b-ad84-264e21bc0a0d None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:38.155653 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f2c1a-8eb9-4a0b-ad84-264e21bc0a0d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:38.156185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f2c1a-8eb9-4a0b-ad84-264e21bc0a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:38.177326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1121/2230] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:38.199010 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-c63f2c1a-8eb9-4a0b-ad84-264e21bc0a0d None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:38.200456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c63f2c1a-8eb9-4a0b-ad84-264e21bc0a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:38.295049 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1110/2231] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:38.306046 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a7154-1aa7-4153-8f69-5bdfa5334ec2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:38.311625 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-131a7154-1aa7-4153-8f69-5bdfa5334ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:38.406763 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a7154-1aa7-4153-8f69-5bdfa5334ec2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:38.478699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24681f28-a10c-4b65-aa15-ca31990a5e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:38.479472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24681f28-a10c-4b65-aa15-ca31990a5e28 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:38.479754 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24681f28-a10c-4b65-aa15-ca31990a5e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:38.480078 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24681f28-a10c-4b65-aa15-ca31990a5e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:38.493418 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24681f28-a10c-4b65-aa15-ca31990a5e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:38.494945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24681f28-a10c-4b65-aa15-ca31990a5e28 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:38.511083 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1122/2232] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:38.935064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f2c1a-8eb9-4a0b-ad84-264e21bc0a0d None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:38.937116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c63f2c1a-8eb9-4a0b-ad84-264e21bc0a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:38.949595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f2c1a-8eb9-4a0b-ad84-264e21bc0a0d None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:38.969171 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9625ed-6802-4f87-bd78-0c9a9ac23359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:38.971015 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9625ed-6802-4f87-bd78-0c9a9ac23359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:38.971524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9625ed-6802-4f87-bd78-0c9a9ac23359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:38.972224 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9625ed-6802-4f87-bd78-0c9a9ac23359 admin admin] PATH_INFO: `/v3/projects/97c2098ba03c4d52a21233a6220887ca` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:38.974758 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9625ed-6802-4f87-bd78-0c9a9ac23359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c2098ba03c4d52a21233a6220887ca)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:38.978227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9625ed-6802-4f87-bd78-0c9a9ac23359 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:39.045709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:39.071070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cc9625ed-6802-4f87-bd78-0c9a9ac23359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c2098ba03c4d52a21233a6220887ca', 'request_id': 'req-cc9625ed-6802-4f87-bd78-0c9a9ac23359'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.083715 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cc9625ed-6802-4f87-bd78-0c9a9ac23359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c2098ba03c4d52a21233a6220887ca', 'request_id': 'req-cc9625ed-6802-4f87-bd78-0c9a9ac23359'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.098078 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cc9625ed-6802-4f87-bd78-0c9a9ac23359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c2098ba03c4d52a21233a6220887ca', 'request_id': 'req-cc9625ed-6802-4f87-bd78-0c9a9ac23359'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.116482 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cc9625ed-6802-4f87-bd78-0c9a9ac23359 admin admin] The token cache is being invalidate because project 97c2098ba03c4d52a21233a6220887ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:39.116784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cc9625ed-6802-4f87-bd78-0c9a9ac23359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.117582 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cc9625ed-6802-4f87-bd78-0c9a9ac23359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.122337 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1111/2233] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:38 2022] DELETE /identity/v3/projects/97c2098ba03c4d52a21233a6220887ca => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:39.123617 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24681f28-a10c-4b65-aa15-ca31990a5e28 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:39.143154 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24681f28-a10c-4b65-aa15-ca31990a5e28 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:39.234693 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9625ed-6802-4f87-bd78-0c9a9ac23359 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:39.236631 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-cc9625ed-6802-4f87-bd78-0c9a9ac23359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:39.311314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3614042-2bd2-42f5-915f-15a530db9b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:39.312132 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3614042-2bd2-42f5-915f-15a530db9b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:39.312415 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3614042-2bd2-42f5-915f-15a530db9b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:39.312689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3614042-2bd2-42f5-915f-15a530db9b5b admin admin] PATH_INFO: `/v3/users/e7675d7f486949c2a2be8ce9c9f79050` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:39.314187 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3614042-2bd2-42f5-915f-15a530db9b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7675d7f486949c2a2be8ce9c9f79050)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:39.316358 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3614042-2bd2-42f5-915f-15a530db9b5b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:39.324910 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:39.390510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9625ed-6802-4f87-bd78-0c9a9ac23359 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:39.403487 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb335d-247e-4aee-8116-189f908ecea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:39.404455 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb335d-247e-4aee-8116-189f908ecea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:39.405367 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb335d-247e-4aee-8116-189f908ecea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:39.405726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb335d-247e-4aee-8116-189f908ecea4 admin admin] PATH_INFO: `/v3/users/d8784f1930b74680bbbe82124dd14672` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:39.405971 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c3614042-2bd2-42f5-915f-15a530db9b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7675d7f486949c2a2be8ce9c9f79050'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.406857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c3614042-2bd2-42f5-915f-15a530db9b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7675d7f486949c2a2be8ce9c9f79050'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.407338 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb335d-247e-4aee-8116-189f908ecea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8784f1930b74680bbbe82124dd14672)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:39.407965 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c3614042-2bd2-42f5-915f-15a530db9b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7675d7f486949c2a2be8ce9c9f79050'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.410274 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb335d-247e-4aee-8116-189f908ecea4 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:39.429964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c3614042-2bd2-42f5-915f-15a530db9b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7675d7f486949c2a2be8ce9c9f79050'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.441533 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c3614042-2bd2-42f5-915f-15a530db9b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7675d7f486949c2a2be8ce9c9f79050'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.474928 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1123/2234] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:39 2022] DELETE /identity/v3/users/e7675d7f486949c2a2be8ce9c9f79050 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:39.482512 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3614042-2bd2-42f5-915f-15a530db9b5b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:39.485489 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c3614042-2bd2-42f5-915f-15a530db9b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:39.498664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-acbb335d-247e-4aee-8116-189f908ecea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8784f1930b74680bbbe82124dd14672'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.500957 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-acbb335d-247e-4aee-8116-189f908ecea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8784f1930b74680bbbe82124dd14672'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.501902 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-acbb335d-247e-4aee-8116-189f908ecea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8784f1930b74680bbbe82124dd14672'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.546265 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-acbb335d-247e-4aee-8116-189f908ecea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8784f1930b74680bbbe82124dd14672'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.560287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-acbb335d-247e-4aee-8116-189f908ecea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8784f1930b74680bbbe82124dd14672'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.607631 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1112/2235] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:39 2022] DELETE /identity/v3/users/d8784f1930b74680bbbe82124dd14672 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:16:39.609140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f976f7-66cd-4522-9d4c-e5eb339bcd08 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:39.609666 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f976f7-66cd-4522-9d4c-e5eb339bcd08 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:39.609822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f976f7-66cd-4522-9d4c-e5eb339bcd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:39.625907 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3614042-2bd2-42f5-915f-15a530db9b5b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:39.648177 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-88f976f7-66cd-4522-9d4c-e5eb339bcd08 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:39.650456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-88f976f7-66cd-4522-9d4c-e5eb339bcd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:39.751999 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0ebf1-b6f5-4e2d-beb4-17fef387c0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:39.752947 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0ebf1-b6f5-4e2d-beb4-17fef387c0d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:39.753220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0ebf1-b6f5-4e2d-beb4-17fef387c0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:39.753488 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0ebf1-b6f5-4e2d-beb4-17fef387c0d9 admin admin] PATH_INFO: `/v3/users/d054836ec0794823aaf005a35e8cae88` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:39.757348 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0ebf1-b6f5-4e2d-beb4-17fef387c0d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d054836ec0794823aaf005a35e8cae88)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:39.759936 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0ebf1-b6f5-4e2d-beb4-17fef387c0d9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:39.772595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:39.799933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1113/2236] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:39.814692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f976f7-66cd-4522-9d4c-e5eb339bcd08 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:39.817001 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-88f976f7-66cd-4522-9d4c-e5eb339bcd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:39.884388 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:39.902657 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dfa0ebf1-b6f5-4e2d-beb4-17fef387c0d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd054836ec0794823aaf005a35e8cae88'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.903609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dfa0ebf1-b6f5-4e2d-beb4-17fef387c0d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd054836ec0794823aaf005a35e8cae88'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.906062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dfa0ebf1-b6f5-4e2d-beb4-17fef387c0d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd054836ec0794823aaf005a35e8cae88'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.921892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f976f7-66cd-4522-9d4c-e5eb339bcd08 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:39.927334 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed82fc-df14-473c-91c1-499682869316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:39.927813 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dfa0ebf1-b6f5-4e2d-beb4-17fef387c0d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd054836ec0794823aaf005a35e8cae88'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.928196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed82fc-df14-473c-91c1-499682869316 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:39.928598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed82fc-df14-473c-91c1-499682869316 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:39.928941 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed82fc-df14-473c-91c1-499682869316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:39.931894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-2bed82fc-df14-473c-91c1-499682869316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:39.949833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dfa0ebf1-b6f5-4e2d-beb4-17fef387c0d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd054836ec0794823aaf005a35e8cae88'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:39.967509 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed82fc-df14-473c-91c1-499682869316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:39.970030 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed82fc-df14-473c-91c1-499682869316 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:39.991203 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1124/2237] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:39 2022] DELETE /identity/v3/users/d054836ec0794823aaf005a35e8cae88 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:39.992106 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0ebf1-b6f5-4e2d-beb4-17fef387c0d9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:39.997635 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dfa0ebf1-b6f5-4e2d-beb4-17fef387c0d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:39.999933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1114/2238] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:40.002437 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9445be7-1142-4fab-bcfc-c9a0182bacea None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:40.002735 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9445be7-1142-4fab-bcfc-c9a0182bacea None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:40.003019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9445be7-1142-4fab-bcfc-c9a0182bacea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:40.067433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-a9445be7-1142-4fab-bcfc-c9a0182bacea None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:40.069277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a9445be7-1142-4fab-bcfc-c9a0182bacea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:40.214876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1115/2239] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:40.230134 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9445be7-1142-4fab-bcfc-c9a0182bacea None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:40.231945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a9445be7-1142-4fab-bcfc-c9a0182bacea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:40.245512 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0ebf1-b6f5-4e2d-beb4-17fef387c0d9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:40.251342 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d625bdb-7564-46e0-a997-69cfcb52d353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:40.252215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d625bdb-7564-46e0-a997-69cfcb52d353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:40.252546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d625bdb-7564-46e0-a997-69cfcb52d353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:40.252822 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d625bdb-7564-46e0-a997-69cfcb52d353 admin admin] PATH_INFO: `/v3/projects/0a214e67d653423a89593019afba2293` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:40.254261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d625bdb-7564-46e0-a997-69cfcb52d353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a214e67d653423a89593019afba2293)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:40.257579 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d625bdb-7564-46e0-a997-69cfcb52d353 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:40.354197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9445be7-1142-4fab-bcfc-c9a0182bacea None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:40.354969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9d625bdb-7564-46e0-a997-69cfcb52d353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a214e67d653423a89593019afba2293', 'request_id': 'req-9d625bdb-7564-46e0-a997-69cfcb52d353'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:40.371732 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9d625bdb-7564-46e0-a997-69cfcb52d353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a214e67d653423a89593019afba2293', 'request_id': 'req-9d625bdb-7564-46e0-a997-69cfcb52d353'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:40.385949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9d625bdb-7564-46e0-a997-69cfcb52d353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a214e67d653423a89593019afba2293', 'request_id': 'req-9d625bdb-7564-46e0-a997-69cfcb52d353'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:40.415450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9d625bdb-7564-46e0-a997-69cfcb52d353 admin admin] The token cache is being invalidate because project 0a214e67d653423a89593019afba2293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:40.415450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9d625bdb-7564-46e0-a997-69cfcb52d353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:40.417627 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9d625bdb-7564-46e0-a997-69cfcb52d353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:40.423482 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1125/2240] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:39 2022] DELETE /identity/v3/projects/0a214e67d653423a89593019afba2293 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:40.424980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5f3e-a5c8-439c-885f-60bd3fd6f245 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:40.425785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5f3e-a5c8-439c-885f-60bd3fd6f245 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:40.427889 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5f3e-a5c8-439c-885f-60bd3fd6f245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:40.477105 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-666b5f3e-a5c8-439c-885f-60bd3fd6f245 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:40.482062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-666b5f3e-a5c8-439c-885f-60bd3fd6f245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:40.502379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:40.516074 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5844ea-29a4-40f1-9a13-3bbacfc31fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:40.517212 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5844ea-29a4-40f1-9a13-3bbacfc31fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:40.517786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5844ea-29a4-40f1-9a13-3bbacfc31fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:40.518443 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5844ea-29a4-40f1-9a13-3bbacfc31fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:40.524929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6d5844ea-29a4-40f1-9a13-3bbacfc31fc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:40.610969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:40.706984 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1126/2241] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:40.708195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5844ea-29a4-40f1-9a13-3bbacfc31fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:40.710037 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5844ea-29a4-40f1-9a13-3bbacfc31fc2 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:40.718250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b5f3e-a5c8-439c-885f-60bd3fd6f245 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:40.723308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-666b5f3e-a5c8-439c-885f-60bd3fd6f245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:40.734236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1116/2242] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:16:40.736324 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db44ae-597d-4db8-b4dc-6176ffc02dbb None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:40.736896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db44ae-597d-4db8-b4dc-6176ffc02dbb None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:40.737431 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db44ae-597d-4db8-b4dc-6176ffc02dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:40.757303 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b5f3e-a5c8-439c-885f-60bd3fd6f245 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:40.772031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-72db44ae-597d-4db8-b4dc-6176ffc02dbb None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:40.773581 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-72db44ae-597d-4db8-b4dc-6176ffc02dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:40.777880 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573a17b-7c4e-4b33-b86e-cb6041543608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:40.778795 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573a17b-7c4e-4b33-b86e-cb6041543608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:40.779073 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573a17b-7c4e-4b33-b86e-cb6041543608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:40.779343 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573a17b-7c4e-4b33-b86e-cb6041543608 admin admin] PATH_INFO: `/v3/projects/4d6c46b1b2f5442db735ba5946a5d332` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:40.786301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573a17b-7c4e-4b33-b86e-cb6041543608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d6c46b1b2f5442db735ba5946a5d332)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:40.788745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1117/2243] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:40.792176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573a17b-7c4e-4b33-b86e-cb6041543608 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:40.793756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db44ae-597d-4db8-b4dc-6176ffc02dbb None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:40.814745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db44ae-597d-4db8-b4dc-6176ffc02dbb None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:40.826210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a662d-1d34-4748-80df-9fcea1f89548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:40.827221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a662d-1d34-4748-80df-9fcea1f89548 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:40.827670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a662d-1d34-4748-80df-9fcea1f89548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:40.828112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a662d-1d34-4748-80df-9fcea1f89548 admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:40.829147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a662d-1d34-4748-80df-9fcea1f89548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:16:40.829551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a662d-1d34-4748-80df-9fcea1f89548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:40.831745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a662d-1d34-4748-80df-9fcea1f89548 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:40.870149 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1118/2244] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:16:40.871246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a662d-1d34-4748-80df-9fcea1f89548 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:40.874022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1573a17b-7c4e-4b33-b86e-cb6041543608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d6c46b1b2f5442db735ba5946a5d332', 'request_id': 'req-1573a17b-7c4e-4b33-b86e-cb6041543608'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:40.880186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1573a17b-7c4e-4b33-b86e-cb6041543608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d6c46b1b2f5442db735ba5946a5d332', 'request_id': 'req-1573a17b-7c4e-4b33-b86e-cb6041543608'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:40.887138 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1573a17b-7c4e-4b33-b86e-cb6041543608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d6c46b1b2f5442db735ba5946a5d332', 'request_id': 'req-1573a17b-7c4e-4b33-b86e-cb6041543608'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:40.895517 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a662d-1d34-4748-80df-9fcea1f89548 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:40.903721 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1573a17b-7c4e-4b33-b86e-cb6041543608 admin admin] The token cache is being invalidate because project 4d6c46b1b2f5442db735ba5946a5d332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:40.904372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1573a17b-7c4e-4b33-b86e-cb6041543608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:40.905297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1573a17b-7c4e-4b33-b86e-cb6041543608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:40.907528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1127/2245] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:40 2022] DELETE /identity/v3/projects/4d6c46b1b2f5442db735ba5946a5d332 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:40.911137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573a17b-7c4e-4b33-b86e-cb6041543608 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:40.913082 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1573a17b-7c4e-4b33-b86e-cb6041543608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:40.994277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9179aed-0c3f-431c-9b66-a45d912aa945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:40.995654 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9179aed-0c3f-431c-9b66-a45d912aa945 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:40.996084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9179aed-0c3f-431c-9b66-a45d912aa945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:40.996500 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9179aed-0c3f-431c-9b66-a45d912aa945 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:40.997355 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9179aed-0c3f-431c-9b66-a45d912aa945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:40.999578 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9179aed-0c3f-431c-9b66-a45d912aa945 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:41.014175 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573a17b-7c4e-4b33-b86e-cb6041543608 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:41.026352 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe285a-2e26-4b0a-9dda-c762ca60fa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:41.029144 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe285a-2e26-4b0a-9dda-c762ca60fa16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:41.031027 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe285a-2e26-4b0a-9dda-c762ca60fa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:41.031373 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe285a-2e26-4b0a-9dda-c762ca60fa16 admin admin] PATH_INFO: `/v3/users/325ff5da5ebf471ebd8fb5dd39bd24be` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:41.034615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe285a-2e26-4b0a-9dda-c762ca60fa16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=325ff5da5ebf471ebd8fb5dd39bd24be)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:41.036819 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe285a-2e26-4b0a-9dda-c762ca60fa16 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:41.049422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1119/2246] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:16:40 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:16:41.051089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9179aed-0c3f-431c-9b66-a45d912aa945 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:41.056814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c9179aed-0c3f-431c-9b66-a45d912aa945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:41.140863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9179aed-0c3f-431c-9b66-a45d912aa945 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:41.141260 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9abe285a-2e26-4b0a-9dda-c762ca60fa16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325ff5da5ebf471ebd8fb5dd39bd24be'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:41.142368 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9abe285a-2e26-4b0a-9dda-c762ca60fa16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325ff5da5ebf471ebd8fb5dd39bd24be'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:41.143530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9abe285a-2e26-4b0a-9dda-c762ca60fa16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325ff5da5ebf471ebd8fb5dd39bd24be'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:41.147509 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc9ab9-9ec5-4f1f-ac4b-a19e05b434ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:41.148531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc9ab9-9ec5-4f1f-ac4b-a19e05b434ea admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:41.149134 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc9ab9-9ec5-4f1f-ac4b-a19e05b434ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:41.149646 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc9ab9-9ec5-4f1f-ac4b-a19e05b434ea admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:41.150523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc9ab9-9ec5-4f1f-ac4b-a19e05b434ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:41.152801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc9ab9-9ec5-4f1f-ac4b-a19e05b434ea admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:41.178796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9abe285a-2e26-4b0a-9dda-c762ca60fa16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325ff5da5ebf471ebd8fb5dd39bd24be'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:41.179161 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:41.183239 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:41.201760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9abe285a-2e26-4b0a-9dda-c762ca60fa16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325ff5da5ebf471ebd8fb5dd39bd24be'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:41.205647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1120/2247] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:16:41 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:41.210536 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc9ab9-9ec5-4f1f-ac4b-a19e05b434ea admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:41.213619 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d8dc9ab9-9ec5-4f1f-ac4b-a19e05b434ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:41.230147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc9ab9-9ec5-4f1f-ac4b-a19e05b434ea admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:41.236550 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d95758-b3cc-4a30-9542-a5f1c5dd5214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:41.237301 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d95758-b3cc-4a30-9542-a5f1c5dd5214 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:41.237567 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d95758-b3cc-4a30-9542-a5f1c5dd5214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:41.237958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d95758-b3cc-4a30-9542-a5f1c5dd5214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:41.238782 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d95758-b3cc-4a30-9542-a5f1c5dd5214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:41.240806 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d95758-b3cc-4a30-9542-a5f1c5dd5214 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:41.253366 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1128/2248] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:40 2022] DELETE /identity/v3/users/325ff5da5ebf471ebd8fb5dd39bd24be => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:16:41.257260 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1121/2249] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:16:41.262609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe285a-2e26-4b0a-9dda-c762ca60fa16 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:41.291886 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d95758-b3cc-4a30-9542-a5f1c5dd5214 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:41.294360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-00d95758-b3cc-4a30-9542-a5f1c5dd5214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:41.314818 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d95758-b3cc-4a30-9542-a5f1c5dd5214 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:41.410862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d902001-1459-4d0c-9332-e55cdb9ea15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:41.412152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d902001-1459-4d0c-9332-e55cdb9ea15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:41.413821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d902001-1459-4d0c-9332-e55cdb9ea15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:41.415490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d902001-1459-4d0c-9332-e55cdb9ea15d admin admin] PATH_INFO: `/v3/projects/ec30ba5559944ea5a691f413fc15b753` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:41.417273 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d902001-1459-4d0c-9332-e55cdb9ea15d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec30ba5559944ea5a691f413fc15b753)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:41.421236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d902001-1459-4d0c-9332-e55cdb9ea15d admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:41.432492 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe285a-2e26-4b0a-9dda-c762ca60fa16 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:41.452235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d3e9d-e3f8-4507-9bd1-faa5a795c511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:41.453057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d3e9d-e3f8-4507-9bd1-faa5a795c511 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:41.453532 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d3e9d-e3f8-4507-9bd1-faa5a795c511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:41.454851 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d3e9d-e3f8-4507-9bd1-faa5a795c511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:41.455769 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d3e9d-e3f8-4507-9bd1-faa5a795c511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:41.461003 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d3e9d-e3f8-4507-9bd1-faa5a795c511 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:41.481160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1129/2250] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:41.487370 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d3e9d-e3f8-4507-9bd1-faa5a795c511 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:41.507948 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d3e9d-e3f8-4507-9bd1-faa5a795c511 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:41.512984 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4d902001-1459-4d0c-9332-e55cdb9ea15d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec30ba5559944ea5a691f413fc15b753', 'request_id': 'req-4d902001-1459-4d0c-9332-e55cdb9ea15d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:41.531574 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4d902001-1459-4d0c-9332-e55cdb9ea15d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec30ba5559944ea5a691f413fc15b753', 'request_id': 'req-4d902001-1459-4d0c-9332-e55cdb9ea15d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:41.541066 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4d902001-1459-4d0c-9332-e55cdb9ea15d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec30ba5559944ea5a691f413fc15b753', 'request_id': 'req-4d902001-1459-4d0c-9332-e55cdb9ea15d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:41.557574 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4d902001-1459-4d0c-9332-e55cdb9ea15d admin admin] The token cache is being invalidate because project ec30ba5559944ea5a691f413fc15b753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:41.558200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4d902001-1459-4d0c-9332-e55cdb9ea15d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:41.559081 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4d902001-1459-4d0c-9332-e55cdb9ea15d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:41.562200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1122/2251] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:41 2022] DELETE /identity/v3/projects/ec30ba5559944ea5a691f413fc15b753 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:41.566906 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf78fe-db95-4c54-91b4-8dd513ec5d00 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:41.567476 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf78fe-db95-4c54-91b4-8dd513ec5d00 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:41.567938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf78fe-db95-4c54-91b4-8dd513ec5d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:41.601569 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-bfaf78fe-db95-4c54-91b4-8dd513ec5d00 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:41.604468 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-bfaf78fe-db95-4c54-91b4-8dd513ec5d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:41.664105 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5c0d2-3d5c-45c0-8c5e-e26fb012dfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:41.666559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5c0d2-3d5c-45c0-8c5e-e26fb012dfcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:41.667077 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5c0d2-3d5c-45c0-8c5e-e26fb012dfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:41.667732 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5c0d2-3d5c-45c0-8c5e-e26fb012dfcd admin admin] PATH_INFO: `/v3/projects/4aedca01b0914289bce6c239414128b3/users/554af75ce52a4b129709eba93d878127/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:41.714624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1123/2252] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:41.714847 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5c0d2-3d5c-45c0-8c5e-e26fb012dfcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aedca01b0914289bce6c239414128b3, user_id=554af75ce52a4b129709eba93d878127, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:41.717413 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5c0d2-3d5c-45c0-8c5e-e26fb012dfcd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:41.723880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee5311-96b1-44cc-a69b-8ceb6b244c01 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:41.724510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee5311-96b1-44cc-a69b-8ceb6b244c01 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:41.724996 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee5311-96b1-44cc-a69b-8ceb6b244c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:41.749348 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1130/2253] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:41 2022] PUT /identity/v3/projects/4aedca01b0914289bce6c239414128b3/users/554af75ce52a4b129709eba93d878127/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:41.759935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-28ee5311-96b1-44cc-a69b-8ceb6b244c01 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:41.762615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefd39e-2568-463a-b722-3fc1c3777137 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:41.762904 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefd39e-2568-463a-b722-3fc1c3777137 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:41.763211 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefd39e-2568-463a-b722-3fc1c3777137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:41.763963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-28ee5311-96b1-44cc-a69b-8ceb6b244c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:41.772105 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:41.823728 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-edefd39e-2568-463a-b722-3fc1c3777137 None None] MFA Rules not processed for user `554af75ce52a4b129709eba93d878127`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:41.824972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-edefd39e-2568-463a-b722-3fc1c3777137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:41.901083 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1124/2254] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:41.901083 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee5311-96b1-44cc-a69b-8ceb6b244c01 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:41.901949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-28ee5311-96b1-44cc-a69b-8ceb6b244c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:41.924202 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee5311-96b1-44cc-a69b-8ceb6b244c01 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:41.938408 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:41.942282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3463b09-25e4-4ecb-bde7-5d81757286a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:41.943624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3463b09-25e4-4ecb-bde7-5d81757286a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:41.943904 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3463b09-25e4-4ecb-bde7-5d81757286a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:41.945827 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3463b09-25e4-4ecb-bde7-5d81757286a5 admin admin] PATH_INFO: `/v3/projects/5527fed5bfed466a8dc78ffcfe9dcb5e` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:41.949541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3463b09-25e4-4ecb-bde7-5d81757286a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5527fed5bfed466a8dc78ffcfe9dcb5e)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:41.955097 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3463b09-25e4-4ecb-bde7-5d81757286a5 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:41.968039 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1131/2255] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:41.971219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefd39e-2568-463a-b722-3fc1c3777137 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:41.988066 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefd39e-2568-463a-b722-3fc1c3777137 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:41.995068 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3ccbb-8764-4844-9dc8-1061fed05b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:41.996378 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3ccbb-8764-4844-9dc8-1061fed05b4f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:41.996818 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3ccbb-8764-4844-9dc8-1061fed05b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:41.997198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3ccbb-8764-4844-9dc8-1061fed05b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:41.998188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3ccbb-8764-4844-9dc8-1061fed05b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:16:41.998617 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3ccbb-8764-4844-9dc8-1061fed05b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:42.000620 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3ccbb-8764-4844-9dc8-1061fed05b4f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:42.019083 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1132/2256] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:16:42.022541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3ccbb-8764-4844-9dc8-1061fed05b4f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:42.024650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-46f3ccbb-8764-4844-9dc8-1061fed05b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:42.076026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e3463b09-25e4-4ecb-bde7-5d81757286a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5527fed5bfed466a8dc78ffcfe9dcb5e', 'request_id': 'req-e3463b09-25e4-4ecb-bde7-5d81757286a5'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:42.096986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e3463b09-25e4-4ecb-bde7-5d81757286a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5527fed5bfed466a8dc78ffcfe9dcb5e', 'request_id': 'req-e3463b09-25e4-4ecb-bde7-5d81757286a5'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:42.119472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e3463b09-25e4-4ecb-bde7-5d81757286a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5527fed5bfed466a8dc78ffcfe9dcb5e', 'request_id': 'req-e3463b09-25e4-4ecb-bde7-5d81757286a5'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:42.153221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e3463b09-25e4-4ecb-bde7-5d81757286a5 admin admin] The token cache is being invalidate because project 5527fed5bfed466a8dc78ffcfe9dcb5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:42.153570 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e3463b09-25e4-4ecb-bde7-5d81757286a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:42.154819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e3463b09-25e4-4ecb-bde7-5d81757286a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:42.156300 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3ccbb-8764-4844-9dc8-1061fed05b4f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:42.160263 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1125/2257] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:41 2022] DELETE /identity/v3/projects/5527fed5bfed466a8dc78ffcfe9dcb5e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:42.162188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3463b09-25e4-4ecb-bde7-5d81757286a5 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:42.175003 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-e3463b09-25e4-4ecb-bde7-5d81757286a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:42.247613 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83e483-5da6-495d-b911-80aa3320946e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:42.248889 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83e483-5da6-495d-b911-80aa3320946e service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:42.249511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83e483-5da6-495d-b911-80aa3320946e service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:42.249982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83e483-5da6-495d-b911-80aa3320946e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:42.252353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5e83e483-5da6-495d-b911-80aa3320946e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:42.325065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3463b09-25e4-4ecb-bde7-5d81757286a5 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:42.331384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2646f9-5464-4112-af9b-ec93b506d06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:42.333722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2646f9-5464-4112-af9b-ec93b506d06b admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:42.334203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2646f9-5464-4112-af9b-ec93b506d06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:42.334850 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2646f9-5464-4112-af9b-ec93b506d06b admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:42.335718 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2646f9-5464-4112-af9b-ec93b506d06b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:42.338855 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2646f9-5464-4112-af9b-ec93b506d06b admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:42.398332 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1126/2258] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:16:42 2022] POST /identity/v3/projects => generated 385 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:42.399981 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2646f9-5464-4112-af9b-ec93b506d06b admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:42.401882 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-de2646f9-5464-4112-af9b-ec93b506d06b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:42.410825 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83e483-5da6-495d-b911-80aa3320946e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:42.415594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83e483-5da6-495d-b911-80aa3320946e service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:42.429596 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1133/2259] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:42.430771 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83e483-5da6-495d-b911-80aa3320946e service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:42.454799 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:42.456334 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83e483-5da6-495d-b911-80aa3320946e service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:42.514097 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2646f9-5464-4112-af9b-ec93b506d06b admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:42.520800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947f1f4-0fab-4569-b762-4d2e7ae653ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:42.521697 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947f1f4-0fab-4569-b762-4d2e7ae653ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:42.521981 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947f1f4-0fab-4569-b762-4d2e7ae653ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:42.522287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947f1f4-0fab-4569-b762-4d2e7ae653ac admin admin] PATH_INFO: `/v3/users/affe479b6d114108aa21c6f4a5d08d05` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:42.523637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947f1f4-0fab-4569-b762-4d2e7ae653ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=affe479b6d114108aa21c6f4a5d08d05)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:42.528661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947f1f4-0fab-4569-b762-4d2e7ae653ac admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:42.581625 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:42.600408 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1af12-1d0b-4374-81b1-afd0eeb0e676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:42.601229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1af12-1d0b-4374-81b1-afd0eeb0e676 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:42.601706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1af12-1d0b-4374-81b1-afd0eeb0e676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:42.601993 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1af12-1d0b-4374-81b1-afd0eeb0e676 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:42.602805 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1af12-1d0b-4374-81b1-afd0eeb0e676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:42.606230 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1af12-1d0b-4374-81b1-afd0eeb0e676 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:42.637634 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1134/2260] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:16:42 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:42.641650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1af12-1d0b-4374-81b1-afd0eeb0e676 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:42.654971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-f947f1f4-0fab-4569-b762-4d2e7ae653ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'affe479b6d114108aa21c6f4a5d08d05'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:42.655677 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-f947f1f4-0fab-4569-b762-4d2e7ae653ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'affe479b6d114108aa21c6f4a5d08d05'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:42.655825 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1af12-1d0b-4374-81b1-afd0eeb0e676 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:42.656356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-f947f1f4-0fab-4569-b762-4d2e7ae653ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'affe479b6d114108aa21c6f4a5d08d05'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:42.668337 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c10b90-f537-4df9-84fb-fae038c4df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:42.668337 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c10b90-f537-4df9-84fb-fae038c4df42 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:42.670367 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c10b90-f537-4df9-84fb-fae038c4df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:42.670987 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c10b90-f537-4df9-84fb-fae038c4df42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:42.673514 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c10b90-f537-4df9-84fb-fae038c4df42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:42.675574 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-f947f1f4-0fab-4569-b762-4d2e7ae653ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'affe479b6d114108aa21c6f4a5d08d05'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:42.677828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c10b90-f537-4df9-84fb-fae038c4df42 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:42.692609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-f947f1f4-0fab-4569-b762-4d2e7ae653ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'affe479b6d114108aa21c6f4a5d08d05'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:42.707037 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1135/2261] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:42.712176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c10b90-f537-4df9-84fb-fae038c4df42 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:42.715776 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-84c10b90-f537-4df9-84fb-fae038c4df42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:42.725653 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1127/2262] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:42 2022] DELETE /identity/v3/users/affe479b6d114108aa21c6f4a5d08d05 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:42.738707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c10b90-f537-4df9-84fb-fae038c4df42 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:42.866019 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1185dcc-bb95-441f-9b18-6e93356697f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:42.867065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1185dcc-bb95-441f-9b18-6e93356697f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:42.867618 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1185dcc-bb95-441f-9b18-6e93356697f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:42.868705 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1185dcc-bb95-441f-9b18-6e93356697f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:42.869873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1185dcc-bb95-441f-9b18-6e93356697f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:42.873418 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1185dcc-bb95-441f-9b18-6e93356697f8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:42.896781 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1136/2263] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:42.903063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947f1f4-0fab-4569-b762-4d2e7ae653ac admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:42.949638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947f1f4-0fab-4569-b762-4d2e7ae653ac admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:42.968125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61623b38-71b9-4b78-85a1-310385ead9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:42.970209 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61623b38-71b9-4b78-85a1-310385ead9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:42.970546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61623b38-71b9-4b78-85a1-310385ead9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:42.970794 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61623b38-71b9-4b78-85a1-310385ead9b5 admin admin] PATH_INFO: `/v3/projects/a806b437707e4d319493eb1d02ee2d8a/users/32941ba0f04749a189cd031c1f3da14f/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:43.039319 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61623b38-71b9-4b78-85a1-310385ead9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a806b437707e4d319493eb1d02ee2d8a, user_id=32941ba0f04749a189cd031c1f3da14f, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:43.043256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61623b38-71b9-4b78-85a1-310385ead9b5 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:43.088090 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1128/2264] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:42 2022] PUT /identity/v3/projects/a806b437707e4d319493eb1d02ee2d8a/users/32941ba0f04749a189cd031c1f3da14f/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:43.092882 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0052e-bf94-4461-88e2-2410ade6e8d1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:43.093594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0052e-bf94-4461-88e2-2410ade6e8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:43.094069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0052e-bf94-4461-88e2-2410ade6e8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:43.155390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a8c0052e-bf94-4461-88e2-2410ade6e8d1 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:43.157972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a8c0052e-bf94-4461-88e2-2410ade6e8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:43.294732 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1137/2265] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:43.309782 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61623b38-71b9-4b78-85a1-310385ead9b5 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:43.311975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-61623b38-71b9-4b78-85a1-310385ead9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:43.400837 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61623b38-71b9-4b78-85a1-310385ead9b5 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:43.466821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c736194-b039-49c1-a8b2-bfd2e1731324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:43.467660 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c736194-b039-49c1-a8b2-bfd2e1731324 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:43.468067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c736194-b039-49c1-a8b2-bfd2e1731324 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:43.468749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c736194-b039-49c1-a8b2-bfd2e1731324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:43.502050 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c736194-b039-49c1-a8b2-bfd2e1731324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:43.507784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c736194-b039-49c1-a8b2-bfd2e1731324 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:43.575720 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1129/2266] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:16:43.672018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0052e-bf94-4461-88e2-2410ade6e8d1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:43.687631 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a8c0052e-bf94-4461-88e2-2410ade6e8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:43.700875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0052e-bf94-4461-88e2-2410ade6e8d1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:43.705745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6a6c7-4bf7-446a-a1aa-3527b8fd1f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:43.706658 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6a6c7-4bf7-446a-a1aa-3527b8fd1f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:43.706941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6a6c7-4bf7-446a-a1aa-3527b8fd1f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:43.707217 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6a6c7-4bf7-446a-a1aa-3527b8fd1f14 admin admin] PATH_INFO: `/v3/projects/717b45f7ad734939a9495e6ebf61707d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:43.708453 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6a6c7-4bf7-446a-a1aa-3527b8fd1f14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=717b45f7ad734939a9495e6ebf61707d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:43.710410 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6a6c7-4bf7-446a-a1aa-3527b8fd1f14 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:43.774777 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b4b6a6c7-4bf7-446a-a1aa-3527b8fd1f14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717b45f7ad734939a9495e6ebf61707d', 'request_id': 'req-b4b6a6c7-4bf7-446a-a1aa-3527b8fd1f14'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:43.781629 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b4b6a6c7-4bf7-446a-a1aa-3527b8fd1f14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717b45f7ad734939a9495e6ebf61707d', 'request_id': 'req-b4b6a6c7-4bf7-446a-a1aa-3527b8fd1f14'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:43.783808 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:43.790879 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b4b6a6c7-4bf7-446a-a1aa-3527b8fd1f14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717b45f7ad734939a9495e6ebf61707d', 'request_id': 'req-b4b6a6c7-4bf7-446a-a1aa-3527b8fd1f14'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:43.810519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b4b6a6c7-4bf7-446a-a1aa-3527b8fd1f14 admin admin] The token cache is being invalidate because project 717b45f7ad734939a9495e6ebf61707d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:43.810948 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b4b6a6c7-4bf7-446a-a1aa-3527b8fd1f14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:43.812320 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b4b6a6c7-4bf7-446a-a1aa-3527b8fd1f14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:43.814546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1138/2267] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:43 2022] DELETE /identity/v3/projects/717b45f7ad734939a9495e6ebf61707d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:49.283344 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c736194-b039-49c1-a8b2-bfd2e1731324 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:49.285594 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-1c736194-b039-49c1-a8b2-bfd2e1731324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:49.309260 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c736194-b039-49c1-a8b2-bfd2e1731324 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:49.342018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:49.451834 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428d950-0f63-4919-a6ac-55bf06f04b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:49.453297 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428d950-0f63-4919-a6ac-55bf06f04b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:49.453718 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428d950-0f63-4919-a6ac-55bf06f04b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:49.454828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428d950-0f63-4919-a6ac-55bf06f04b70 admin admin] PATH_INFO: `/v3/users/554af75ce52a4b129709eba93d878127` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:49.456628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428d950-0f63-4919-a6ac-55bf06f04b70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=554af75ce52a4b129709eba93d878127)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:49.458801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428d950-0f63-4919-a6ac-55bf06f04b70 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:49.571686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c428d950-0f63-4919-a6ac-55bf06f04b70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554af75ce52a4b129709eba93d878127'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:49.575042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c428d950-0f63-4919-a6ac-55bf06f04b70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554af75ce52a4b129709eba93d878127'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:49.578074 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c428d950-0f63-4919-a6ac-55bf06f04b70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554af75ce52a4b129709eba93d878127'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:49.604922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c428d950-0f63-4919-a6ac-55bf06f04b70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554af75ce52a4b129709eba93d878127'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:49.640864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c428d950-0f63-4919-a6ac-55bf06f04b70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554af75ce52a4b129709eba93d878127'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:49.679206 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3c876-8fde-4fd6-baba-9699e8357dfd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:49.680193 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3c876-8fde-4fd6-baba-9699e8357dfd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:49.681469 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3c876-8fde-4fd6-baba-9699e8357dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:49.684866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1130/2268] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:49 2022] DELETE /identity/v3/users/554af75ce52a4b129709eba93d878127 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:49.720035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-02c3c876-8fde-4fd6-baba-9699e8357dfd None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:49.723104 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-02c3c876-8fde-4fd6-baba-9699e8357dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:49.813517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1139/2269] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:49.820459 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428d950-0f63-4919-a6ac-55bf06f04b70 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:49.822575 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c428d950-0f63-4919-a6ac-55bf06f04b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:49.901185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428d950-0f63-4919-a6ac-55bf06f04b70 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:49.907386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1460e6-2d10-4409-8be3-748e286251fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:49.908686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1460e6-2d10-4409-8be3-748e286251fd service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:49.909439 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1460e6-2d10-4409-8be3-748e286251fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:49.910107 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1460e6-2d10-4409-8be3-748e286251fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:49.923973 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1460e6-2d10-4409-8be3-748e286251fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:49.925937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1460e6-2d10-4409-8be3-748e286251fd service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:49.973307 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1131/2270] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:16:50.638205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3c876-8fde-4fd6-baba-9699e8357dfd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:50.639552 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-02c3c876-8fde-4fd6-baba-9699e8357dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:50.664526 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3c876-8fde-4fd6-baba-9699e8357dfd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:50.678525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358bdfe-e38f-490c-aef3-4b47da94a8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:50.679528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358bdfe-e38f-490c-aef3-4b47da94a8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:50.681235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358bdfe-e38f-490c-aef3-4b47da94a8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:50.681771 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358bdfe-e38f-490c-aef3-4b47da94a8b5 admin admin] PATH_INFO: `/v3/projects/4aedca01b0914289bce6c239414128b3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:50.685751 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358bdfe-e38f-490c-aef3-4b47da94a8b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aedca01b0914289bce6c239414128b3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:50.690686 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358bdfe-e38f-490c-aef3-4b47da94a8b5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:50.854063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b358bdfe-e38f-490c-aef3-4b47da94a8b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aedca01b0914289bce6c239414128b3', 'request_id': 'req-b358bdfe-e38f-490c-aef3-4b47da94a8b5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:50.880946 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b358bdfe-e38f-490c-aef3-4b47da94a8b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aedca01b0914289bce6c239414128b3', 'request_id': 'req-b358bdfe-e38f-490c-aef3-4b47da94a8b5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:50.894814 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b358bdfe-e38f-490c-aef3-4b47da94a8b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aedca01b0914289bce6c239414128b3', 'request_id': 'req-b358bdfe-e38f-490c-aef3-4b47da94a8b5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:50.920652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b358bdfe-e38f-490c-aef3-4b47da94a8b5 admin admin] The token cache is being invalidate because project 4aedca01b0914289bce6c239414128b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:16:50.920989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b358bdfe-e38f-490c-aef3-4b47da94a8b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:50.926517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b358bdfe-e38f-490c-aef3-4b47da94a8b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:50.931866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1140/2271] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:16:50 2022] DELETE /identity/v3/projects/4aedca01b0914289bce6c239414128b3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:50.936916 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc5bd6-f8cd-452f-a672-7c4a79f71068 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:50.937527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc5bd6-f8cd-452f-a672-7c4a79f71068 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:50.937527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc5bd6-f8cd-452f-a672-7c4a79f71068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:50.995983 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-eafc5bd6-f8cd-452f-a672-7c4a79f71068 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:51.000206 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-eafc5bd6-f8cd-452f-a672-7c4a79f71068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:51.084543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:51.147896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1132/2272] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:51.224301 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224b329-15cc-4486-a4ca-9a7fa8ee0ccc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:51.224730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224b329-15cc-4486-a4ca-9a7fa8ee0ccc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:51.225078 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224b329-15cc-4486-a4ca-9a7fa8ee0ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:51.289436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4224b329-15cc-4486-a4ca-9a7fa8ee0ccc None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:51.296061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4224b329-15cc-4486-a4ca-9a7fa8ee0ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:51.319814 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1141/2273] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:51.321857 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc5bd6-f8cd-452f-a672-7c4a79f71068 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:51.335771 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc5bd6-f8cd-452f-a672-7c4a79f71068 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:51.350614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef167e-6271-4dca-92bc-52e8536aeebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:51.351796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef167e-6271-4dca-92bc-52e8536aeebb admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:51.352425 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef167e-6271-4dca-92bc-52e8536aeebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:51.353033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef167e-6271-4dca-92bc-52e8536aeebb admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:51.354030 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef167e-6271-4dca-92bc-52e8536aeebb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:16:51.354556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef167e-6271-4dca-92bc-52e8536aeebb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:51.359792 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef167e-6271-4dca-92bc-52e8536aeebb admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:51.397193 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1133/2274] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:16:51.398870 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224b329-15cc-4486-a4ca-9a7fa8ee0ccc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:51.413588 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224b329-15cc-4486-a4ca-9a7fa8ee0ccc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:51.428068 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccc5df-491b-458f-bc1d-482f3e46d750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:51.428876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccc5df-491b-458f-bc1d-482f3e46d750 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:51.429808 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccc5df-491b-458f-bc1d-482f3e46d750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:51.430206 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccc5df-491b-458f-bc1d-482f3e46d750 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:51.431040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccc5df-491b-458f-bc1d-482f3e46d750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:51.434791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccc5df-491b-458f-bc1d-482f3e46d750 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:51.522853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef167e-6271-4dca-92bc-52e8536aeebb admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:51.530527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1142/2275] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:16:51 2022] POST /identity/v3/projects => generated 399 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:51.538989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef167e-6271-4dca-92bc-52e8536aeebb admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:51.695897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a999ca-7068-41f1-af34-10f3e8f86df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:51.697167 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a999ca-7068-41f1-af34-10f3e8f86df1 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:51.697457 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a999ca-7068-41f1-af34-10f3e8f86df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:51.697735 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a999ca-7068-41f1-af34-10f3e8f86df1 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:51.698494 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a999ca-7068-41f1-af34-10f3e8f86df1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:51.700531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a999ca-7068-41f1-af34-10f3e8f86df1 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:51.750432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1134/2276] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:16:51 2022] POST /identity/v3/users => generated 300 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:51.754652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccc5df-491b-458f-bc1d-482f3e46d750 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:51.767781 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccc5df-491b-458f-bc1d-482f3e46d750 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:51.783511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed1e94-33d1-48ca-aa67-b2a95910c936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:51.784189 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed1e94-33d1-48ca-aa67-b2a95910c936 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:51.784472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed1e94-33d1-48ca-aa67-b2a95910c936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:51.784752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed1e94-33d1-48ca-aa67-b2a95910c936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:51.785487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed1e94-33d1-48ca-aa67-b2a95910c936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:51.787139 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed1e94-33d1-48ca-aa67-b2a95910c936 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:51.817923 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1143/2277] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:51.819849 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a999ca-7068-41f1-af34-10f3e8f86df1 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:51.841774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a999ca-7068-41f1-af34-10f3e8f86df1 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:51.852175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07d51d-5c03-4b81-86ca-15a47513fa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:51.853446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07d51d-5c03-4b81-86ca-15a47513fa7f admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:51.853732 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07d51d-5c03-4b81-86ca-15a47513fa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:51.854045 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07d51d-5c03-4b81-86ca-15a47513fa7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:51.854796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07d51d-5c03-4b81-86ca-15a47513fa7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:51.856480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07d51d-5c03-4b81-86ca-15a47513fa7f admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:51.885819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1135/2278] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:51.892252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed1e94-33d1-48ca-aa67-b2a95910c936 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:51.907113 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed1e94-33d1-48ca-aa67-b2a95910c936 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:51.917496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f51e96-125c-46c5-a87b-35eaa9c2df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:51.918418 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f51e96-125c-46c5-a87b-35eaa9c2df78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:51.918698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f51e96-125c-46c5-a87b-35eaa9c2df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:51.918968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f51e96-125c-46c5-a87b-35eaa9c2df78 admin admin] PATH_INFO: `/v3/projects/bbb71c27cfa34125a56b40a11880c0b9/users/d1a9b67f68624df8a4fca2101c49cdbd/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:51.947739 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f51e96-125c-46c5-a87b-35eaa9c2df78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb71c27cfa34125a56b40a11880c0b9, user_id=d1a9b67f68624df8a4fca2101c49cdbd, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:51.952269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f51e96-125c-46c5-a87b-35eaa9c2df78 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:51.973211 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1144/2279] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:51 2022] PUT /identity/v3/projects/bbb71c27cfa34125a56b40a11880c0b9/users/d1a9b67f68624df8a4fca2101c49cdbd/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:51.984070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b468f62-777b-4d14-9ec1-0aa76a560251 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:51.984571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b468f62-777b-4d14-9ec1-0aa76a560251 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:51.984571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b468f62-777b-4d14-9ec1-0aa76a560251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:52.037724 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-0b468f62-777b-4d14-9ec1-0aa76a560251 None None] MFA Rules not processed for user `d1a9b67f68624df8a4fca2101c49cdbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:52.054030 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-0b468f62-777b-4d14-9ec1-0aa76a560251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:52.120369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fcdc7-2d2f-4d85-8877-c4ba90730e5a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:52.121068 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fcdc7-2d2f-4d85-8877-c4ba90730e5a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:52.121282 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fcdc7-2d2f-4d85-8877-c4ba90730e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:52.198180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:52.258599 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4f2fcdc7-2d2f-4d85-8877-c4ba90730e5a None None] MFA Rules not processed for user `32941ba0f04749a189cd031c1f3da14f`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:52.270029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4f2fcdc7-2d2f-4d85-8877-c4ba90730e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:52.288790 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1136/2280] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:52.305089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b468f62-777b-4d14-9ec1-0aa76a560251 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:52.307749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-0b468f62-777b-4d14-9ec1-0aa76a560251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:52.374034 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:52.422891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b468f62-777b-4d14-9ec1-0aa76a560251 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:52.432464 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fcd86-8c31-4856-a933-262f4846b331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:52.433585 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fcd86-8c31-4856-a933-262f4846b331 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:52.435334 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fcd86-8c31-4856-a933-262f4846b331 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:52.435883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fcd86-8c31-4856-a933-262f4846b331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:52.460517 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fcd86-8c31-4856-a933-262f4846b331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:52.484677 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fcd86-8c31-4856-a933-262f4846b331 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:52.526050 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1137/2281] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:16:52.527411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1145/2282] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:52.531464 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fcd86-8c31-4856-a933-262f4846b331 service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:52.539309 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-363fcd86-8c31-4856-a933-262f4846b331 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:52.676110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fcd86-8c31-4856-a933-262f4846b331 service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:52.681872 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ae48f-0597-4686-a694-2711c76f9929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:52.682593 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ae48f-0597-4686-a694-2711c76f9929 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:52.682980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ae48f-0597-4686-a694-2711c76f9929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:52.683126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ae48f-0597-4686-a694-2711c76f9929 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:52.683841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ae48f-0597-4686-a694-2711c76f9929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:52.690818 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ae48f-0597-4686-a694-2711c76f9929 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:52.748364 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1138/2283] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:16:52 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:52.752763 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fcdc7-2d2f-4d85-8877-c4ba90730e5a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:52.769911 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fcdc7-2d2f-4d85-8877-c4ba90730e5a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:52.950698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662669ec-07fd-494d-b19c-973c67437a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:52.951541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662669ec-07fd-494d-b19c-973c67437a4d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:52.951934 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662669ec-07fd-494d-b19c-973c67437a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:52.952338 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662669ec-07fd-494d-b19c-973c67437a4d admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:52.953321 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662669ec-07fd-494d-b19c-973c67437a4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:52.956799 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662669ec-07fd-494d-b19c-973c67437a4d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:52.988447 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1146/2284] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:16:52 2022] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:16:52.992216 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ae48f-0597-4686-a694-2711c76f9929 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:53.015048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ae48f-0597-4686-a694-2711c76f9929 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:53.057637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87ba68-fad5-4f50-abdd-b9130741ba68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:53.058883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87ba68-fad5-4f50-abdd-b9130741ba68 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:53.059320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87ba68-fad5-4f50-abdd-b9130741ba68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:53.059779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87ba68-fad5-4f50-abdd-b9130741ba68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:53.063551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87ba68-fad5-4f50-abdd-b9130741ba68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:53.067351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87ba68-fad5-4f50-abdd-b9130741ba68 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:53.096448 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1139/2285] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:53.097466 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662669ec-07fd-494d-b19c-973c67437a4d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:53.116611 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662669ec-07fd-494d-b19c-973c67437a4d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:53.123254 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc9422-f30f-4d1a-a5f2-f7bd5c2ccc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:53.124310 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc9422-f30f-4d1a-a5f2-f7bd5c2ccc45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:53.124904 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc9422-f30f-4d1a-a5f2-f7bd5c2ccc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:53.125260 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc9422-f30f-4d1a-a5f2-f7bd5c2ccc45 admin admin] PATH_INFO: `/v3/projects/dd7457ac96994b3bb77bc72590760df3/users/1641b685a19c4c18ae3c7930f2ac552d/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:53.148608 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc9422-f30f-4d1a-a5f2-f7bd5c2ccc45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd7457ac96994b3bb77bc72590760df3, user_id=1641b685a19c4c18ae3c7930f2ac552d, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:53.163580 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc9422-f30f-4d1a-a5f2-f7bd5c2ccc45 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:53.216742 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1147/2286] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:53 2022] PUT /identity/v3/projects/dd7457ac96994b3bb77bc72590760df3/users/1641b685a19c4c18ae3c7930f2ac552d/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:16:53.221201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87ba68-fad5-4f50-abdd-b9130741ba68 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:53.234704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87ba68-fad5-4f50-abdd-b9130741ba68 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:53.370831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a164e-76a5-4973-8ead-f5643a6bfa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:53.371666 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a164e-76a5-4973-8ead-f5643a6bfa18 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:53.371969 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a164e-76a5-4973-8ead-f5643a6bfa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:53.372246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a164e-76a5-4973-8ead-f5643a6bfa18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:53.373225 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a164e-76a5-4973-8ead-f5643a6bfa18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:53.375117 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a164e-76a5-4973-8ead-f5643a6bfa18 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:53.404217 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1140/2287] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:16:53.406190 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc9422-f30f-4d1a-a5f2-f7bd5c2ccc45 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:53.417797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc9422-f30f-4d1a-a5f2-f7bd5c2ccc45 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:53.422798 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e07c45-60b3-4678-ae1b-ee9f4a8b103c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:53.424012 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e07c45-60b3-4678-ae1b-ee9f4a8b103c admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:53.424294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e07c45-60b3-4678-ae1b-ee9f4a8b103c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:53.424567 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e07c45-60b3-4678-ae1b-ee9f4a8b103c admin admin] PATH_INFO: `/v3/projects/dd7457ac96994b3bb77bc72590760df3/users/1641b685a19c4c18ae3c7930f2ac552d/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:53.427123 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e07c45-60b3-4678-ae1b-ee9f4a8b103c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd7457ac96994b3bb77bc72590760df3, user_id=1641b685a19c4c18ae3c7930f2ac552d, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:53.429841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e07c45-60b3-4678-ae1b-ee9f4a8b103c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:53.455060 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1148/2288] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:16:53 2022] PUT /identity/v3/projects/dd7457ac96994b3bb77bc72590760df3/users/1641b685a19c4c18ae3c7930f2ac552d/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:58.425668 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a164e-76a5-4973-8ead-f5643a6bfa18 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:58.457712 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a164e-76a5-4973-8ead-f5643a6bfa18 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:58.594297 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:58.637969 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c2a33-0bbd-43fb-bd38-068718e6e084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:58.640179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c2a33-0bbd-43fb-bd38-068718e6e084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:58.640476 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c2a33-0bbd-43fb-bd38-068718e6e084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:58.640758 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c2a33-0bbd-43fb-bd38-068718e6e084 admin admin] PATH_INFO: `/v3/users/d1a9b67f68624df8a4fca2101c49cdbd` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:58.642204 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c2a33-0bbd-43fb-bd38-068718e6e084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a9b67f68624df8a4fca2101c49cdbd)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:58.652347 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c2a33-0bbd-43fb-bd38-068718e6e084 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:58.783708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-780c2a33-0bbd-43fb-bd38-068718e6e084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a9b67f68624df8a4fca2101c49cdbd'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:58.784799 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-780c2a33-0bbd-43fb-bd38-068718e6e084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a9b67f68624df8a4fca2101c49cdbd'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:58.785665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-780c2a33-0bbd-43fb-bd38-068718e6e084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a9b67f68624df8a4fca2101c49cdbd'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:58.823662 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-780c2a33-0bbd-43fb-bd38-068718e6e084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a9b67f68624df8a4fca2101c49cdbd'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:58.853278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-780c2a33-0bbd-43fb-bd38-068718e6e084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a9b67f68624df8a4fca2101c49cdbd'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:16:58.897124 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1141/2289] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:16:58 2022] DELETE /identity/v3/users/d1a9b67f68624df8a4fca2101c49cdbd => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:16:58.902088 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4b4bf-62b2-42f0-b2f1-9c6459f00c69 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:58.902622 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4b4bf-62b2-42f0-b2f1-9c6459f00c69 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:58.902622 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4b4bf-62b2-42f0-b2f1-9c6459f00c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:58.958141 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c2c4b4bf-62b2-42f0-b2f1-9c6459f00c69 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:16:58.959794 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c2c4b4bf-62b2-42f0-b2f1-9c6459f00c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:59.159453 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:16:59.188295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1149/2290] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:16:59.195573 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c2a33-0bbd-43fb-bd38-068718e6e084 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:16:59.197155 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-780c2a33-0bbd-43fb-bd38-068718e6e084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:16:59.369594 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c2a33-0bbd-43fb-bd38-068718e6e084 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:16:59.374629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f87cb-8138-4ecf-9679-2b27cdcc0ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:16:59.375298 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f87cb-8138-4ecf-9679-2b27cdcc0ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:16:59.375587 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f87cb-8138-4ecf-9679-2b27cdcc0ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:16:59.375875 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f87cb-8138-4ecf-9679-2b27cdcc0ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:16:59.387849 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f87cb-8138-4ecf-9679-2b27cdcc0ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:16:59.389831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f87cb-8138-4ecf-9679-2b27cdcc0ab5 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:16:59.420643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1142/2291] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:17:00.026705 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4b4bf-62b2-42f0-b2f1-9c6459f00c69 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:00.028990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c2c4b4bf-62b2-42f0-b2f1-9c6459f00c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:00.067579 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4b4bf-62b2-42f0-b2f1-9c6459f00c69 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:00.084402 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a85811-0049-47a9-9725-aa15fc03c73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:00.085732 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a85811-0049-47a9-9725-aa15fc03c73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:00.086051 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a85811-0049-47a9-9725-aa15fc03c73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:00.086456 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a85811-0049-47a9-9725-aa15fc03c73d admin admin] PATH_INFO: `/v3/projects/bbb71c27cfa34125a56b40a11880c0b9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:00.092199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a85811-0049-47a9-9725-aa15fc03c73d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb71c27cfa34125a56b40a11880c0b9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:00.106573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a85811-0049-47a9-9725-aa15fc03c73d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:00.342582 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a1a85811-0049-47a9-9725-aa15fc03c73d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb71c27cfa34125a56b40a11880c0b9', 'request_id': 'req-a1a85811-0049-47a9-9725-aa15fc03c73d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:00.357142 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a1a85811-0049-47a9-9725-aa15fc03c73d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb71c27cfa34125a56b40a11880c0b9', 'request_id': 'req-a1a85811-0049-47a9-9725-aa15fc03c73d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:00.371897 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a1a85811-0049-47a9-9725-aa15fc03c73d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb71c27cfa34125a56b40a11880c0b9', 'request_id': 'req-a1a85811-0049-47a9-9725-aa15fc03c73d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:00.413484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a1a85811-0049-47a9-9725-aa15fc03c73d admin admin] The token cache is being invalidate because project bbb71c27cfa34125a56b40a11880c0b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:17:00.413790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a1a85811-0049-47a9-9725-aa15fc03c73d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:00.416640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a1a85811-0049-47a9-9725-aa15fc03c73d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:00.420894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1150/2292] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:17:00 2022] DELETE /identity/v3/projects/bbb71c27cfa34125a56b40a11880c0b9 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:17:03.092710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f447a-59f9-4f22-b2ec-50d7dd1ad470 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:03.093199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f447a-59f9-4f22-b2ec-50d7dd1ad470 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:03.093199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f447a-59f9-4f22-b2ec-50d7dd1ad470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:03.143514 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-874f447a-59f9-4f22-b2ec-50d7dd1ad470 None None] MFA Rules not processed for user `1641b685a19c4c18ae3c7930f2ac552d`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:17:03.145166 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-874f447a-59f9-4f22-b2ec-50d7dd1ad470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:03.198285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba849c-af65-4269-b756-40a943c07f79 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:03.199900 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba849c-af65-4269-b756-40a943c07f79 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:03.200363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba849c-af65-4269-b756-40a943c07f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:03.232400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-09ba849c-af65-4269-b756-40a943c07f79 None None] MFA Rules not processed for user `30c0516b85e74bdb829a3019e71e6ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:17:03.234063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-09ba849c-af65-4269-b756-40a943c07f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:03.279820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:03.316281 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1143/2293] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:17:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:17:03.325126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f447a-59f9-4f22-b2ec-50d7dd1ad470 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:03.327858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-874f447a-59f9-4f22-b2ec-50d7dd1ad470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:03.343895 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1151/2294] 10.222.0.48 () {58 vars in 967 bytes} [Mon Jul 25 12:17:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:17:03.359082 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba849c-af65-4269-b756-40a943c07f79 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:03.362095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-09ba849c-af65-4269-b756-40a943c07f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:03.447575 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba849c-af65-4269-b756-40a943c07f79 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:03.450652 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f447a-59f9-4f22-b2ec-50d7dd1ad470 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:03.453254 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7084d09-2612-4354-b11d-ff3c13ca227c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71de21b4b6d4971953f0c1ca92d9f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:03.454025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7084d09-2612-4354-b11d-ff3c13ca227c service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:03.454306 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7084d09-2612-4354-b11d-ff3c13ca227c service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:03.454582 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7084d09-2612-4354-b11d-ff3c13ca227c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:03.454880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addea614-b559-41a2-a250-2f45afe2b156 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52ff8138094d64bce9de60c819ab4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:03.455717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addea614-b559-41a2-a250-2f45afe2b156 service glance] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:03.456064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addea614-b559-41a2-a250-2f45afe2b156 service glance] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:03.456436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addea614-b559-41a2-a250-2f45afe2b156 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:03.458302 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-addea614-b559-41a2-a250-2f45afe2b156 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:03.463806 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7084d09-2612-4354-b11d-ff3c13ca227c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:03.466261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7084d09-2612-4354-b11d-ff3c13ca227c service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:03.479247 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1152/2295] 10.222.0.48 () {60 vars in 1384 bytes} [Mon Jul 25 12:17:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 12:17:03.541754 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addea614-b559-41a2-a250-2f45afe2b156 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:03.544015 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addea614-b559-41a2-a250-2f45afe2b156 service glance] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:03.555006 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1144/2296] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:17:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:17:03.708590 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945593a-d36e-4c5d-a887-b7802b37d9c1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:03.709047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945593a-d36e-4c5d-a887-b7802b37d9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:03.709324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945593a-d36e-4c5d-a887-b7802b37d9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:03.733570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9945593a-d36e-4c5d-a887-b7802b37d9c1 None None] MFA Rules not processed for user `30c0516b85e74bdb829a3019e71e6ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:17:03.735064 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9945593a-d36e-4c5d-a887-b7802b37d9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:03.746172 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1153/2297] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 12:17:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:17:03.759609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addea614-b559-41a2-a250-2f45afe2b156 service glance] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:03.773032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addea614-b559-41a2-a250-2f45afe2b156 service glance] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:03.781070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604a8bd-9ce1-4b1b-98e0-d3a39015a6ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71de21b4b6d4971953f0c1ca92d9f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:03.781882 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604a8bd-9ce1-4b1b-98e0-d3a39015a6ea service swift] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:03.782250 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604a8bd-9ce1-4b1b-98e0-d3a39015a6ea service swift] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:03.782557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604a8bd-9ce1-4b1b-98e0-d3a39015a6ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:03.806805 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604a8bd-9ce1-4b1b-98e0-d3a39015a6ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:03.810892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604a8bd-9ce1-4b1b-98e0-d3a39015a6ea service swift] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:03.829493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1145/2298] 10.222.0.48 () {60 vars in 1384 bytes} [Mon Jul 25 12:17:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:17:06.185186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630bbae-0965-4d6b-bd86-d33fff48023b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:06.185955 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630bbae-0965-4d6b-bd86-d33fff48023b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:06.186069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630bbae-0965-4d6b-bd86-d33fff48023b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:06.187471 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1154/2299] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 12:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:17:06.227007 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f4938-e704-45c2-af4d-1b976c1f150d None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:06.227594 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f4938-e704-45c2-af4d-1b976c1f150d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:06.227682 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f4938-e704-45c2-af4d-1b976c1f150d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:06.277382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-728f4938-e704-45c2-af4d-1b976c1f150d None None] MFA Rules not processed for user `40f748b0f6b1433c87012793f0dda307`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:17:06.281361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-728f4938-e704-45c2-af4d-1b976c1f150d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:06.312511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630bbae-0965-4d6b-bd86-d33fff48023b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:06.314269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0630bbae-0965-4d6b-bd86-d33fff48023b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:06.320736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:06.478587 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630bbae-0965-4d6b-bd86-d33fff48023b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:06.492228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1146/2300] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 12:17:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:17:06.498852 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375165ea-e0e3-4488-b165-f9da6f314a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:06.499761 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375165ea-e0e3-4488-b165-f9da6f314a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:06.500047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375165ea-e0e3-4488-b165-f9da6f314a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:06.500315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375165ea-e0e3-4488-b165-f9da6f314a9c admin admin] PATH_INFO: `/v3/users/376d10540ec44065a7010c87d1c50dd6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:06.505519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375165ea-e0e3-4488-b165-f9da6f314a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=376d10540ec44065a7010c87d1c50dd6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:06.507532 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f4938-e704-45c2-af4d-1b976c1f150d None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:06.509210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-728f4938-e704-45c2-af4d-1b976c1f150d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:06.512316 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375165ea-e0e3-4488-b165-f9da6f314a9c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:06.545446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f4938-e704-45c2-af4d-1b976c1f150d None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:06.561445 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16352cba-20e5-4613-84b3-479dc9c62a8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f748b0f6b1433c87012793f0dda307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:06.562191 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16352cba-20e5-4613-84b3-479dc9c62a8b service placement] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:06.562480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16352cba-20e5-4613-84b3-479dc9c62a8b service placement] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:06.562760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16352cba-20e5-4613-84b3-479dc9c62a8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:06.581179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16352cba-20e5-4613-84b3-479dc9c62a8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:06.583195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16352cba-20e5-4613-84b3-479dc9c62a8b service placement] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:06.591086 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:06.600254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1147/2301] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:17:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:17:06.636220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-375165ea-e0e3-4488-b165-f9da6f314a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376d10540ec44065a7010c87d1c50dd6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:06.640505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-375165ea-e0e3-4488-b165-f9da6f314a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376d10540ec44065a7010c87d1c50dd6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:06.641353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-375165ea-e0e3-4488-b165-f9da6f314a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376d10540ec44065a7010c87d1c50dd6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:06.676852 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-375165ea-e0e3-4488-b165-f9da6f314a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376d10540ec44065a7010c87d1c50dd6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:06.695233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-375165ea-e0e3-4488-b165-f9da6f314a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376d10540ec44065a7010c87d1c50dd6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:06.716950 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1155/2302] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:17:06 2022] DELETE /identity/v3/users/376d10540ec44065a7010c87d1c50dd6 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:17:06.809948 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993caa6-af08-45f3-9444-9d28cb3c8402 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:06.810627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993caa6-af08-45f3-9444-9d28cb3c8402 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:06.810793 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993caa6-af08-45f3-9444-9d28cb3c8402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:06.859555 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-c993caa6-af08-45f3-9444-9d28cb3c8402 None None] MFA Rules not processed for user `8e0fa1b05a614a7d866c207c8fc9201b`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:17:06.861296 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c993caa6-af08-45f3-9444-9d28cb3c8402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:06.935209 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1148/2303] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:17:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:17:06.994447 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375165ea-e0e3-4488-b165-f9da6f314a9c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:06.998034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-375165ea-e0e3-4488-b165-f9da6f314a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:07.140124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375165ea-e0e3-4488-b165-f9da6f314a9c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:07.146966 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963f47d-b719-4f0a-aa2a-c8f96b52849f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:07.148352 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963f47d-b719-4f0a-aa2a-c8f96b52849f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:07.148635 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963f47d-b719-4f0a-aa2a-c8f96b52849f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:07.148963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963f47d-b719-4f0a-aa2a-c8f96b52849f admin admin] PATH_INFO: `/v3/projects/2d3280f184854bebaf2a1a26d1db6cd2` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:07.151406 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963f47d-b719-4f0a-aa2a-c8f96b52849f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d3280f184854bebaf2a1a26d1db6cd2)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:07.154366 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963f47d-b719-4f0a-aa2a-c8f96b52849f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:07.183186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:07.219586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f963f47d-b719-4f0a-aa2a-c8f96b52849f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d3280f184854bebaf2a1a26d1db6cd2', 'request_id': 'req-f963f47d-b719-4f0a-aa2a-c8f96b52849f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:07.226027 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f963f47d-b719-4f0a-aa2a-c8f96b52849f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d3280f184854bebaf2a1a26d1db6cd2', 'request_id': 'req-f963f47d-b719-4f0a-aa2a-c8f96b52849f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:07.232991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f963f47d-b719-4f0a-aa2a-c8f96b52849f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d3280f184854bebaf2a1a26d1db6cd2', 'request_id': 'req-f963f47d-b719-4f0a-aa2a-c8f96b52849f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:07.253742 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f963f47d-b719-4f0a-aa2a-c8f96b52849f admin admin] The token cache is being invalidate because project 2d3280f184854bebaf2a1a26d1db6cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:17:07.254100 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f963f47d-b719-4f0a-aa2a-c8f96b52849f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:07.255062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f963f47d-b719-4f0a-aa2a-c8f96b52849f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:07.260865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1156/2304] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:17:06 2022] DELETE /identity/v3/projects/2d3280f184854bebaf2a1a26d1db6cd2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:17:07.262472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76a3b7-b514-4250-8bb7-2600117419e3 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:07.262941 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76a3b7-b514-4250-8bb7-2600117419e3 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:07.263037 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76a3b7-b514-4250-8bb7-2600117419e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:07.286481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-ab76a3b7-b514-4250-8bb7-2600117419e3 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:17:07.287730 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ab76a3b7-b514-4250-8bb7-2600117419e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:07.379636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1149/2305] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:17:07.387622 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041e49-1656-4e20-ac6b-ff2c25b8181a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:07.388265 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041e49-1656-4e20-ac6b-ff2c25b8181a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:07.388761 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041e49-1656-4e20-ac6b-ff2c25b8181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:07.428577 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2d041e49-1656-4e20-ac6b-ff2c25b8181a None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:17:07.430129 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2d041e49-1656-4e20-ac6b-ff2c25b8181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:07.441536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1157/2306] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:17:07.447253 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76a3b7-b514-4250-8bb7-2600117419e3 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:07.461391 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76a3b7-b514-4250-8bb7-2600117419e3 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:07.475641 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf463d9-30db-4906-afa2-79963875acef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:07.476335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf463d9-30db-4906-afa2-79963875acef admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:07.477035 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf463d9-30db-4906-afa2-79963875acef admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:07.477330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf463d9-30db-4906-afa2-79963875acef admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:07.478126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf463d9-30db-4906-afa2-79963875acef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:17:07.478438 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf463d9-30db-4906-afa2-79963875acef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:07.481693 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf463d9-30db-4906-afa2-79963875acef admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:07.545233 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1150/2307] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:17:07.550820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d041e49-1656-4e20-ac6b-ff2c25b8181a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:07.566724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d041e49-1656-4e20-ac6b-ff2c25b8181a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:07.592823 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd2ccf-b0bc-4aea-a5e7-4f273bd1651e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:07.593816 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd2ccf-b0bc-4aea-a5e7-4f273bd1651e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:07.594289 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd2ccf-b0bc-4aea-a5e7-4f273bd1651e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:07.594730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd2ccf-b0bc-4aea-a5e7-4f273bd1651e admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:07.595598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd2ccf-b0bc-4aea-a5e7-4f273bd1651e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:07.597787 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd2ccf-b0bc-4aea-a5e7-4f273bd1651e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:07.689748 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1158/2308] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:17:07 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:17:07.694084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf463d9-30db-4906-afa2-79963875acef admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:07.709012 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf463d9-30db-4906-afa2-79963875acef admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:07.814097 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600aa195-83d2-4370-b19a-cb03d1739d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:07.814803 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aa195-83d2-4370-b19a-cb03d1739d15 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:07.815089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aa195-83d2-4370-b19a-cb03d1739d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:07.815366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aa195-83d2-4370-b19a-cb03d1739d15 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:07.816092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600aa195-83d2-4370-b19a-cb03d1739d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:07.818076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600aa195-83d2-4370-b19a-cb03d1739d15 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:07.873501 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1151/2309] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:17:07 2022] POST /identity/v3/users => generated 284 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:17:07.874874 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd2ccf-b0bc-4aea-a5e7-4f273bd1651e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:07.893168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd2ccf-b0bc-4aea-a5e7-4f273bd1651e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:07.905323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab2a8e-735b-41f4-9572-65e5d597c084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:07.906729 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab2a8e-735b-41f4-9572-65e5d597c084 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:07.908045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab2a8e-735b-41f4-9572-65e5d597c084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:07.909094 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab2a8e-735b-41f4-9572-65e5d597c084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:07.910270 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab2a8e-735b-41f4-9572-65e5d597c084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:07.919179 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab2a8e-735b-41f4-9572-65e5d597c084 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:07.943258 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1159/2310] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:17:07.944528 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600aa195-83d2-4370-b19a-cb03d1739d15 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:07.958649 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600aa195-83d2-4370-b19a-cb03d1739d15 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:07.968556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e57db-4039-4710-a6c4-24861c436b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:07.969241 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e57db-4039-4710-a6c4-24861c436b26 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:07.969525 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e57db-4039-4710-a6c4-24861c436b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:07.969805 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e57db-4039-4710-a6c4-24861c436b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:07.970633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e57db-4039-4710-a6c4-24861c436b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:07.972226 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e57db-4039-4710-a6c4-24861c436b26 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:08.001112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1152/2311] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:17:08.002405 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab2a8e-735b-41f4-9572-65e5d597c084 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:08.017551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab2a8e-735b-41f4-9572-65e5d597c084 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:08.023999 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68215c4d-4987-47bb-8a02-bc35fedc98fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:08.025060 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68215c4d-4987-47bb-8a02-bc35fedc98fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:08.025434 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68215c4d-4987-47bb-8a02-bc35fedc98fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:08.025803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68215c4d-4987-47bb-8a02-bc35fedc98fe admin admin] PATH_INFO: `/v3/projects/a40bb76d20794b0c8f049dc38048ead9/users/c253fced75814d62b15d21ad795e9c58/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:08.051021 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68215c4d-4987-47bb-8a02-bc35fedc98fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40bb76d20794b0c8f049dc38048ead9, user_id=c253fced75814d62b15d21ad795e9c58, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:08.054210 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68215c4d-4987-47bb-8a02-bc35fedc98fe admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:08.090235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1160/2312] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:17:08 2022] PUT /identity/v3/projects/a40bb76d20794b0c8f049dc38048ead9/users/c253fced75814d62b15d21ad795e9c58/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:17:08.099696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6b038-5b0e-4b26-8778-86130563c2f9 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:08.099996 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6b038-5b0e-4b26-8778-86130563c2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:08.100270 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6b038-5b0e-4b26-8778-86130563c2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:08.152757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:08.171796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-2aa6b038-5b0e-4b26-8778-86130563c2f9 None None] MFA Rules not processed for user `c253fced75814d62b15d21ad795e9c58`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:17:08.172956 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-2aa6b038-5b0e-4b26-8778-86130563c2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:08.268748 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1153/2313] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:17:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:17:08.279789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68215c4d-4987-47bb-8a02-bc35fedc98fe admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:08.282334 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-68215c4d-4987-47bb-8a02-bc35fedc98fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:08.388723 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68215c4d-4987-47bb-8a02-bc35fedc98fe admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:08.395777 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3d64b-2a92-43c7-b08c-06a58ebeac0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52ff8138094d64bce9de60c819ab4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:08.396866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3d64b-2a92-43c7-b08c-06a58ebeac0b service glance] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:08.397320 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3d64b-2a92-43c7-b08c-06a58ebeac0b service glance] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:08.397599 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3d64b-2a92-43c7-b08c-06a58ebeac0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:08.408950 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3d64b-2a92-43c7-b08c-06a58ebeac0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:08.410538 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3d64b-2a92-43c7-b08c-06a58ebeac0b service glance] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:08.426367 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1161/2314] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:17:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:17:14.429152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01e3d-39c3-4bdb-b072-58204e239d92 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:14.429705 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01e3d-39c3-4bdb-b072-58204e239d92 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:14.429814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01e3d-39c3-4bdb-b072-58204e239d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:14.452680 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-8df01e3d-39c3-4bdb-b072-58204e239d92 None None] MFA Rules not processed for user `32941ba0f04749a189cd031c1f3da14f`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:17:14.453899 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-8df01e3d-39c3-4bdb-b072-58204e239d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:14.514931 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1154/2315] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:17:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:17:16.601624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4da8a-7001-4b4a-9341-103951437bcc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:16.602208 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4da8a-7001-4b4a-9341-103951437bcc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:16.602297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4da8a-7001-4b4a-9341-103951437bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:16.625353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a9e4da8a-7001-4b4a-9341-103951437bcc None None] MFA Rules not processed for user `30c0516b85e74bdb829a3019e71e6ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:17:16.626751 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a9e4da8a-7001-4b4a-9341-103951437bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:16.687075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:16.702164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1162/2316] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 12:17:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:17:16.716363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df01e3d-39c3-4bdb-b072-58204e239d92 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:16.717992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-8df01e3d-39c3-4bdb-b072-58204e239d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:16.799200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df01e3d-39c3-4bdb-b072-58204e239d92 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:16.808562 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31aa781-171f-446d-9a51-004d69a6c5e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71de21b4b6d4971953f0c1ca92d9f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:16.810464 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aa781-171f-446d-9a51-004d69a6c5e4 service swift] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:16.811282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aa781-171f-446d-9a51-004d69a6c5e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:16.811985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aa781-171f-446d-9a51-004d69a6c5e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:16.823794 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31aa781-171f-446d-9a51-004d69a6c5e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:16.825481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31aa781-171f-446d-9a51-004d69a6c5e4 service swift] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:16.834748 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1155/2317] 10.222.0.48 () {60 vars in 1384 bytes} [Mon Jul 25 12:17:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:17:26.703927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:26.831042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=84 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:33.901792 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4da8a-7001-4b4a-9341-103951437bcc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:33.961917 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4da8a-7001-4b4a-9341-103951437bcc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:33.966380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1bef4-5b34-4d71-83af-9ae3a796b101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:33.967225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1bef4-5b34-4d71-83af-9ae3a796b101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:33.967504 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1bef4-5b34-4d71-83af-9ae3a796b101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:33.967774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1bef4-5b34-4d71-83af-9ae3a796b101 admin admin] PATH_INFO: `/v3/users/c253fced75814d62b15d21ad795e9c58` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:33.968930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1bef4-5b34-4d71-83af-9ae3a796b101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c253fced75814d62b15d21ad795e9c58)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:33.970885 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1bef4-5b34-4d71-83af-9ae3a796b101 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:34.015528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3ba1bef4-5b34-4d71-83af-9ae3a796b101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c253fced75814d62b15d21ad795e9c58'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:34.016180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3ba1bef4-5b34-4d71-83af-9ae3a796b101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c253fced75814d62b15d21ad795e9c58'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:34.016796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3ba1bef4-5b34-4d71-83af-9ae3a796b101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c253fced75814d62b15d21ad795e9c58'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:34.028555 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3ba1bef4-5b34-4d71-83af-9ae3a796b101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c253fced75814d62b15d21ad795e9c58'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:34.035661 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3ba1bef4-5b34-4d71-83af-9ae3a796b101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c253fced75814d62b15d21ad795e9c58'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:34.048501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1163/2318] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:17:33 2022] DELETE /identity/v3/users/c253fced75814d62b15d21ad795e9c58 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:17:34.052762 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f83f1a-3f4a-48f0-93a3-e068048f7a1e None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:34.053244 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f83f1a-3f4a-48f0-93a3-e068048f7a1e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:34.053341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f83f1a-3f4a-48f0-93a3-e068048f7a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:34.072680 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-64f83f1a-3f4a-48f0-93a3-e068048f7a1e None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:17:34.073890 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-64f83f1a-3f4a-48f0-93a3-e068048f7a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:34.132805 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1156/2319] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:17:34.142501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1bef4-5b34-4d71-83af-9ae3a796b101 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:34.143945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3ba1bef4-5b34-4d71-83af-9ae3a796b101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:34.201583 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1bef4-5b34-4d71-83af-9ae3a796b101 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:34.205430 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a68df4-6f75-4c6e-9e9d-bff7d1ce4598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:34.206106 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a68df4-6f75-4c6e-9e9d-bff7d1ce4598 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:34.206395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a68df4-6f75-4c6e-9e9d-bff7d1ce4598 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:34.206670 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a68df4-6f75-4c6e-9e9d-bff7d1ce4598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:34.217131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a68df4-6f75-4c6e-9e9d-bff7d1ce4598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:34.218649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a68df4-6f75-4c6e-9e9d-bff7d1ce4598 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:34.229272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1164/2320] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:17:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:17:34.577795 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f83f1a-3f4a-48f0-93a3-e068048f7a1e None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:34.579401 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-64f83f1a-3f4a-48f0-93a3-e068048f7a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:34.592420 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f83f1a-3f4a-48f0-93a3-e068048f7a1e None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:34.597043 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b242e05-eef7-4dc0-9a1d-4207d141cd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:34.597907 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b242e05-eef7-4dc0-9a1d-4207d141cd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:34.598220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b242e05-eef7-4dc0-9a1d-4207d141cd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:34.598496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b242e05-eef7-4dc0-9a1d-4207d141cd3d admin admin] PATH_INFO: `/v3/projects/a40bb76d20794b0c8f049dc38048ead9` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:34.599766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b242e05-eef7-4dc0-9a1d-4207d141cd3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a40bb76d20794b0c8f049dc38048ead9)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:34.601646 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b242e05-eef7-4dc0-9a1d-4207d141cd3d admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:34.647207 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9b242e05-eef7-4dc0-9a1d-4207d141cd3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a40bb76d20794b0c8f049dc38048ead9', 'request_id': 'req-9b242e05-eef7-4dc0-9a1d-4207d141cd3d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:34.654680 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9b242e05-eef7-4dc0-9a1d-4207d141cd3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a40bb76d20794b0c8f049dc38048ead9', 'request_id': 'req-9b242e05-eef7-4dc0-9a1d-4207d141cd3d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:34.660464 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9b242e05-eef7-4dc0-9a1d-4207d141cd3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a40bb76d20794b0c8f049dc38048ead9', 'request_id': 'req-9b242e05-eef7-4dc0-9a1d-4207d141cd3d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:34.671433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9b242e05-eef7-4dc0-9a1d-4207d141cd3d admin admin] The token cache is being invalidate because project a40bb76d20794b0c8f049dc38048ead9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:17:34.671730 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9b242e05-eef7-4dc0-9a1d-4207d141cd3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:34.672379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9b242e05-eef7-4dc0-9a1d-4207d141cd3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:34.674252 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1157/2321] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:17:34 2022] DELETE /identity/v3/projects/a40bb76d20794b0c8f049dc38048ead9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:17:34.679307 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a3738-7251-48f3-9700-18345d208a4b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:34.679619 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a3738-7251-48f3-9700-18345d208a4b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:34.679886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a3738-7251-48f3-9700-18345d208a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:34.699952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-649a3738-7251-48f3-9700-18345d208a4b None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:17:34.701167 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-649a3738-7251-48f3-9700-18345d208a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:34.718729 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:34.763885 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1165/2322] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:17:34.771674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221d062-4e74-45aa-8c09-7cba752f2af7 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:34.771986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221d062-4e74-45aa-8c09-7cba752f2af7 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:34.772262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221d062-4e74-45aa-8c09-7cba752f2af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:34.793069 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-f221d062-4e74-45aa-8c09-7cba752f2af7 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:17:34.794307 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-f221d062-4e74-45aa-8c09-7cba752f2af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:34.802402 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1158/2323] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:17:34.807288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a3738-7251-48f3-9700-18345d208a4b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:34.817076 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a3738-7251-48f3-9700-18345d208a4b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:34.822580 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfe696-10b7-4895-b9d2-9a58d5b205c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:34.823377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfe696-10b7-4895-b9d2-9a58d5b205c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:34.823666 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfe696-10b7-4895-b9d2-9a58d5b205c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:34.824058 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfe696-10b7-4895-b9d2-9a58d5b205c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:34.824688 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfe696-10b7-4895-b9d2-9a58d5b205c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:17:34.824995 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfe696-10b7-4895-b9d2-9a58d5b205c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:34.826641 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfe696-10b7-4895-b9d2-9a58d5b205c8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:34.838539 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1166/2324] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:17:34.843084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221d062-4e74-45aa-8c09-7cba752f2af7 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:34.852629 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221d062-4e74-45aa-8c09-7cba752f2af7 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:34.857387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51883cb-a41f-42cf-834d-bb9d05920b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:34.858064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51883cb-a41f-42cf-834d-bb9d05920b9b admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:34.858351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51883cb-a41f-42cf-834d-bb9d05920b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:34.858649 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51883cb-a41f-42cf-834d-bb9d05920b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:34.859431 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51883cb-a41f-42cf-834d-bb9d05920b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:34.861242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51883cb-a41f-42cf-834d-bb9d05920b9b admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:34.889690 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1159/2325] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:17:34 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:17:34.893977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfe696-10b7-4895-b9d2-9a58d5b205c8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:34.904180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfe696-10b7-4895-b9d2-9a58d5b205c8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:34.960050 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e23ba-fdf9-4a6a-ac90-f80a52e01592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:34.960648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e23ba-fdf9-4a6a-ac90-f80a52e01592 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:34.960928 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e23ba-fdf9-4a6a-ac90-f80a52e01592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:34.961198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e23ba-fdf9-4a6a-ac90-f80a52e01592 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:34.961892 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e23ba-fdf9-4a6a-ac90-f80a52e01592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:34.963854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e23ba-fdf9-4a6a-ac90-f80a52e01592 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:34.983769 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1167/2326] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:17:34 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:17:34.987820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51883cb-a41f-42cf-834d-bb9d05920b9b admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:34.998624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51883cb-a41f-42cf-834d-bb9d05920b9b admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:35.003332 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b73bae-8434-4434-b586-7b5757687663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:35.003988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b73bae-8434-4434-b586-7b5757687663 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:35.004274 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b73bae-8434-4434-b586-7b5757687663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:35.004574 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b73bae-8434-4434-b586-7b5757687663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:35.005284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b73bae-8434-4434-b586-7b5757687663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:35.006951 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b73bae-8434-4434-b586-7b5757687663 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:35.017482 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1160/2327] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:17:35.021265 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e23ba-fdf9-4a6a-ac90-f80a52e01592 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:35.031171 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e23ba-fdf9-4a6a-ac90-f80a52e01592 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:35.035779 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550cdb32-f61f-4780-997e-f53b3555b741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:35.036433 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cdb32-f61f-4780-997e-f53b3555b741 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:35.036725 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cdb32-f61f-4780-997e-f53b3555b741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:35.036997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cdb32-f61f-4780-997e-f53b3555b741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:35.037725 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550cdb32-f61f-4780-997e-f53b3555b741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:35.039373 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550cdb32-f61f-4780-997e-f53b3555b741 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:35.049806 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1168/2328] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:17:35.053608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b73bae-8434-4434-b586-7b5757687663 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:35.064357 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b73bae-8434-4434-b586-7b5757687663 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:35.069066 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fe8e9-2766-41fd-b47d-85a2768f27e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:35.069935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fe8e9-2766-41fd-b47d-85a2768f27e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:35.070246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fe8e9-2766-41fd-b47d-85a2768f27e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:35.070520 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fe8e9-2766-41fd-b47d-85a2768f27e3 admin admin] PATH_INFO: `/v3/projects/bc39af5a3931424096f2ac6c2d967d11/users/a431c578047c474a8b35bd53d74d3e8c/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:35.085838 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fe8e9-2766-41fd-b47d-85a2768f27e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc39af5a3931424096f2ac6c2d967d11, user_id=a431c578047c474a8b35bd53d74d3e8c, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:35.088526 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fe8e9-2766-41fd-b47d-85a2768f27e3 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:35.101219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1161/2329] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:17:35 2022] PUT /identity/v3/projects/bc39af5a3931424096f2ac6c2d967d11/users/a431c578047c474a8b35bd53d74d3e8c/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:17:35.112782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273f2d4-cd5e-480c-ac8a-1c55b3984c92 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:35.113076 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273f2d4-cd5e-480c-ac8a-1c55b3984c92 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:35.113357 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273f2d4-cd5e-480c-ac8a-1c55b3984c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:35.141185 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2273f2d4-cd5e-480c-ac8a-1c55b3984c92 None None] MFA Rules not processed for user `a431c578047c474a8b35bd53d74d3e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:17:35.142429 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2273f2d4-cd5e-480c-ac8a-1c55b3984c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:35.206297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1169/2330] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:17:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:17:35.216707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fe8e9-2766-41fd-b47d-85a2768f27e3 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:35.218474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-131fe8e9-2766-41fd-b47d-85a2768f27e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:35.241700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:35.281530 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fe8e9-2766-41fd-b47d-85a2768f27e3 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:35.285313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f47dec-a568-4cac-a560-628d945266f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:35.285968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f47dec-a568-4cac-a560-628d945266f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:35.286286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f47dec-a568-4cac-a560-628d945266f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:35.286569 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f47dec-a568-4cac-a560-628d945266f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:35.295457 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f47dec-a568-4cac-a560-628d945266f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:35.296888 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f47dec-a568-4cac-a560-628d945266f8 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:35.305968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1162/2331] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:17:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:17:43.998312 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273f2d4-cd5e-480c-ac8a-1c55b3984c92 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:43.999715 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2273f2d4-cd5e-480c-ac8a-1c55b3984c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:44.019768 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:44.055709 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273f2d4-cd5e-480c-ac8a-1c55b3984c92 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:44.059761 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fcbfe-791e-437b-b95a-dd90e939430c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:44.060399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fcbfe-791e-437b-b95a-dd90e939430c service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:44.060680 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fcbfe-791e-437b-b95a-dd90e939430c service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:44.060951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fcbfe-791e-437b-b95a-dd90e939430c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:44.062982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-096fcbfe-791e-437b-b95a-dd90e939430c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:44.124596 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fcbfe-791e-437b-b95a-dd90e939430c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:44.126099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fcbfe-791e-437b-b95a-dd90e939430c service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:44.137968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1170/2332] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:17:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:17:45.301762 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=17 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:45.434770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f47dec-a568-4cac-a560-628d945266f8 service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:45.503541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f47dec-a568-4cac-a560-628d945266f8 service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:45.508439 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb7a0d-38b9-4fde-bf53-ede1d453892d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:45.509985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb7a0d-38b9-4fde-bf53-ede1d453892d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:45.510303 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb7a0d-38b9-4fde-bf53-ede1d453892d admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:45.510583 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb7a0d-38b9-4fde-bf53-ede1d453892d admin admin] PATH_INFO: `/v3/users/a431c578047c474a8b35bd53d74d3e8c` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:45.511802 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb7a0d-38b9-4fde-bf53-ede1d453892d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a431c578047c474a8b35bd53d74d3e8c)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:45.513739 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb7a0d-38b9-4fde-bf53-ede1d453892d admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:45.568271 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-69cb7a0d-38b9-4fde-bf53-ede1d453892d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a431c578047c474a8b35bd53d74d3e8c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:45.568928 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-69cb7a0d-38b9-4fde-bf53-ede1d453892d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a431c578047c474a8b35bd53d74d3e8c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:45.569538 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-69cb7a0d-38b9-4fde-bf53-ede1d453892d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a431c578047c474a8b35bd53d74d3e8c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:45.583097 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-69cb7a0d-38b9-4fde-bf53-ede1d453892d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a431c578047c474a8b35bd53d74d3e8c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:45.591597 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-69cb7a0d-38b9-4fde-bf53-ede1d453892d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a431c578047c474a8b35bd53d74d3e8c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:45.606242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1163/2333] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:17:45 2022] DELETE /identity/v3/users/a431c578047c474a8b35bd53d74d3e8c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:17:45.610889 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c7c48-67dd-4367-b800-290aa8a1129a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:45.611402 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c7c48-67dd-4367-b800-290aa8a1129a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:45.611551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c7c48-67dd-4367-b800-290aa8a1129a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:45.630504 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ea1c7c48-67dd-4367-b800-290aa8a1129a None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:17:45.631756 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ea1c7c48-67dd-4367-b800-290aa8a1129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:45.692522 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1171/2334] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:17:45.702156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb7a0d-38b9-4fde-bf53-ede1d453892d admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:45.703621 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-69cb7a0d-38b9-4fde-bf53-ede1d453892d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:45.768010 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb7a0d-38b9-4fde-bf53-ede1d453892d admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:45.772210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e0f99-032f-4aab-ba0e-614550cedca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:45.772862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e0f99-032f-4aab-ba0e-614550cedca6 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:45.773158 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e0f99-032f-4aab-ba0e-614550cedca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:45.773415 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e0f99-032f-4aab-ba0e-614550cedca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:45.793980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e0f99-032f-4aab-ba0e-614550cedca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:45.799406 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e0f99-032f-4aab-ba0e-614550cedca6 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:45.815312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1164/2335] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:17:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:17:46.410594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c7c48-67dd-4367-b800-290aa8a1129a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:46.412525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ea1c7c48-67dd-4367-b800-290aa8a1129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:46.428190 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c7c48-67dd-4367-b800-290aa8a1129a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:46.435032 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52e197-90d5-485c-aa7c-f0b470b309fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:46.435892 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52e197-90d5-485c-aa7c-f0b470b309fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:46.436424 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52e197-90d5-485c-aa7c-f0b470b309fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:46.436692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52e197-90d5-485c-aa7c-f0b470b309fa admin admin] PATH_INFO: `/v3/projects/bc39af5a3931424096f2ac6c2d967d11` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:46.438038 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52e197-90d5-485c-aa7c-f0b470b309fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc39af5a3931424096f2ac6c2d967d11)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:46.442063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52e197-90d5-485c-aa7c-f0b470b309fa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:46.505120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4b52e197-90d5-485c-aa7c-f0b470b309fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc39af5a3931424096f2ac6c2d967d11', 'request_id': 'req-4b52e197-90d5-485c-aa7c-f0b470b309fa'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:46.511023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4b52e197-90d5-485c-aa7c-f0b470b309fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc39af5a3931424096f2ac6c2d967d11', 'request_id': 'req-4b52e197-90d5-485c-aa7c-f0b470b309fa'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:46.517339 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4b52e197-90d5-485c-aa7c-f0b470b309fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc39af5a3931424096f2ac6c2d967d11', 'request_id': 'req-4b52e197-90d5-485c-aa7c-f0b470b309fa'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:46.519140 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:46.532592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4b52e197-90d5-485c-aa7c-f0b470b309fa admin admin] The token cache is being invalidate because project bc39af5a3931424096f2ac6c2d967d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:17:46.532973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4b52e197-90d5-485c-aa7c-f0b470b309fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:46.533651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4b52e197-90d5-485c-aa7c-f0b470b309fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:17:46.535514 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1172/2336] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:17:46 2022] DELETE /identity/v3/projects/bc39af5a3931424096f2ac6c2d967d11 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:17:52.737638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f8c14-f037-4a7c-ba46-c12c0dde3ec4 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:52.738218 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f8c14-f037-4a7c-ba46-c12c0dde3ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:52.738218 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f8c14-f037-4a7c-ba46-c12c0dde3ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:52.769209 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-5f2f8c14-f037-4a7c-ba46-c12c0dde3ec4 None None] MFA Rules not processed for user `30c0516b85e74bdb829a3019e71e6ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:17:52.770508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5f2f8c14-f037-4a7c-ba46-c12c0dde3ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:52.792777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:17:52.844668 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1165/2337] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 12:17:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:17:52.880111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52e197-90d5-485c-aa7c-f0b470b309fa admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:52.881838 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4b52e197-90d5-485c-aa7c-f0b470b309fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:52.971821 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52e197-90d5-485c-aa7c-f0b470b309fa admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:52.984181 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2415443-5c9d-40ad-a1eb-367b0c1f2a13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71de21b4b6d4971953f0c1ca92d9f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:52.984993 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2415443-5c9d-40ad-a1eb-367b0c1f2a13 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:52.985394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2415443-5c9d-40ad-a1eb-367b0c1f2a13 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:52.985900 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2415443-5c9d-40ad-a1eb-367b0c1f2a13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:53.003038 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2415443-5c9d-40ad-a1eb-367b0c1f2a13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:53.005229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2415443-5c9d-40ad-a1eb-367b0c1f2a13 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:53.018561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1173/2338] 10.222.0.48 () {60 vars in 1384 bytes} [Mon Jul 25 12:17:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:17:53.739474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f8c14-f037-4a7c-ba46-c12c0dde3ec4 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:17:53.741422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5f2f8c14-f037-4a7c-ba46-c12c0dde3ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:53.912791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f8c14-f037-4a7c-ba46-c12c0dde3ec4 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:17:53.926257 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870ecd8-976e-48c7-ab03-cdcc3ee360aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f748b0f6b1433c87012793f0dda307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:17:53.926935 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870ecd8-976e-48c7-ab03-cdcc3ee360aa service placement] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:17:53.927260 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870ecd8-976e-48c7-ab03-cdcc3ee360aa service placement] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:17:53.927482 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870ecd8-976e-48c7-ab03-cdcc3ee360aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:17:53.942242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a870ecd8-976e-48c7-ab03-cdcc3ee360aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:17:53.966168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870ecd8-976e-48c7-ab03-cdcc3ee360aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:17:53.967833 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870ecd8-976e-48c7-ab03-cdcc3ee360aa service placement] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:17:53.981966 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1166/2339] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:17:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:18:03.011646 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=34 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:03.977475 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=47 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:04.921602 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddbbbe-e17e-4584-aebb-6b21e84fcb0a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:18:04.922119 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddbbbe-e17e-4584-aebb-6b21e84fcb0a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:18:04.922214 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddbbbe-e17e-4584-aebb-6b21e84fcb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:18:04.941440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7eddbbbe-e17e-4584-aebb-6b21e84fcb0a None None] MFA Rules not processed for user `0dd62c26ee6a438495abdc3ca489b85e`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:18:04.942670 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7eddbbbe-e17e-4584-aebb-6b21e84fcb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:18:04.994437 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1174/2340] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:18:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:18:07.640929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a1e27-9120-4080-b9b5-cded19480f0d None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:18:07.641470 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a1e27-9120-4080-b9b5-cded19480f0d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:18:07.641564 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a1e27-9120-4080-b9b5-cded19480f0d None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:18:07.643290 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1167/2341] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 12:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:18:07.648907 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352920d-2bb4-44bf-bf21-a9cc626cff74 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:18:07.649362 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352920d-2bb4-44bf-bf21-a9cc626cff74 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:18:07.649628 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352920d-2bb4-44bf-bf21-a9cc626cff74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:18:07.670878 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e352920d-2bb4-44bf-bf21-a9cc626cff74 None None] MFA Rules not processed for user `6d9db26891a04b0bb7e655c21feeffdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:18:07.672188 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e352920d-2bb4-44bf-bf21-a9cc626cff74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:18:07.743944 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1175/2342] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 12:18:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:18:07.757611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a1e27-9120-4080-b9b5-cded19480f0d None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:18:07.759554 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b10a1e27-9120-4080-b9b5-cded19480f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:18:07.828584 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a1e27-9120-4080-b9b5-cded19480f0d None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:18:07.832551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c285e79-f1eb-46ed-980e-5d2c5164069e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52ff8138094d64bce9de60c819ab4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:18:07.833303 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c285e79-f1eb-46ed-980e-5d2c5164069e service glance] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:18:07.833660 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c285e79-f1eb-46ed-980e-5d2c5164069e service glance] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:18:07.834064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c285e79-f1eb-46ed-980e-5d2c5164069e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:18:07.845833 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c285e79-f1eb-46ed-980e-5d2c5164069e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:18:07.847368 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c285e79-f1eb-46ed-980e-5d2c5164069e service glance] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:18:07.866062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1168/2343] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:18:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:18:07.933535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3742df-6051-4bb4-ba5f-f6c24b6a1ab7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:18:07.933867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3742df-6051-4bb4-ba5f-f6c24b6a1ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:18:07.934186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3742df-6051-4bb4-ba5f-f6c24b6a1ab7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:18:07.936045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1176/2344] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 12:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:18:07.943532 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaafbe0-c000-4eb1-863a-bde0e6cf02c7 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:18:07.943837 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaafbe0-c000-4eb1-863a-bde0e6cf02c7 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:18:07.944108 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaafbe0-c000-4eb1-863a-bde0e6cf02c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:18:07.963426 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-beaafbe0-c000-4eb1-863a-bde0e6cf02c7 None None] MFA Rules not processed for user `fbc9fad7089b4c95ac92e846d46cb5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:18:07.965183 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-beaafbe0-c000-4eb1-863a-bde0e6cf02c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:18:08.016971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1169/2345] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 12:18:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:18:08.029532 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3742df-6051-4bb4-ba5f-f6c24b6a1ab7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:18:08.031326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ea3742df-6051-4bb4-ba5f-f6c24b6a1ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:18:08.045536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3742df-6051-4bb4-ba5f-f6c24b6a1ab7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:18:08.049556 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d87603-96d4-4119-8db5-630d056dc894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:18:08.050676 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d87603-96d4-4119-8db5-630d056dc894 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:18:08.050965 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d87603-96d4-4119-8db5-630d056dc894 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:18:08.051244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d87603-96d4-4119-8db5-630d056dc894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:18:08.059258 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d87603-96d4-4119-8db5-630d056dc894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:18:08.060709 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d87603-96d4-4119-8db5-630d056dc894 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:18:08.069403 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1177/2346] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:18:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:18:08.165221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a9de2-9191-46d3-8aac-c8ff0f5d9efb None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:18:08.165513 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a9de2-9191-46d3-8aac-c8ff0f5d9efb None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:18:08.165786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a9de2-9191-46d3-8aac-c8ff0f5d9efb None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:18:08.167251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1170/2347] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 12:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:18:08.172799 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476969c4-a883-489b-b46e-6ac3bebd2c91 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:18:08.173176 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476969c4-a883-489b-b46e-6ac3bebd2c91 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:18:08.173608 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476969c4-a883-489b-b46e-6ac3bebd2c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:18:08.193899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-476969c4-a883-489b-b46e-6ac3bebd2c91 None None] MFA Rules not processed for user `6d9db26891a04b0bb7e655c21feeffdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:18:08.195175 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-476969c4-a883-489b-b46e-6ac3bebd2c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:18:08.205216 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1178/2348] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 12:18:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:18:08.216382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a9de2-9191-46d3-8aac-c8ff0f5d9efb None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:18:08.227579 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a9de2-9191-46d3-8aac-c8ff0f5d9efb None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:18:08.231317 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40ef36-a23a-4fea-bb5e-4644e627cdbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:18:08.231957 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40ef36-a23a-4fea-bb5e-4644e627cdbc service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:18:08.232242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40ef36-a23a-4fea-bb5e-4644e627cdbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:18:08.232518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40ef36-a23a-4fea-bb5e-4644e627cdbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:18:08.243845 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40ef36-a23a-4fea-bb5e-4644e627cdbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:18:08.245348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40ef36-a23a-4fea-bb5e-4644e627cdbc service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:18:08.258270 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1171/2349] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:18:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:18:12.293854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76225de-1eea-41e7-914e-87b6de710746 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:18:12.294339 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76225de-1eea-41e7-914e-87b6de710746 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:18:12.294454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76225de-1eea-41e7-914e-87b6de710746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:18:12.314133 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b76225de-1eea-41e7-914e-87b6de710746 None None] MFA Rules not processed for user `30c0516b85e74bdb829a3019e71e6ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:18:12.315332 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b76225de-1eea-41e7-914e-87b6de710746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:18:12.322520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1179/2350] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 12:18:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:18:12.334734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40ef36-a23a-4fea-bb5e-4644e627cdbc service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:18:12.345837 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40ef36-a23a-4fea-bb5e-4644e627cdbc service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:18:12.350849 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b1c60-4642-4d3b-ba98-09f490bf3edb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71de21b4b6d4971953f0c1ca92d9f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:18:12.351488 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b1c60-4642-4d3b-ba98-09f490bf3edb service swift] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:18:12.351766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b1c60-4642-4d3b-ba98-09f490bf3edb service swift] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:18:12.352042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b1c60-4642-4d3b-ba98-09f490bf3edb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:18:12.360353 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b1c60-4642-4d3b-ba98-09f490bf3edb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:18:12.361930 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b1c60-4642-4d3b-ba98-09f490bf3edb service swift] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:18:12.370114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1172/2351] 10.222.0.48 () {60 vars in 1384 bytes} [Mon Jul 25 12:18:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 12:18:22.309151 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=68 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:22.366825 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=61 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:31.149943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c4510-53f5-4fe0-8a97-67d1994fb832 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:18:31.150428 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c4510-53f5-4fe0-8a97-67d1994fb832 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:18:31.150530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c4510-53f5-4fe0-8a97-67d1994fb832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:18:31.170311 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6a9c4510-53f5-4fe0-8a97-67d1994fb832 None None] MFA Rules not processed for user `30c0516b85e74bdb829a3019e71e6ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:18:31.171444 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6a9c4510-53f5-4fe0-8a97-67d1994fb832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:18:31.178481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1180/2352] 10.222.0.48 () {58 vars in 967 bytes} [Mon Jul 25 12:18:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:18:31.190860 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b1c60-4642-4d3b-ba98-09f490bf3edb service swift] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:18:31.201105 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b1c60-4642-4d3b-ba98-09f490bf3edb service swift] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:18:31.206265 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02440661-64a9-41fd-996b-53637fc5ea41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71de21b4b6d4971953f0c1ca92d9f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:18:31.206917 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02440661-64a9-41fd-996b-53637fc5ea41 service swift] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:18:31.207204 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02440661-64a9-41fd-996b-53637fc5ea41 service swift] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:18:31.207486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02440661-64a9-41fd-996b-53637fc5ea41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:18:31.216145 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02440661-64a9-41fd-996b-53637fc5ea41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:18:31.217746 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02440661-64a9-41fd-996b-53637fc5ea41 service swift] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:18:31.226320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1173/2353] 10.222.0.48 () {60 vars in 1384 bytes} [Mon Jul 25 12:18:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:18:41.164918 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:41.222598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=6 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:46.918658 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8aad3-0c9e-4326-9c3e-4cae9eabf7ea None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:18:46.919199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8aad3-0c9e-4326-9c3e-4cae9eabf7ea None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:18:46.919199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8aad3-0c9e-4326-9c3e-4cae9eabf7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:18:46.939166 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-00e8aad3-0c9e-4326-9c3e-4cae9eabf7ea None None] MFA Rules not processed for user `8e0fa1b05a614a7d866c207c8fc9201b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:18:46.940348 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-00e8aad3-0c9e-4326-9c3e-4cae9eabf7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:18:46.993172 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1181/2354] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:18:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:18:56.986919 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=25 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:18:57.032124 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137e73a-f54e-45d5-b430-dde74ebb0951 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:18:57.032661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137e73a-f54e-45d5-b430-dde74ebb0951 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:18:57.032761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137e73a-f54e-45d5-b430-dde74ebb0951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:18:57.051970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-7137e73a-f54e-45d5-b430-dde74ebb0951 None None] MFA Rules not processed for user `170f479a814646e0b8822c1133cc9be4`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:18:57.053213 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-7137e73a-f54e-45d5-b430-dde74ebb0951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:18:57.109357 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1174/2355] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:18:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:19:07.101956 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=25 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:23.336823 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a7d5c-58bc-4e8e-a48d-277eee57624b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:19:23.337305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a7d5c-58bc-4e8e-a48d-277eee57624b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:19:23.337549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a7d5c-58bc-4e8e-a48d-277eee57624b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:19:23.359148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6a0a7d5c-58bc-4e8e-a48d-277eee57624b None None] MFA Rules not processed for user `333371fa736049e3ae21068a6bc6bd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:19:23.360357 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6a0a7d5c-58bc-4e8e-a48d-277eee57624b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:19:23.416893 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1182/2356] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:19:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:19:23.785650 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5edda-6fdb-403d-9489-a87ecdaa50d1 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:19:23.786183 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5edda-6fdb-403d-9489-a87ecdaa50d1 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:19:23.786294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5edda-6fdb-403d-9489-a87ecdaa50d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:19:23.805499 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-5ad5edda-6fdb-403d-9489-a87ecdaa50d1 None None] MFA Rules not processed for user `0dd62c26ee6a438495abdc3ca489b85e`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:19:23.806784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5ad5edda-6fdb-403d-9489-a87ecdaa50d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:19:23.815231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1175/2357] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:19:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:19:33.410025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=25 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:33.800595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:48.281343 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a7d5c-58bc-4e8e-a48d-277eee57624b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:19:48.283455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6a0a7d5c-58bc-4e8e-a48d-277eee57624b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:19:48.295768 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a7d5c-58bc-4e8e-a48d-277eee57624b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:19:48.300012 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11278f88-dd29-48ed-81d4-99e0fba5d8d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:19:48.300646 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11278f88-dd29-48ed-81d4-99e0fba5d8d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:19:48.300927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11278f88-dd29-48ed-81d4-99e0fba5d8d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:19:48.301200 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11278f88-dd29-48ed-81d4-99e0fba5d8d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:19:48.302989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-11278f88-dd29-48ed-81d4-99e0fba5d8d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:19:48.316495 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11278f88-dd29-48ed-81d4-99e0fba5d8d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:19:48.317928 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11278f88-dd29-48ed-81d4-99e0fba5d8d5 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:19:48.328675 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1183/2358] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:19:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:19:50.679818 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5edda-6fdb-403d-9489-a87ecdaa50d1 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:19:50.690231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5edda-6fdb-403d-9489-a87ecdaa50d1 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:19:50.693734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376f7a6-a657-4cdb-b157-fc786f5d4eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:19:50.694410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376f7a6-a657-4cdb-b157-fc786f5d4eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:19:50.694699 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376f7a6-a657-4cdb-b157-fc786f5d4eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:19:50.694979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376f7a6-a657-4cdb-b157-fc786f5d4eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:19:50.696752 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a376f7a6-a657-4cdb-b157-fc786f5d4eb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:19:50.710779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376f7a6-a657-4cdb-b157-fc786f5d4eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:19:50.712201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376f7a6-a657-4cdb-b157-fc786f5d4eb0 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:19:50.723092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1176/2359] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:19:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:19:58.323970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:19:59.326966 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11278f88-dd29-48ed-81d4-99e0fba5d8d5 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:19:59.336116 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11278f88-dd29-48ed-81d4-99e0fba5d8d5 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:19:59.339789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e715a-3df6-440f-9037-1189eb93bf0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:19:59.340433 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e715a-3df6-440f-9037-1189eb93bf0d service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:19:59.340716 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e715a-3df6-440f-9037-1189eb93bf0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:19:59.340990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e715a-3df6-440f-9037-1189eb93bf0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:19:59.342773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cc6e715a-3df6-440f-9037-1189eb93bf0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:19:59.411855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e715a-3df6-440f-9037-1189eb93bf0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:19:59.413458 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e715a-3df6-440f-9037-1189eb93bf0d service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:19:59.430173 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1184/2360] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:19:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:00.718373 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=6 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:01.926719 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376f7a6-a657-4cdb-b157-fc786f5d4eb0 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:01.928216 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a376f7a6-a657-4cdb-b157-fc786f5d4eb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:01.984479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376f7a6-a657-4cdb-b157-fc786f5d4eb0 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:01.988701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e98679-58c2-44ce-89df-619a69df5f97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:01.989349 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e98679-58c2-44ce-89df-619a69df5f97 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:01.989636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e98679-58c2-44ce-89df-619a69df5f97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:01.989914 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e98679-58c2-44ce-89df-619a69df5f97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:01.991748 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d8e98679-58c2-44ce-89df-619a69df5f97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:02.005287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e98679-58c2-44ce-89df-619a69df5f97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:02.007861 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e98679-58c2-44ce-89df-619a69df5f97 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:02.025336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1177/2361] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:02.237666 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c7a8f-f83c-463c-98c9-422ac3e17a88 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:02.238181 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c7a8f-f83c-463c-98c9-422ac3e17a88 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:02.238509 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c7a8f-f83c-463c-98c9-422ac3e17a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:02.268841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-362c7a8f-f83c-463c-98c9-422ac3e17a88 None None] MFA Rules not processed for user `30c0516b85e74bdb829a3019e71e6ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:02.270340 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-362c7a8f-f83c-463c-98c9-422ac3e17a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:02.277750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1185/2362] 10.222.0.48 () {58 vars in 967 bytes} [Mon Jul 25 12:20:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:02.337420 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e98679-58c2-44ce-89df-619a69df5f97 service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:02.355327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e98679-58c2-44ce-89df-619a69df5f97 service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:02.360563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a10be-a749-4d46-9fcc-4080db0dd16b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71de21b4b6d4971953f0c1ca92d9f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:02.361343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a10be-a749-4d46-9fcc-4080db0dd16b service swift] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:02.362265 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a10be-a749-4d46-9fcc-4080db0dd16b service swift] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:02.362547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a10be-a749-4d46-9fcc-4080db0dd16b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:02.372450 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a10be-a749-4d46-9fcc-4080db0dd16b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:02.374085 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a10be-a749-4d46-9fcc-4080db0dd16b service swift] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:02.384725 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1178/2363] 10.222.0.48 () {60 vars in 1384 bytes} [Mon Jul 25 12:20:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:20:03.041652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c7a8f-f83c-463c-98c9-422ac3e17a88 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:03.043865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-362c7a8f-f83c-463c-98c9-422ac3e17a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:03.059365 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c7a8f-f83c-463c-98c9-422ac3e17a88 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:03.064388 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642093b7-fa5b-44e1-b76d-12a9577255da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:03.066164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642093b7-fa5b-44e1-b76d-12a9577255da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:03.066451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642093b7-fa5b-44e1-b76d-12a9577255da admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:03.066729 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642093b7-fa5b-44e1-b76d-12a9577255da admin admin] PATH_INFO: `/v3/users/8e0fa1b05a614a7d866c207c8fc9201b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:03.067966 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642093b7-fa5b-44e1-b76d-12a9577255da admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e0fa1b05a614a7d866c207c8fc9201b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:03.069981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642093b7-fa5b-44e1-b76d-12a9577255da admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:03.125170 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-642093b7-fa5b-44e1-b76d-12a9577255da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e0fa1b05a614a7d866c207c8fc9201b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:03.125840 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-642093b7-fa5b-44e1-b76d-12a9577255da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e0fa1b05a614a7d866c207c8fc9201b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:03.126487 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-642093b7-fa5b-44e1-b76d-12a9577255da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e0fa1b05a614a7d866c207c8fc9201b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:03.140310 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-642093b7-fa5b-44e1-b76d-12a9577255da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e0fa1b05a614a7d866c207c8fc9201b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:03.148898 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-642093b7-fa5b-44e1-b76d-12a9577255da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e0fa1b05a614a7d866c207c8fc9201b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:03.163147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1186/2364] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:03 2022] DELETE /identity/v3/users/8e0fa1b05a614a7d866c207c8fc9201b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:03.401524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a10be-a749-4d46-9fcc-4080db0dd16b service swift] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:03.413595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a10be-a749-4d46-9fcc-4080db0dd16b service swift] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:03.517395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6421099-2d01-4608-bc9e-b50db935cb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:03.518894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6421099-2d01-4608-bc9e-b50db935cb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:03.519302 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6421099-2d01-4608-bc9e-b50db935cb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:03.519709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6421099-2d01-4608-bc9e-b50db935cb86 admin admin] PATH_INFO: `/v3/projects/fabfb17a597c40e1a8987d79c40be118` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:03.520977 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6421099-2d01-4608-bc9e-b50db935cb86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fabfb17a597c40e1a8987d79c40be118)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:03.522986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6421099-2d01-4608-bc9e-b50db935cb86 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:03.581953 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b6421099-2d01-4608-bc9e-b50db935cb86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fabfb17a597c40e1a8987d79c40be118', 'request_id': 'req-b6421099-2d01-4608-bc9e-b50db935cb86'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:03.592402 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b6421099-2d01-4608-bc9e-b50db935cb86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fabfb17a597c40e1a8987d79c40be118', 'request_id': 'req-b6421099-2d01-4608-bc9e-b50db935cb86'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:03.599637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b6421099-2d01-4608-bc9e-b50db935cb86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fabfb17a597c40e1a8987d79c40be118', 'request_id': 'req-b6421099-2d01-4608-bc9e-b50db935cb86'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:03.615366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b6421099-2d01-4608-bc9e-b50db935cb86 admin admin] The token cache is being invalidate because project fabfb17a597c40e1a8987d79c40be118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:03.615646 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b6421099-2d01-4608-bc9e-b50db935cb86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:03.616499 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b6421099-2d01-4608-bc9e-b50db935cb86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:03.618306 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1179/2365] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:03 2022] DELETE /identity/v3/projects/fabfb17a597c40e1a8987d79c40be118 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:03.623353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc3977-f637-4566-8b50-a4f341b3c3d7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:03.623867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc3977-f637-4566-8b50-a4f341b3c3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:03.623953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc3977-f637-4566-8b50-a4f341b3c3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:03.645638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f4bc3977-f637-4566-8b50-a4f341b3c3d7 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:03.647049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f4bc3977-f637-4566-8b50-a4f341b3c3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:03.698652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:03.709196 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1187/2366] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:03.716883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d75586-682d-42e5-b712-d78117578834 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:03.717389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d75586-682d-42e5-b712-d78117578834 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:03.717893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d75586-682d-42e5-b712-d78117578834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:03.739949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-45d75586-682d-42e5-b712-d78117578834 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:03.741381 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-45d75586-682d-42e5-b712-d78117578834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:03.753285 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1180/2367] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:03.758126 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc3977-f637-4566-8b50-a4f341b3c3d7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:03.768782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc3977-f637-4566-8b50-a4f341b3c3d7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:03.773809 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8d230-42c3-4cca-abcb-73bf9cec0bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:03.774695 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8d230-42c3-4cca-abcb-73bf9cec0bfb admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:03.774979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8d230-42c3-4cca-abcb-73bf9cec0bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:03.775253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8d230-42c3-4cca-abcb-73bf9cec0bfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:03.775992 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8d230-42c3-4cca-abcb-73bf9cec0bfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:20:03.776297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8d230-42c3-4cca-abcb-73bf9cec0bfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:03.777916 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8d230-42c3-4cca-abcb-73bf9cec0bfb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:03.794404 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1188/2368] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:20:03.795422 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d75586-682d-42e5-b712-d78117578834 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:03.804803 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d75586-682d-42e5-b712-d78117578834 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:03.809681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8ad42-c96e-4721-94f6-7b37744a8dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:03.810316 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8ad42-c96e-4721-94f6-7b37744a8dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:03.810599 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8ad42-c96e-4721-94f6-7b37744a8dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:03.810869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8ad42-c96e-4721-94f6-7b37744a8dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:03.811557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8ad42-c96e-4721-94f6-7b37744a8dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:03.815464 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8ad42-c96e-4721-94f6-7b37744a8dd0 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:03.829501 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:03.859473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1181/2369] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:03 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:03.863724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8d230-42c3-4cca-abcb-73bf9cec0bfb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:03.874869 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8d230-42c3-4cca-abcb-73bf9cec0bfb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:03.954952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6770d-9fe7-43de-b5f7-adf1dae29080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:03.956403 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6770d-9fe7-43de-b5f7-adf1dae29080 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:03.956653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6770d-9fe7-43de-b5f7-adf1dae29080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:03.956982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6770d-9fe7-43de-b5f7-adf1dae29080 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:03.957898 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6770d-9fe7-43de-b5f7-adf1dae29080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:03.959867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6770d-9fe7-43de-b5f7-adf1dae29080 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:03.985315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1189/2370] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:03 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:03.989342 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8ad42-c96e-4721-94f6-7b37744a8dd0 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:04.000359 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8ad42-c96e-4721-94f6-7b37744a8dd0 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:04.023883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620e836-dde9-482f-837e-2e3bd7ab05a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:04.025370 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620e836-dde9-482f-837e-2e3bd7ab05a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:04.025869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620e836-dde9-482f-837e-2e3bd7ab05a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:04.026866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620e836-dde9-482f-837e-2e3bd7ab05a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:04.027993 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620e836-dde9-482f-837e-2e3bd7ab05a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:04.031221 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620e836-dde9-482f-837e-2e3bd7ab05a2 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:04.046229 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1182/2371] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:04.048187 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6770d-9fe7-43de-b5f7-adf1dae29080 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:04.059243 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6770d-9fe7-43de-b5f7-adf1dae29080 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:04.065141 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c4613-0119-44a6-aec1-c7373441a95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:04.065757 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c4613-0119-44a6-aec1-c7373441a95a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:04.066066 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c4613-0119-44a6-aec1-c7373441a95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:04.066511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c4613-0119-44a6-aec1-c7373441a95a admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:04.067422 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c4613-0119-44a6-aec1-c7373441a95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:04.069048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c4613-0119-44a6-aec1-c7373441a95a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:04.085180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1190/2372] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:04.087825 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620e836-dde9-482f-837e-2e3bd7ab05a2 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:04.103489 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620e836-dde9-482f-837e-2e3bd7ab05a2 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:04.112294 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd39c10-a945-4eba-9c99-5f646afe1c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:04.114100 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd39c10-a945-4eba-9c99-5f646afe1c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:04.114974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd39c10-a945-4eba-9c99-5f646afe1c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:04.115356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd39c10-a945-4eba-9c99-5f646afe1c85 admin admin] PATH_INFO: `/v3/projects/f139fa958b094d1c80293eceda6efff4/users/e6c5e8721e994b5daf7c0ada0f0e3472/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:04.143607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd39c10-a945-4eba-9c99-5f646afe1c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f139fa958b094d1c80293eceda6efff4, user_id=e6c5e8721e994b5daf7c0ada0f0e3472, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:04.146801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd39c10-a945-4eba-9c99-5f646afe1c85 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:04.188542 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a2757-6407-4df2-8570-58e6a9eafe36 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:04.189093 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a2757-6407-4df2-8570-58e6a9eafe36 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:04.189378 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a2757-6407-4df2-8570-58e6a9eafe36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:04.203107 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1183/2373] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:04 2022] PUT /identity/v3/projects/f139fa958b094d1c80293eceda6efff4/users/e6c5e8721e994b5daf7c0ada0f0e3472/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:04.247053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c68a2757-6407-4df2-8570-58e6a9eafe36 None None] MFA Rules not processed for user `e6c5e8721e994b5daf7c0ada0f0e3472`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:04.248290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c68a2757-6407-4df2-8570-58e6a9eafe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:04.333806 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1191/2374] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:04.344402 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd39c10-a945-4eba-9c99-5f646afe1c85 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:04.346307 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-0bd39c10-a945-4eba-9c99-5f646afe1c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:04.421743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd39c10-a945-4eba-9c99-5f646afe1c85 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:04.427923 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1245cde-3a97-46d2-be9b-5b0ff26ba494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:04.428572 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1245cde-3a97-46d2-be9b-5b0ff26ba494 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:04.428854 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1245cde-3a97-46d2-be9b-5b0ff26ba494 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:04.429130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1245cde-3a97-46d2-be9b-5b0ff26ba494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:04.437085 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1245cde-3a97-46d2-be9b-5b0ff26ba494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:04.438965 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1245cde-3a97-46d2-be9b-5b0ff26ba494 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:04.449167 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1184/2375] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:04.680417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a2757-6407-4df2-8570-58e6a9eafe36 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:04.750561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:04.755163 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a2757-6407-4df2-8570-58e6a9eafe36 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:04.761779 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930332ed-a430-4188-aec5-16976324d850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:04.763233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930332ed-a430-4188-aec5-16976324d850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:04.764212 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930332ed-a430-4188-aec5-16976324d850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:04.764212 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930332ed-a430-4188-aec5-16976324d850 admin admin] PATH_INFO: `/v3/users/e6c5e8721e994b5daf7c0ada0f0e3472` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:04.767570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930332ed-a430-4188-aec5-16976324d850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c5e8721e994b5daf7c0ada0f0e3472)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:04.769706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930332ed-a430-4188-aec5-16976324d850 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:04.827795 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-930332ed-a430-4188-aec5-16976324d850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c5e8721e994b5daf7c0ada0f0e3472'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:04.828578 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-930332ed-a430-4188-aec5-16976324d850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c5e8721e994b5daf7c0ada0f0e3472'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:04.829326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-930332ed-a430-4188-aec5-16976324d850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c5e8721e994b5daf7c0ada0f0e3472'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:04.849720 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-930332ed-a430-4188-aec5-16976324d850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c5e8721e994b5daf7c0ada0f0e3472'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:04.862800 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-930332ed-a430-4188-aec5-16976324d850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c5e8721e994b5daf7c0ada0f0e3472'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:04.877226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1192/2376] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:04 2022] DELETE /identity/v3/users/e6c5e8721e994b5daf7c0ada0f0e3472 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:04.881654 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f44fdf-6e0d-4420-89fe-404e9287640e None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:04.881948 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f44fdf-6e0d-4420-89fe-404e9287640e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:04.882262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f44fdf-6e0d-4420-89fe-404e9287640e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:04.900887 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-c6f44fdf-6e0d-4420-89fe-404e9287640e None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:04.902382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c6f44fdf-6e0d-4420-89fe-404e9287640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:04.964009 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1185/2377] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:04.974610 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930332ed-a430-4188-aec5-16976324d850 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:04.976118 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-930332ed-a430-4188-aec5-16976324d850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:05.039175 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930332ed-a430-4188-aec5-16976324d850 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:05.043756 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997e7e5-79fc-4971-8ccf-0ffee33577ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:05.046699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997e7e5-79fc-4971-8ccf-0ffee33577ca service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:05.047019 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997e7e5-79fc-4971-8ccf-0ffee33577ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:05.047513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997e7e5-79fc-4971-8ccf-0ffee33577ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:05.059118 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997e7e5-79fc-4971-8ccf-0ffee33577ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:05.060716 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997e7e5-79fc-4971-8ccf-0ffee33577ca service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:05.072271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1193/2378] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:05.444926 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f44fdf-6e0d-4420-89fe-404e9287640e None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:05.446647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c6f44fdf-6e0d-4420-89fe-404e9287640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:05.470748 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f44fdf-6e0d-4420-89fe-404e9287640e None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:05.476077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ca3e5-7733-4643-8bbe-bb798d7904cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:05.477078 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ca3e5-7733-4643-8bbe-bb798d7904cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:05.477466 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ca3e5-7733-4643-8bbe-bb798d7904cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:05.477847 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ca3e5-7733-4643-8bbe-bb798d7904cf admin admin] PATH_INFO: `/v3/projects/f139fa958b094d1c80293eceda6efff4` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:05.479670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ca3e5-7733-4643-8bbe-bb798d7904cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f139fa958b094d1c80293eceda6efff4)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:05.482250 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ca3e5-7733-4643-8bbe-bb798d7904cf admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:05.529955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:05.551502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-525ca3e5-7733-4643-8bbe-bb798d7904cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f139fa958b094d1c80293eceda6efff4', 'request_id': 'req-525ca3e5-7733-4643-8bbe-bb798d7904cf'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:05.561565 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-525ca3e5-7733-4643-8bbe-bb798d7904cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f139fa958b094d1c80293eceda6efff4', 'request_id': 'req-525ca3e5-7733-4643-8bbe-bb798d7904cf'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:05.569140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-525ca3e5-7733-4643-8bbe-bb798d7904cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f139fa958b094d1c80293eceda6efff4', 'request_id': 'req-525ca3e5-7733-4643-8bbe-bb798d7904cf'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:05.585295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-525ca3e5-7733-4643-8bbe-bb798d7904cf admin admin] The token cache is being invalidate because project f139fa958b094d1c80293eceda6efff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:05.585684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-525ca3e5-7733-4643-8bbe-bb798d7904cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:05.586421 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-525ca3e5-7733-4643-8bbe-bb798d7904cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:05.587981 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1186/2379] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:05 2022] DELETE /identity/v3/projects/f139fa958b094d1c80293eceda6efff4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:05.592785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf9e3c-ad71-436b-a85c-734cc2f44eb1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:05.593079 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf9e3c-ad71-436b-a85c-734cc2f44eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:05.593352 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf9e3c-ad71-436b-a85c-734cc2f44eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:05.617198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cbaf9e3c-ad71-436b-a85c-734cc2f44eb1 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:05.618518 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cbaf9e3c-ad71-436b-a85c-734cc2f44eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:05.700874 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1194/2380] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:05.709240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad18e6e-5ed6-46cd-b745-b28c662aae56 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:05.709539 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad18e6e-5ed6-46cd-b745-b28c662aae56 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:05.709879 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad18e6e-5ed6-46cd-b745-b28c662aae56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:05.737116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-fad18e6e-5ed6-46cd-b745-b28c662aae56 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:05.738761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-fad18e6e-5ed6-46cd-b745-b28c662aae56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:05.763667 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1187/2381] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:05.767616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf9e3c-ad71-436b-a85c-734cc2f44eb1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:05.780737 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf9e3c-ad71-436b-a85c-734cc2f44eb1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:05.789060 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722859e-3fea-4edb-a3e4-7c922ded8d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:05.790648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722859e-3fea-4edb-a3e4-7c922ded8d36 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:05.791101 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722859e-3fea-4edb-a3e4-7c922ded8d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:05.791380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722859e-3fea-4edb-a3e4-7c922ded8d36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:05.792422 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722859e-3fea-4edb-a3e4-7c922ded8d36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:20:05.793059 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722859e-3fea-4edb-a3e4-7c922ded8d36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:05.794936 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722859e-3fea-4edb-a3e4-7c922ded8d36 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:05.822206 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1195/2382] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:20:05.825912 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad18e6e-5ed6-46cd-b745-b28c662aae56 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:05.845888 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad18e6e-5ed6-46cd-b745-b28c662aae56 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:05.878815 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026de2e9-4e9f-40aa-9820-ebd662ef95d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:05.879600 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026de2e9-4e9f-40aa-9820-ebd662ef95d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:05.879890 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026de2e9-4e9f-40aa-9820-ebd662ef95d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:05.880834 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026de2e9-4e9f-40aa-9820-ebd662ef95d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:05.881549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026de2e9-4e9f-40aa-9820-ebd662ef95d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:05.883695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026de2e9-4e9f-40aa-9820-ebd662ef95d0 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:05.914052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1188/2383] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:05 2022] POST /identity/v3/projects => generated 405 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:05.918635 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722859e-3fea-4edb-a3e4-7c922ded8d36 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:05.925621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:05.929760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722859e-3fea-4edb-a3e4-7c922ded8d36 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:05.995040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7666570-c1b2-4adb-8873-9bc2155d8781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:05.995717 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7666570-c1b2-4adb-8873-9bc2155d8781 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:05.995996 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7666570-c1b2-4adb-8873-9bc2155d8781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:05.996266 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7666570-c1b2-4adb-8873-9bc2155d8781 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:05.996968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7666570-c1b2-4adb-8873-9bc2155d8781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:05.998931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7666570-c1b2-4adb-8873-9bc2155d8781 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:06.021574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1196/2384] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:05 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:20:06.025440 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026de2e9-4e9f-40aa-9820-ebd662ef95d0 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:06.035950 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026de2e9-4e9f-40aa-9820-ebd662ef95d0 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:06.040549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bfc06-a89f-4e49-a319-54c59fbb2e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:06.041208 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bfc06-a89f-4e49-a319-54c59fbb2e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:06.041490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bfc06-a89f-4e49-a319-54c59fbb2e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:06.041768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bfc06-a89f-4e49-a319-54c59fbb2e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:06.042523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bfc06-a89f-4e49-a319-54c59fbb2e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:06.044110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bfc06-a89f-4e49-a319-54c59fbb2e1a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:06.054875 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1189/2385] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:06.060523 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7666570-c1b2-4adb-8873-9bc2155d8781 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:06.072971 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7666570-c1b2-4adb-8873-9bc2155d8781 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:06.079164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7c77d-47a9-436a-9510-a7522ec50342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:06.080499 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7c77d-47a9-436a-9510-a7522ec50342 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:06.080893 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7c77d-47a9-436a-9510-a7522ec50342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:06.081233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7c77d-47a9-436a-9510-a7522ec50342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:06.082199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7c77d-47a9-436a-9510-a7522ec50342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:06.084021 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7c77d-47a9-436a-9510-a7522ec50342 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:06.098383 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1197/2386] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:06.102578 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bfc06-a89f-4e49-a319-54c59fbb2e1a admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:06.119868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bfc06-a89f-4e49-a319-54c59fbb2e1a admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:06.127100 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c83ffb-f280-4f89-b192-a6481d04d423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:06.128263 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c83ffb-f280-4f89-b192-a6481d04d423 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:06.128684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c83ffb-f280-4f89-b192-a6481d04d423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:06.129416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c83ffb-f280-4f89-b192-a6481d04d423 admin admin] PATH_INFO: `/v3/projects/d77d9bb4458d4f3e96263577780594db/users/07255ad6db9542098eae77b5b1ecff79/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:06.154267 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c83ffb-f280-4f89-b192-a6481d04d423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77d9bb4458d4f3e96263577780594db, user_id=07255ad6db9542098eae77b5b1ecff79, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:06.157291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c83ffb-f280-4f89-b192-a6481d04d423 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:06.200503 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1190/2387] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:06 2022] PUT /identity/v3/projects/d77d9bb4458d4f3e96263577780594db/users/07255ad6db9542098eae77b5b1ecff79/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:06.206209 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182e705-9b2a-4b12-b2f3-cdf47e9b899e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:06.206742 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182e705-9b2a-4b12-b2f3-cdf47e9b899e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:06.207466 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182e705-9b2a-4b12-b2f3-cdf47e9b899e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:06.237908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1182e705-9b2a-4b12-b2f3-cdf47e9b899e None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:06.239481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1182e705-9b2a-4b12-b2f3-cdf47e9b899e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:06.314472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1198/2388] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:06.317541 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c83ffb-f280-4f89-b192-a6481d04d423 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:06.319867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c6c83ffb-f280-4f89-b192-a6481d04d423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:06.402488 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c83ffb-f280-4f89-b192-a6481d04d423 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:06.406626 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d18a95-10d2-4048-9a7d-e05e6627c808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:06.407549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d18a95-10d2-4048-9a7d-e05e6627c808 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:06.407808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d18a95-10d2-4048-9a7d-e05e6627c808 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:06.408166 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d18a95-10d2-4048-9a7d-e05e6627c808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:06.419998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d18a95-10d2-4048-9a7d-e05e6627c808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:06.421749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d18a95-10d2-4048-9a7d-e05e6627c808 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:06.437972 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1191/2389] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:07.343147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15047f4e-a888-429c-99ce-aa23687ea804 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:07.343612 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15047f4e-a888-429c-99ce-aa23687ea804 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:07.343909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15047f4e-a888-429c-99ce-aa23687ea804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:07.388434 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-15047f4e-a888-429c-99ce-aa23687ea804 None None] MFA Rules not processed for user `07255ad6db9542098eae77b5b1ecff79`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:07.389746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-15047f4e-a888-429c-99ce-aa23687ea804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:07.464943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1199/2390] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:07 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:07.469963 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d18a95-10d2-4048-9a7d-e05e6627c808 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:07.480119 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d18a95-10d2-4048-9a7d-e05e6627c808 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:07.489187 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5a214-91d0-4ec6-ad64-4ca845ae6ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:07.489871 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5a214-91d0-4ec6-ad64-4ca845ae6ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:07.490303 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5a214-91d0-4ec6-ad64-4ca845ae6ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:07.490597 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5a214-91d0-4ec6-ad64-4ca845ae6ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:07.491439 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5a214-91d0-4ec6-ad64-4ca845ae6ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:07.493428 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5a214-91d0-4ec6-ad64-4ca845ae6ea4 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:07.526041 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1192/2391] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:07 2022] POST /identity/v3/projects => generated 405 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:07.530038 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15047f4e-a888-429c-99ce-aa23687ea804 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:07.541207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15047f4e-a888-429c-99ce-aa23687ea804 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:07.553606 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:07.618557 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a88b16-a3e0-44e9-bbff-84abe9772d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:07.619525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a88b16-a3e0-44e9-bbff-84abe9772d8b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:07.620095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a88b16-a3e0-44e9-bbff-84abe9772d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:07.620367 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a88b16-a3e0-44e9-bbff-84abe9772d8b admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:07.621056 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a88b16-a3e0-44e9-bbff-84abe9772d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:07.623046 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a88b16-a3e0-44e9-bbff-84abe9772d8b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:07.645598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1200/2392] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:07 2022] POST /identity/v3/users => generated 309 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:07.649767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5a214-91d0-4ec6-ad64-4ca845ae6ea4 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:07.661317 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5a214-91d0-4ec6-ad64-4ca845ae6ea4 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:07.665762 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3be703-4d18-46a7-a9d3-0ee2509dc2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:07.666461 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3be703-4d18-46a7-a9d3-0ee2509dc2aa admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:07.666746 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3be703-4d18-46a7-a9d3-0ee2509dc2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:07.667016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3be703-4d18-46a7-a9d3-0ee2509dc2aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:07.667745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3be703-4d18-46a7-a9d3-0ee2509dc2aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:07.669331 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3be703-4d18-46a7-a9d3-0ee2509dc2aa admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:07.680977 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1193/2393] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:20:07.685384 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a88b16-a3e0-44e9-bbff-84abe9772d8b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:07.695680 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a88b16-a3e0-44e9-bbff-84abe9772d8b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:07.700314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce347b-c3b8-4a7d-945f-9e4168c88a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:07.701195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce347b-c3b8-4a7d-945f-9e4168c88a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:07.701472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce347b-c3b8-4a7d-945f-9e4168c88a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:07.701745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce347b-c3b8-4a7d-945f-9e4168c88a82 admin admin] PATH_INFO: `/v3/projects/5f8968e2541b4a56a01d58aa59e6eb14/users/d22a37437cbb4020a21c57966557910d/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:07.718225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce347b-c3b8-4a7d-945f-9e4168c88a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8968e2541b4a56a01d58aa59e6eb14, user_id=d22a37437cbb4020a21c57966557910d, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:07.721329 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce347b-c3b8-4a7d-945f-9e4168c88a82 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:07.736163 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1201/2394] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:07 2022] PUT /identity/v3/projects/5f8968e2541b4a56a01d58aa59e6eb14/users/d22a37437cbb4020a21c57966557910d/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:07.740521 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3be703-4d18-46a7-a9d3-0ee2509dc2aa admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:07.752276 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3be703-4d18-46a7-a9d3-0ee2509dc2aa admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:07.790043 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:07.832804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3833c-6d8e-4ae8-9a35-910866046177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:07.833515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3833c-6d8e-4ae8-9a35-910866046177 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:07.833804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3833c-6d8e-4ae8-9a35-910866046177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:07.834248 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3833c-6d8e-4ae8-9a35-910866046177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:07.835000 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3833c-6d8e-4ae8-9a35-910866046177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:07.836925 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3833c-6d8e-4ae8-9a35-910866046177 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:07.857851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1194/2395] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:07.859160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce347b-c3b8-4a7d-945f-9e4168c88a82 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:07.873519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce347b-c3b8-4a7d-945f-9e4168c88a82 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:07.880560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804ea36-efe1-4706-8dc7-6d6d2f9846fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:07.881516 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804ea36-efe1-4706-8dc7-6d6d2f9846fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:07.881758 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804ea36-efe1-4706-8dc7-6d6d2f9846fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:07.882062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804ea36-efe1-4706-8dc7-6d6d2f9846fb admin admin] PATH_INFO: `/v3/projects/5f8968e2541b4a56a01d58aa59e6eb14/users/d22a37437cbb4020a21c57966557910d/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:07.884103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804ea36-efe1-4706-8dc7-6d6d2f9846fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8968e2541b4a56a01d58aa59e6eb14, user_id=d22a37437cbb4020a21c57966557910d, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:07.887010 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804ea36-efe1-4706-8dc7-6d6d2f9846fb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:07.900522 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1202/2396] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:07 2022] PUT /identity/v3/projects/5f8968e2541b4a56a01d58aa59e6eb14/users/d22a37437cbb4020a21c57966557910d/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:09.516956 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0543a0-584b-4b9a-9522-992e7311a3ee None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:09.517523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0543a0-584b-4b9a-9522-992e7311a3ee None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:09.517523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0543a0-584b-4b9a-9522-992e7311a3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:09.578696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-4f0543a0-584b-4b9a-9522-992e7311a3ee None None] MFA Rules not processed for user `d22a37437cbb4020a21c57966557910d`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:09.582721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-4f0543a0-584b-4b9a-9522-992e7311a3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:09.718176 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1195/2397] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:09 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:11.144954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804ea36-efe1-4706-8dc7-6d6d2f9846fb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:11.146968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4804ea36-efe1-4706-8dc7-6d6d2f9846fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:11.220220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804ea36-efe1-4706-8dc7-6d6d2f9846fb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:11.228455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4a2e2-3d23-4396-9f27-639915f40f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:11.229382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0543a0-584b-4b9a-9522-992e7311a3ee None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:11.230416 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4a2e2-3d23-4396-9f27-639915f40f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:11.230733 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4a2e2-3d23-4396-9f27-639915f40f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:11.231124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4a2e2-3d23-4396-9f27-639915f40f84 admin admin] PATH_INFO: `/v3/users/32941ba0f04749a189cd031c1f3da14f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:11.233229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4a2e2-3d23-4396-9f27-639915f40f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32941ba0f04749a189cd031c1f3da14f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:11.235593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4a2e2-3d23-4396-9f27-639915f40f84 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:11.243642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0543a0-584b-4b9a-9522-992e7311a3ee None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:11.248581 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43547725-7129-44f9-93a1-15490528629a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:11.249592 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43547725-7129-44f9-93a1-15490528629a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:11.249946 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43547725-7129-44f9-93a1-15490528629a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:11.250356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43547725-7129-44f9-93a1-15490528629a admin admin] PATH_INFO: `/v3/users/07255ad6db9542098eae77b5b1ecff79` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:11.251692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43547725-7129-44f9-93a1-15490528629a admin admin] RBAC: Authorizing `identity:delete_user(user_id=07255ad6db9542098eae77b5b1ecff79)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:11.254462 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43547725-7129-44f9-93a1-15490528629a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:11.303943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5a4a2e2-3d23-4396-9f27-639915f40f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32941ba0f04749a189cd031c1f3da14f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.304609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5a4a2e2-3d23-4396-9f27-639915f40f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32941ba0f04749a189cd031c1f3da14f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.305488 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5a4a2e2-3d23-4396-9f27-639915f40f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32941ba0f04749a189cd031c1f3da14f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.312419 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-43547725-7129-44f9-93a1-15490528629a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07255ad6db9542098eae77b5b1ecff79'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.313082 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-43547725-7129-44f9-93a1-15490528629a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07255ad6db9542098eae77b5b1ecff79'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.314236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-43547725-7129-44f9-93a1-15490528629a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07255ad6db9542098eae77b5b1ecff79'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.325459 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5a4a2e2-3d23-4396-9f27-639915f40f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32941ba0f04749a189cd031c1f3da14f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.329695 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=85,keystone:INSERT=6,keystone:DELETE=9 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:11.335050 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-43547725-7129-44f9-93a1-15490528629a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07255ad6db9542098eae77b5b1ecff79'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.340701 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5a4a2e2-3d23-4396-9f27-639915f40f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32941ba0f04749a189cd031c1f3da14f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.346439 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-43547725-7129-44f9-93a1-15490528629a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07255ad6db9542098eae77b5b1ecff79'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.363179 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1203/2398] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:11 2022] DELETE /identity/v3/users/32941ba0f04749a189cd031c1f3da14f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:11.373701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1196/2399] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:11 2022] DELETE /identity/v3/users/07255ad6db9542098eae77b5b1ecff79 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:11.563233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4a2e2-3d23-4396-9f27-639915f40f84 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:11.565141 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c5a4a2e2-3d23-4396-9f27-639915f40f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:11.651186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4a2e2-3d23-4396-9f27-639915f40f84 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:11.688724 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43547725-7129-44f9-93a1-15490528629a admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:11.691692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-43547725-7129-44f9-93a1-15490528629a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:11.741444 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:11.743640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f40a0e-0299-4c77-a5f0-84702352161a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:11.743768 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f40a0e-0299-4c77-a5f0-84702352161a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:11.743961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f40a0e-0299-4c77-a5f0-84702352161a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:11.744320 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f40a0e-0299-4c77-a5f0-84702352161a admin admin] PATH_INFO: `/v3/projects/a806b437707e4d319493eb1d02ee2d8a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:11.745496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f40a0e-0299-4c77-a5f0-84702352161a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a806b437707e4d319493eb1d02ee2d8a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:11.748851 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f40a0e-0299-4c77-a5f0-84702352161a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:11.795793 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43547725-7129-44f9-93a1-15490528629a admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:11.800996 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894556ee-e092-475a-a07b-c942684db976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:11.801869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894556ee-e092-475a-a07b-c942684db976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:11.802222 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894556ee-e092-475a-a07b-c942684db976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:11.802678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894556ee-e092-475a-a07b-c942684db976 admin admin] PATH_INFO: `/v3/projects/d77d9bb4458d4f3e96263577780594db` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:11.804068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894556ee-e092-475a-a07b-c942684db976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d77d9bb4458d4f3e96263577780594db)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:11.806237 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894556ee-e092-475a-a07b-c942684db976 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:11.823862 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-13f40a0e-0299-4c77-a5f0-84702352161a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a806b437707e4d319493eb1d02ee2d8a', 'request_id': 'req-13f40a0e-0299-4c77-a5f0-84702352161a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.842063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-13f40a0e-0299-4c77-a5f0-84702352161a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a806b437707e4d319493eb1d02ee2d8a', 'request_id': 'req-13f40a0e-0299-4c77-a5f0-84702352161a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.855589 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-13f40a0e-0299-4c77-a5f0-84702352161a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a806b437707e4d319493eb1d02ee2d8a', 'request_id': 'req-13f40a0e-0299-4c77-a5f0-84702352161a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.870881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-894556ee-e092-475a-a07b-c942684db976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd77d9bb4458d4f3e96263577780594db', 'request_id': 'req-894556ee-e092-475a-a07b-c942684db976'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.879453 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-13f40a0e-0299-4c77-a5f0-84702352161a admin admin] The token cache is being invalidate because project a806b437707e4d319493eb1d02ee2d8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:11.879922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-13f40a0e-0299-4c77-a5f0-84702352161a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.880572 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-13f40a0e-0299-4c77-a5f0-84702352161a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.881527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-894556ee-e092-475a-a07b-c942684db976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd77d9bb4458d4f3e96263577780594db', 'request_id': 'req-894556ee-e092-475a-a07b-c942684db976'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.882633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1204/2400] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:11 2022] DELETE /identity/v3/projects/a806b437707e4d319493eb1d02ee2d8a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:11.887584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f40a0e-0299-4c77-a5f0-84702352161a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:11.889544 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-894556ee-e092-475a-a07b-c942684db976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd77d9bb4458d4f3e96263577780594db', 'request_id': 'req-894556ee-e092-475a-a07b-c942684db976'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.891645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-13f40a0e-0299-4c77-a5f0-84702352161a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:11.909898 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-894556ee-e092-475a-a07b-c942684db976 admin admin] The token cache is being invalidate because project d77d9bb4458d4f3e96263577780594db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:11.910291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-894556ee-e092-475a-a07b-c942684db976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.911312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-894556ee-e092-475a-a07b-c942684db976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:11.915940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1197/2401] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:11 2022] DELETE /identity/v3/projects/d77d9bb4458d4f3e96263577780594db => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:11.917208 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894556ee-e092-475a-a07b-c942684db976 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:11.919626 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-894556ee-e092-475a-a07b-c942684db976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:11.932316 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:11.984205 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f40a0e-0299-4c77-a5f0-84702352161a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:12.010021 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894556ee-e092-475a-a07b-c942684db976 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:12.016140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d12e6-a30f-4e9e-b8d7-14bfaa7acc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:12.016940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d12e6-a30f-4e9e-b8d7-14bfaa7acc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:12.017353 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d12e6-a30f-4e9e-b8d7-14bfaa7acc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:12.018485 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d12e6-a30f-4e9e-b8d7-14bfaa7acc3b admin admin] PATH_INFO: `/v3/users/d22a37437cbb4020a21c57966557910d` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:12.019756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d12e6-a30f-4e9e-b8d7-14bfaa7acc3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22a37437cbb4020a21c57966557910d)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:12.021908 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d12e6-a30f-4e9e-b8d7-14bfaa7acc3b admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:12.051342 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620097f4-8d2a-4d11-bc11-572cf90adfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:12.052515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620097f4-8d2a-4d11-bc11-572cf90adfef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:12.053128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620097f4-8d2a-4d11-bc11-572cf90adfef admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:12.053412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620097f4-8d2a-4d11-bc11-572cf90adfef admin admin] PATH_INFO: `/v3/users/1641b685a19c4c18ae3c7930f2ac552d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:12.054875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620097f4-8d2a-4d11-bc11-572cf90adfef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1641b685a19c4c18ae3c7930f2ac552d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:12.057036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620097f4-8d2a-4d11-bc11-572cf90adfef admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:12.077725 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-492d12e6-a30f-4e9e-b8d7-14bfaa7acc3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22a37437cbb4020a21c57966557910d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.078450 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-492d12e6-a30f-4e9e-b8d7-14bfaa7acc3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22a37437cbb4020a21c57966557910d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.079080 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-492d12e6-a30f-4e9e-b8d7-14bfaa7acc3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22a37437cbb4020a21c57966557910d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.088979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:12.095575 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-492d12e6-a30f-4e9e-b8d7-14bfaa7acc3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22a37437cbb4020a21c57966557910d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.109387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-492d12e6-a30f-4e9e-b8d7-14bfaa7acc3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22a37437cbb4020a21c57966557910d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.117067 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-620097f4-8d2a-4d11-bc11-572cf90adfef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1641b685a19c4c18ae3c7930f2ac552d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.117972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-620097f4-8d2a-4d11-bc11-572cf90adfef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1641b685a19c4c18ae3c7930f2ac552d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.118863 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-620097f4-8d2a-4d11-bc11-572cf90adfef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1641b685a19c4c18ae3c7930f2ac552d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.124542 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1198/2402] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:11 2022] DELETE /identity/v3/users/d22a37437cbb4020a21c57966557910d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:12.133824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-620097f4-8d2a-4d11-bc11-572cf90adfef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1641b685a19c4c18ae3c7930f2ac552d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.146575 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-620097f4-8d2a-4d11-bc11-572cf90adfef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1641b685a19c4c18ae3c7930f2ac552d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.162024 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1205/2403] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:11 2022] DELETE /identity/v3/users/1641b685a19c4c18ae3c7930f2ac552d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:12.344486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d12e6-a30f-4e9e-b8d7-14bfaa7acc3b admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:12.346491 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-492d12e6-a30f-4e9e-b8d7-14bfaa7acc3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:12.405399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620097f4-8d2a-4d11-bc11-572cf90adfef admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:12.407109 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-620097f4-8d2a-4d11-bc11-572cf90adfef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:12.442100 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d12e6-a30f-4e9e-b8d7-14bfaa7acc3b admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:12.468128 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:12.486059 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620097f4-8d2a-4d11-bc11-572cf90adfef admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:12.492194 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5536b-8af3-4e64-9413-bb2eddcf7615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:12.493069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5536b-8af3-4e64-9413-bb2eddcf7615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:12.493343 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5536b-8af3-4e64-9413-bb2eddcf7615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:12.493621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5536b-8af3-4e64-9413-bb2eddcf7615 admin admin] PATH_INFO: `/v3/projects/dd7457ac96994b3bb77bc72590760df3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:12.494844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5536b-8af3-4e64-9413-bb2eddcf7615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd7457ac96994b3bb77bc72590760df3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:12.496771 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5536b-8af3-4e64-9413-bb2eddcf7615 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:12.505695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb02180-fc02-4380-bf68-1b531d368e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:12.506779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb02180-fc02-4380-bf68-1b531d368e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:12.507123 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb02180-fc02-4380-bf68-1b531d368e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:12.507468 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb02180-fc02-4380-bf68-1b531d368e8c admin admin] PATH_INFO: `/v3/projects/5f8968e2541b4a56a01d58aa59e6eb14` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:12.508854 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb02180-fc02-4380-bf68-1b531d368e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8968e2541b4a56a01d58aa59e6eb14)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:12.511126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb02180-fc02-4380-bf68-1b531d368e8c admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:12.544513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0eb5536b-8af3-4e64-9413-bb2eddcf7615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd7457ac96994b3bb77bc72590760df3', 'request_id': 'req-0eb5536b-8af3-4e64-9413-bb2eddcf7615'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.551253 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0eb5536b-8af3-4e64-9413-bb2eddcf7615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd7457ac96994b3bb77bc72590760df3', 'request_id': 'req-0eb5536b-8af3-4e64-9413-bb2eddcf7615'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.558666 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0eb5536b-8af3-4e64-9413-bb2eddcf7615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd7457ac96994b3bb77bc72590760df3', 'request_id': 'req-0eb5536b-8af3-4e64-9413-bb2eddcf7615'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.562811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4cb02180-fc02-4380-bf68-1b531d368e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8968e2541b4a56a01d58aa59e6eb14', 'request_id': 'req-4cb02180-fc02-4380-bf68-1b531d368e8c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.571902 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4cb02180-fc02-4380-bf68-1b531d368e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8968e2541b4a56a01d58aa59e6eb14', 'request_id': 'req-4cb02180-fc02-4380-bf68-1b531d368e8c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.577976 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4cb02180-fc02-4380-bf68-1b531d368e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8968e2541b4a56a01d58aa59e6eb14', 'request_id': 'req-4cb02180-fc02-4380-bf68-1b531d368e8c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.582134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0eb5536b-8af3-4e64-9413-bb2eddcf7615 admin admin] The token cache is being invalidate because project dd7457ac96994b3bb77bc72590760df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:12.582536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0eb5536b-8af3-4e64-9413-bb2eddcf7615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.583192 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0eb5536b-8af3-4e64-9413-bb2eddcf7615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.584841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1206/2404] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:12 2022] DELETE /identity/v3/projects/dd7457ac96994b3bb77bc72590760df3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:12.590968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4cb02180-fc02-4380-bf68-1b531d368e8c admin admin] The token cache is being invalidate because project 5f8968e2541b4a56a01d58aa59e6eb14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:12.591330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4cb02180-fc02-4380-bf68-1b531d368e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.592080 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4cb02180-fc02-4380-bf68-1b531d368e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:12.594305 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1199/2405] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:12 2022] DELETE /identity/v3/projects/5f8968e2541b4a56a01d58aa59e6eb14 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:12.600013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d4f53-2e7d-40f6-b572-f64c53908c1d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:12.600293 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d4f53-2e7d-40f6-b572-f64c53908c1d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:12.600634 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d4f53-2e7d-40f6-b572-f64c53908c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:12.623450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-eb9d4f53-2e7d-40f6-b572-f64c53908c1d None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:12.624234 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-eb9d4f53-2e7d-40f6-b572-f64c53908c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:12.690936 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1207/2406] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:12.698850 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ac453-138d-4edd-9192-095a94539243 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:12.699141 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ac453-138d-4edd-9192-095a94539243 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:12.699417 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ac453-138d-4edd-9192-095a94539243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:12.720275 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-605ac453-138d-4edd-9192-095a94539243 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:12.722125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-605ac453-138d-4edd-9192-095a94539243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:12.730169 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1200/2407] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:12.734883 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d4f53-2e7d-40f6-b572-f64c53908c1d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:12.745753 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d4f53-2e7d-40f6-b572-f64c53908c1d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:12.750708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25fe40-d8a8-4cd4-a13b-bca92fabccff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:12.751401 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25fe40-d8a8-4cd4-a13b-bca92fabccff admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:12.751684 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25fe40-d8a8-4cd4-a13b-bca92fabccff admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:12.751961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25fe40-d8a8-4cd4-a13b-bca92fabccff admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:12.752768 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25fe40-d8a8-4cd4-a13b-bca92fabccff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:20:12.753055 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25fe40-d8a8-4cd4-a13b-bca92fabccff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:12.754760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25fe40-d8a8-4cd4-a13b-bca92fabccff admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:12.767638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1208/2408] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:20:12.772732 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ac453-138d-4edd-9192-095a94539243 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:12.778729 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:12.783140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ac453-138d-4edd-9192-095a94539243 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:12.790709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03108d1-8a2a-418c-9e1f-a4eef324f04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:12.791487 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03108d1-8a2a-418c-9e1f-a4eef324f04a admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:12.791842 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03108d1-8a2a-418c-9e1f-a4eef324f04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:12.792397 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03108d1-8a2a-418c-9e1f-a4eef324f04a admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:12.793615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03108d1-8a2a-418c-9e1f-a4eef324f04a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:12.795938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03108d1-8a2a-418c-9e1f-a4eef324f04a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:12.828842 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1201/2409] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:12 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:20:12.830101 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25fe40-d8a8-4cd4-a13b-bca92fabccff admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:12.841096 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25fe40-d8a8-4cd4-a13b-bca92fabccff admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:12.898906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff8cdf-dddb-4512-8fda-b8d9c8367898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:12.899495 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff8cdf-dddb-4512-8fda-b8d9c8367898 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:12.899777 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff8cdf-dddb-4512-8fda-b8d9c8367898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:12.900051 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff8cdf-dddb-4512-8fda-b8d9c8367898 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:12.900727 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff8cdf-dddb-4512-8fda-b8d9c8367898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:12.902687 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff8cdf-dddb-4512-8fda-b8d9c8367898 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:12.913186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:12.925276 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1209/2410] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:12 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:12.929381 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03108d1-8a2a-418c-9e1f-a4eef324f04a admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:12.940581 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03108d1-8a2a-418c-9e1f-a4eef324f04a admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:12.945204 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b992ba-ec24-48da-938c-fc61e1040ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:12.945869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b992ba-ec24-48da-938c-fc61e1040ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:12.946197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b992ba-ec24-48da-938c-fc61e1040ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:12.946470 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b992ba-ec24-48da-938c-fc61e1040ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:12.947193 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b992ba-ec24-48da-938c-fc61e1040ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:12.948759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b992ba-ec24-48da-938c-fc61e1040ce8 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:12.959421 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1202/2411] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:12.963511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff8cdf-dddb-4512-8fda-b8d9c8367898 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:12.973371 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff8cdf-dddb-4512-8fda-b8d9c8367898 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:12.978031 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bd2e7-96b9-4940-8006-0e7a2aed81e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:12.978683 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bd2e7-96b9-4940-8006-0e7a2aed81e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:12.978967 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bd2e7-96b9-4940-8006-0e7a2aed81e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:12.979245 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bd2e7-96b9-4940-8006-0e7a2aed81e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:12.979971 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bd2e7-96b9-4940-8006-0e7a2aed81e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:12.981568 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bd2e7-96b9-4940-8006-0e7a2aed81e4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:12.992146 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1210/2412] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:20:12.995984 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b992ba-ec24-48da-938c-fc61e1040ce8 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:13.006253 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b992ba-ec24-48da-938c-fc61e1040ce8 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:13.010850 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6286b2-e3f6-4d3b-9348-199db5daa522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:13.011723 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6286b2-e3f6-4d3b-9348-199db5daa522 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:13.012009 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6286b2-e3f6-4d3b-9348-199db5daa522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:13.012289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6286b2-e3f6-4d3b-9348-199db5daa522 admin admin] PATH_INFO: `/v3/projects/b1f8687de604463489ff608076ed0c37/users/89580849d33043eb8426b2791b0f0366/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:13.026949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6286b2-e3f6-4d3b-9348-199db5daa522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f8687de604463489ff608076ed0c37, user_id=89580849d33043eb8426b2791b0f0366, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:13.029583 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6286b2-e3f6-4d3b-9348-199db5daa522 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:13.042097 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1203/2413] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:12 2022] PUT /identity/v3/projects/b1f8687de604463489ff608076ed0c37/users/89580849d33043eb8426b2791b0f0366/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:13.052107 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee0b9d-7c65-4342-b715-f947d469c12d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:13.052396 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee0b9d-7c65-4342-b715-f947d469c12d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:13.052671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee0b9d-7c65-4342-b715-f947d469c12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:13.080977 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3eee0b9d-7c65-4342-b715-f947d469c12d None None] MFA Rules not processed for user `89580849d33043eb8426b2791b0f0366`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:13.082264 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3eee0b9d-7c65-4342-b715-f947d469c12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:13.150915 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1211/2414] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:13.155246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6286b2-e3f6-4d3b-9348-199db5daa522 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:13.216163 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6286b2-e3f6-4d3b-9348-199db5daa522 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:13.220842 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afd690-3957-4567-b637-c88e62c71131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:13.221508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afd690-3957-4567-b637-c88e62c71131 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:13.221795 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afd690-3957-4567-b637-c88e62c71131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:13.222101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afd690-3957-4567-b637-c88e62c71131 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:13.222802 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afd690-3957-4567-b637-c88e62c71131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:13.224707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afd690-3957-4567-b637-c88e62c71131 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:13.254055 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1204/2415] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:13 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:13.258556 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee0b9d-7c65-4342-b715-f947d469c12d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:13.269049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee0b9d-7c65-4342-b715-f947d469c12d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:13.323602 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a250eb-7722-45e7-994a-158c2f5b43b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:13.324262 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a250eb-7722-45e7-994a-158c2f5b43b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:13.324537 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a250eb-7722-45e7-994a-158c2f5b43b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:13.324806 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a250eb-7722-45e7-994a-158c2f5b43b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:13.325494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a250eb-7722-45e7-994a-158c2f5b43b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:13.327431 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a250eb-7722-45e7-994a-158c2f5b43b1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:13.347402 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1212/2416] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:13 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:13.351378 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afd690-3957-4567-b637-c88e62c71131 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:13.362518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afd690-3957-4567-b637-c88e62c71131 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:13.367308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e6a8e-5678-4344-9241-3cace97623fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:13.367964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e6a8e-5678-4344-9241-3cace97623fb admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:13.368245 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e6a8e-5678-4344-9241-3cace97623fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:13.368519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e6a8e-5678-4344-9241-3cace97623fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:13.369240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e6a8e-5678-4344-9241-3cace97623fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:13.373044 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e6a8e-5678-4344-9241-3cace97623fb admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:13.388750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1205/2417] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:20:13.390119 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a250eb-7722-45e7-994a-158c2f5b43b1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:13.401243 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a250eb-7722-45e7-994a-158c2f5b43b1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:13.406023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b01ef-4243-45af-be56-9d015b9e03b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:13.406918 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b01ef-4243-45af-be56-9d015b9e03b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:13.407195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b01ef-4243-45af-be56-9d015b9e03b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:13.407520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b01ef-4243-45af-be56-9d015b9e03b4 admin admin] PATH_INFO: `/v3/projects/aaec57fddfe74e2baece121ae328ed4c/users/32f5988cb73841e48171235b0717b5fc/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:13.422136 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b01ef-4243-45af-be56-9d015b9e03b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaec57fddfe74e2baece121ae328ed4c, user_id=32f5988cb73841e48171235b0717b5fc, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:13.425348 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b01ef-4243-45af-be56-9d015b9e03b4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:13.438623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1213/2418] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:13 2022] PUT /identity/v3/projects/aaec57fddfe74e2baece121ae328ed4c/users/32f5988cb73841e48171235b0717b5fc/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:13.451939 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e6a8e-5678-4344-9241-3cace97623fb admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:13.462533 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e6a8e-5678-4344-9241-3cace97623fb admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:13.521630 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971472cb-3cc7-40cd-957a-2fb5a4496149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:13.522339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971472cb-3cc7-40cd-957a-2fb5a4496149 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:13.522627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971472cb-3cc7-40cd-957a-2fb5a4496149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:13.522906 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971472cb-3cc7-40cd-957a-2fb5a4496149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:13.523667 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971472cb-3cc7-40cd-957a-2fb5a4496149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:13.525264 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971472cb-3cc7-40cd-957a-2fb5a4496149 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:13.536042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1206/2419] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:13.540772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b01ef-4243-45af-be56-9d015b9e03b4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:13.552110 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b01ef-4243-45af-be56-9d015b9e03b4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:13.556920 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc47ca7-99e4-45e9-acb4-6e3f8bdb9657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:13.557819 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc47ca7-99e4-45e9-acb4-6e3f8bdb9657 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:13.558140 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc47ca7-99e4-45e9-acb4-6e3f8bdb9657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:13.558448 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc47ca7-99e4-45e9-acb4-6e3f8bdb9657 admin admin] PATH_INFO: `/v3/projects/aaec57fddfe74e2baece121ae328ed4c/users/32f5988cb73841e48171235b0717b5fc/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:13.560478 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc47ca7-99e4-45e9-acb4-6e3f8bdb9657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaec57fddfe74e2baece121ae328ed4c, user_id=32f5988cb73841e48171235b0717b5fc, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:13.563308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc47ca7-99e4-45e9-acb4-6e3f8bdb9657 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:13.575388 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1214/2420] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:13 2022] PUT /identity/v3/projects/aaec57fddfe74e2baece121ae328ed4c/users/32f5988cb73841e48171235b0717b5fc/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:13.587098 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cc0e1-8e96-4df4-9ae3-7457f755d6c8 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:13.587394 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cc0e1-8e96-4df4-9ae3-7457f755d6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:13.587680 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cc0e1-8e96-4df4-9ae3-7457f755d6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:13.616606 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-336cc0e1-8e96-4df4-9ae3-7457f755d6c8 None None] MFA Rules not processed for user `32f5988cb73841e48171235b0717b5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:13.617866 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-336cc0e1-8e96-4df4-9ae3-7457f755d6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:13.623398 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:13.687436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1207/2421] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:13.698820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc47ca7-99e4-45e9-acb4-6e3f8bdb9657 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:13.700586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6bc47ca7-99e4-45e9-acb4-6e3f8bdb9657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:13.731615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:13.759269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc47ca7-99e4-45e9-acb4-6e3f8bdb9657 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:13.762962 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfd7d3-d179-4f95-9a73-52d1c9cf093b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:13.763631 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfd7d3-d179-4f95-9a73-52d1c9cf093b service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:13.764024 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfd7d3-d179-4f95-9a73-52d1c9cf093b service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:13.764470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfd7d3-d179-4f95-9a73-52d1c9cf093b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:13.773498 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfd7d3-d179-4f95-9a73-52d1c9cf093b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:13.774958 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfd7d3-d179-4f95-9a73-52d1c9cf093b service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:13.784810 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1215/2422] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:14.167143 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cc0e1-8e96-4df4-9ae3-7457f755d6c8 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:14.228895 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cc0e1-8e96-4df4-9ae3-7457f755d6c8 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:14.233500 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c51063-2d2c-4cd3-9b70-c8dd35a5fc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:14.234397 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c51063-2d2c-4cd3-9b70-c8dd35a5fc9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:14.234681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c51063-2d2c-4cd3-9b70-c8dd35a5fc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:14.234959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c51063-2d2c-4cd3-9b70-c8dd35a5fc9f admin admin] PATH_INFO: `/v3/users/89580849d33043eb8426b2791b0f0366` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:14.236151 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c51063-2d2c-4cd3-9b70-c8dd35a5fc9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=89580849d33043eb8426b2791b0f0366)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:14.238597 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c51063-2d2c-4cd3-9b70-c8dd35a5fc9f admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:14.284121 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c7c51063-2d2c-4cd3-9b70-c8dd35a5fc9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89580849d33043eb8426b2791b0f0366'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:14.284774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c7c51063-2d2c-4cd3-9b70-c8dd35a5fc9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89580849d33043eb8426b2791b0f0366'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:14.285382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c7c51063-2d2c-4cd3-9b70-c8dd35a5fc9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89580849d33043eb8426b2791b0f0366'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:14.297220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c7c51063-2d2c-4cd3-9b70-c8dd35a5fc9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89580849d33043eb8426b2791b0f0366'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:14.304519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c7c51063-2d2c-4cd3-9b70-c8dd35a5fc9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89580849d33043eb8426b2791b0f0366'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:14.318240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1208/2423] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:14 2022] DELETE /identity/v3/users/89580849d33043eb8426b2791b0f0366 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:14.322884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07960dfd-d635-4bfc-9029-b4a2cd981406 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:14.323363 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07960dfd-d635-4bfc-9029-b4a2cd981406 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:14.323461 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07960dfd-d635-4bfc-9029-b4a2cd981406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:14.342892 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-07960dfd-d635-4bfc-9029-b4a2cd981406 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:14.344102 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-07960dfd-d635-4bfc-9029-b4a2cd981406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:14.403664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1216/2424] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:14.413850 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c51063-2d2c-4cd3-9b70-c8dd35a5fc9f admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:14.415577 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c7c51063-2d2c-4cd3-9b70-c8dd35a5fc9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:14.442153 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:14.474258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c51063-2d2c-4cd3-9b70-c8dd35a5fc9f admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:14.477858 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8d88c-1f07-464a-9469-ef32d5547286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:14.478529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8d88c-1f07-464a-9469-ef32d5547286 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:14.478812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8d88c-1f07-464a-9469-ef32d5547286 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:14.479086 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8d88c-1f07-464a-9469-ef32d5547286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:14.488641 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8d88c-1f07-464a-9469-ef32d5547286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:14.490117 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8d88c-1f07-464a-9469-ef32d5547286 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:14.499709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1209/2425] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:14.780904 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07960dfd-d635-4bfc-9029-b4a2cd981406 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:14.782397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-07960dfd-d635-4bfc-9029-b4a2cd981406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:14.806932 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07960dfd-d635-4bfc-9029-b4a2cd981406 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:14.812479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e62d5-2c0c-482c-8799-68e6ad3207cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:14.813398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e62d5-2c0c-482c-8799-68e6ad3207cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:14.813640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e62d5-2c0c-482c-8799-68e6ad3207cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:14.814174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e62d5-2c0c-482c-8799-68e6ad3207cc admin admin] PATH_INFO: `/v3/projects/b1f8687de604463489ff608076ed0c37` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:14.815439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e62d5-2c0c-482c-8799-68e6ad3207cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f8687de604463489ff608076ed0c37)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:14.817456 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e62d5-2c0c-482c-8799-68e6ad3207cc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:14.865991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0b6e62d5-2c0c-482c-8799-68e6ad3207cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f8687de604463489ff608076ed0c37', 'request_id': 'req-0b6e62d5-2c0c-482c-8799-68e6ad3207cc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:14.871504 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0b6e62d5-2c0c-482c-8799-68e6ad3207cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f8687de604463489ff608076ed0c37', 'request_id': 'req-0b6e62d5-2c0c-482c-8799-68e6ad3207cc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:14.877655 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0b6e62d5-2c0c-482c-8799-68e6ad3207cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f8687de604463489ff608076ed0c37', 'request_id': 'req-0b6e62d5-2c0c-482c-8799-68e6ad3207cc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:14.890412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0b6e62d5-2c0c-482c-8799-68e6ad3207cc admin admin] The token cache is being invalidate because project b1f8687de604463489ff608076ed0c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:14.890699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0b6e62d5-2c0c-482c-8799-68e6ad3207cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:14.891316 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0b6e62d5-2c0c-482c-8799-68e6ad3207cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:14.894197 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1217/2426] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:14 2022] DELETE /identity/v3/projects/b1f8687de604463489ff608076ed0c37 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:14.898182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8d88c-1f07-464a-9469-ef32d5547286 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:14.909319 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8d88c-1f07-464a-9469-ef32d5547286 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:14.966196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dcb6e-fc89-44aa-ad60-9cb58051e9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:14.967066 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dcb6e-fc89-44aa-ad60-9cb58051e9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:14.967384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dcb6e-fc89-44aa-ad60-9cb58051e9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:14.967698 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dcb6e-fc89-44aa-ad60-9cb58051e9e9 admin admin] PATH_INFO: `/v3/users/32f5988cb73841e48171235b0717b5fc` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:14.968972 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dcb6e-fc89-44aa-ad60-9cb58051e9e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32f5988cb73841e48171235b0717b5fc)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:14.971703 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dcb6e-fc89-44aa-ad60-9cb58051e9e9 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:15.140082 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-ff7dcb6e-fc89-44aa-ad60-9cb58051e9e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32f5988cb73841e48171235b0717b5fc'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:15.140729 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-ff7dcb6e-fc89-44aa-ad60-9cb58051e9e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32f5988cb73841e48171235b0717b5fc'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:15.141328 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-ff7dcb6e-fc89-44aa-ad60-9cb58051e9e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32f5988cb73841e48171235b0717b5fc'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:15.154177 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-ff7dcb6e-fc89-44aa-ad60-9cb58051e9e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32f5988cb73841e48171235b0717b5fc'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:15.161817 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-ff7dcb6e-fc89-44aa-ad60-9cb58051e9e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32f5988cb73841e48171235b0717b5fc'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:15.176662 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1210/2427] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:14 2022] DELETE /identity/v3/users/32f5988cb73841e48171235b0717b5fc => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:15.461159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e62d5-2c0c-482c-8799-68e6ad3207cc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:15.462698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0b6e62d5-2c0c-482c-8799-68e6ad3207cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:15.483537 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e62d5-2c0c-482c-8799-68e6ad3207cc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:15.539520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:15.552396 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bb415-e284-4817-87c6-ecaef3721556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:15.553504 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bb415-e284-4817-87c6-ecaef3721556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:15.553884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bb415-e284-4817-87c6-ecaef3721556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:15.554649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bb415-e284-4817-87c6-ecaef3721556 admin admin] PATH_INFO: `/v3/projects/aaec57fddfe74e2baece121ae328ed4c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:15.556048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bb415-e284-4817-87c6-ecaef3721556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaec57fddfe74e2baece121ae328ed4c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:15.558785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bb415-e284-4817-87c6-ecaef3721556 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:15.606789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8f4bb415-e284-4817-87c6-ecaef3721556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaec57fddfe74e2baece121ae328ed4c', 'request_id': 'req-8f4bb415-e284-4817-87c6-ecaef3721556'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:15.612599 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8f4bb415-e284-4817-87c6-ecaef3721556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaec57fddfe74e2baece121ae328ed4c', 'request_id': 'req-8f4bb415-e284-4817-87c6-ecaef3721556'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:15.618547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8f4bb415-e284-4817-87c6-ecaef3721556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaec57fddfe74e2baece121ae328ed4c', 'request_id': 'req-8f4bb415-e284-4817-87c6-ecaef3721556'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:15.630717 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8f4bb415-e284-4817-87c6-ecaef3721556 admin admin] The token cache is being invalidate because project aaec57fddfe74e2baece121ae328ed4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:15.630998 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8f4bb415-e284-4817-87c6-ecaef3721556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:15.631610 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8f4bb415-e284-4817-87c6-ecaef3721556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:15.633132 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1218/2428] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:15 2022] DELETE /identity/v3/projects/aaec57fddfe74e2baece121ae328ed4c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:15.638148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d81647-08e2-4bea-b61d-aa28aba33757 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:15.638600 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d81647-08e2-4bea-b61d-aa28aba33757 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:15.638695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d81647-08e2-4bea-b61d-aa28aba33757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:15.657545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-b8d81647-08e2-4bea-b61d-aa28aba33757 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:15.658783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b8d81647-08e2-4bea-b61d-aa28aba33757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:15.699990 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:15.729320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1211/2429] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:15.729531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396db8f-66d9-43ca-a788-5287d64dfb36 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:15.729831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396db8f-66d9-43ca-a788-5287d64dfb36 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:15.730143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396db8f-66d9-43ca-a788-5287d64dfb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:15.754713 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1396db8f-66d9-43ca-a788-5287d64dfb36 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:15.756285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1396db8f-66d9-43ca-a788-5287d64dfb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:15.770148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1219/2430] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:20:15.772138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d81647-08e2-4bea-b61d-aa28aba33757 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:15.783225 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d81647-08e2-4bea-b61d-aa28aba33757 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:15.791701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ae628-c44c-42eb-9ed0-63ccf9401d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:15.792527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ae628-c44c-42eb-9ed0-63ccf9401d63 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:15.792896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ae628-c44c-42eb-9ed0-63ccf9401d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:15.793240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ae628-c44c-42eb-9ed0-63ccf9401d63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:15.794147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ae628-c44c-42eb-9ed0-63ccf9401d63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:20:15.794796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ae628-c44c-42eb-9ed0-63ccf9401d63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:15.796502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ae628-c44c-42eb-9ed0-63ccf9401d63 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:15.817932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1212/2431] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:20:15.819068 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396db8f-66d9-43ca-a788-5287d64dfb36 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:15.831291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ae628-c44c-42eb-9ed0-63ccf9401d63 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:15.833713 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-3c3ae628-c44c-42eb-9ed0-63ccf9401d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:15.833842 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396db8f-66d9-43ca-a788-5287d64dfb36 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:15.843398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e93d90-7a0f-4f47-88ed-53613f5984b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:15.844362 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e93d90-7a0f-4f47-88ed-53613f5984b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:15.845228 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e93d90-7a0f-4f47-88ed-53613f5984b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:15.845569 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e93d90-7a0f-4f47-88ed-53613f5984b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:15.847140 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e93d90-7a0f-4f47-88ed-53613f5984b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:15.849729 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e93d90-7a0f-4f47-88ed-53613f5984b4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:15.883537 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1220/2432] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:15 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:15.887781 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e93d90-7a0f-4f47-88ed-53613f5984b4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:15.902212 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ae628-c44c-42eb-9ed0-63ccf9401d63 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:15.957525 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace81ca-26c5-4af8-93fc-aa9792c1cfdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:15.958211 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace81ca-26c5-4af8-93fc-aa9792c1cfdd service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:15.958491 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace81ca-26c5-4af8-93fc-aa9792c1cfdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:15.958761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace81ca-26c5-4af8-93fc-aa9792c1cfdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:15.959961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e93d90-7a0f-4f47-88ed-53613f5984b4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:15.960557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-7ace81ca-26c5-4af8-93fc-aa9792c1cfdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:15.965632 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf139e-0aab-4199-942c-c263447f0b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:15.966345 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf139e-0aab-4199-942c-c263447f0b78 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:15.966637 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf139e-0aab-4199-942c-c263447f0b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:15.967168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf139e-0aab-4199-942c-c263447f0b78 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:15.967884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf139e-0aab-4199-942c-c263447f0b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:15.970028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf139e-0aab-4199-942c-c263447f0b78 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:15.975845 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace81ca-26c5-4af8-93fc-aa9792c1cfdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:15.977416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace81ca-26c5-4af8-93fc-aa9792c1cfdd service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:15.989568 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1213/2433] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:20:15.997346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1221/2434] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:15 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:20:16.002059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace81ca-26c5-4af8-93fc-aa9792c1cfdd service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:16.012040 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace81ca-26c5-4af8-93fc-aa9792c1cfdd service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:16.016852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980b7d3-e26b-4383-be48-c83b85ff319d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:16.017520 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980b7d3-e26b-4383-be48-c83b85ff319d admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:16.017844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980b7d3-e26b-4383-be48-c83b85ff319d admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:16.018160 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980b7d3-e26b-4383-be48-c83b85ff319d admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:16.018887 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980b7d3-e26b-4383-be48-c83b85ff319d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:16.020486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980b7d3-e26b-4383-be48-c83b85ff319d admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:16.031024 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1214/2435] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:16.035452 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf139e-0aab-4199-942c-c263447f0b78 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:16.045484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf139e-0aab-4199-942c-c263447f0b78 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:16.051202 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9f292-27e6-420d-9bf8-2660c5c11f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:16.051876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9f292-27e6-420d-9bf8-2660c5c11f2c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:16.052163 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9f292-27e6-420d-9bf8-2660c5c11f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:16.052442 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9f292-27e6-420d-9bf8-2660c5c11f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:16.053172 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9f292-27e6-420d-9bf8-2660c5c11f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:16.054965 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9f292-27e6-420d-9bf8-2660c5c11f2c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:16.065981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1222/2436] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:16.070503 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980b7d3-e26b-4383-be48-c83b85ff319d admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:16.080582 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980b7d3-e26b-4383-be48-c83b85ff319d admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:16.085231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f58e56-832b-4ca4-accb-f4c85d979e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:16.086141 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f58e56-832b-4ca4-accb-f4c85d979e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:16.086426 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f58e56-832b-4ca4-accb-f4c85d979e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:16.086700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f58e56-832b-4ca4-accb-f4c85d979e62 admin admin] PATH_INFO: `/v3/projects/e9c59bc3ec4d49b8a8f4f652430423d1/users/aba6c6237c3049c19f0a9a0886972e2b/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:16.101924 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f58e56-832b-4ca4-accb-f4c85d979e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c59bc3ec4d49b8a8f4f652430423d1, user_id=aba6c6237c3049c19f0a9a0886972e2b, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:16.104592 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f58e56-832b-4ca4-accb-f4c85d979e62 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:16.118364 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1215/2437] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:16 2022] PUT /identity/v3/projects/e9c59bc3ec4d49b8a8f4f652430423d1/users/aba6c6237c3049c19f0a9a0886972e2b/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:16.128853 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec356ecb-9b01-4d53-b530-7d50cab10ba6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:16.129141 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec356ecb-9b01-4d53-b530-7d50cab10ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:16.129414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec356ecb-9b01-4d53-b530-7d50cab10ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:16.157595 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ec356ecb-9b01-4d53-b530-7d50cab10ba6 None None] MFA Rules not processed for user `aba6c6237c3049c19f0a9a0886972e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:16.159390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ec356ecb-9b01-4d53-b530-7d50cab10ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:16.181103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:16.233845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1223/2438] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:16.238565 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f58e56-832b-4ca4-accb-f4c85d979e62 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:16.297809 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:16.304239 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f58e56-832b-4ca4-accb-f4c85d979e62 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:16.309289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36fcd0-1fb4-43f6-bb68-0316e3df5ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:16.309946 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36fcd0-1fb4-43f6-bb68-0316e3df5ffe admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:16.310265 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36fcd0-1fb4-43f6-bb68-0316e3df5ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:16.310542 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36fcd0-1fb4-43f6-bb68-0316e3df5ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:16.311251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36fcd0-1fb4-43f6-bb68-0316e3df5ffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:16.313152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36fcd0-1fb4-43f6-bb68-0316e3df5ffe admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:16.342364 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1216/2439] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:16 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:16.346433 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec356ecb-9b01-4d53-b530-7d50cab10ba6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:16.357770 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec356ecb-9b01-4d53-b530-7d50cab10ba6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:16.416776 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0306b4c-4689-4a57-9526-3c2143233661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:16.417445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0306b4c-4689-4a57-9526-3c2143233661 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:16.417730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0306b4c-4689-4a57-9526-3c2143233661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:16.418197 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0306b4c-4689-4a57-9526-3c2143233661 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:16.418918 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0306b4c-4689-4a57-9526-3c2143233661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:16.420911 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0306b4c-4689-4a57-9526-3c2143233661 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:16.443250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1224/2440] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:16 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:20:16.447332 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36fcd0-1fb4-43f6-bb68-0316e3df5ffe admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:16.458135 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36fcd0-1fb4-43f6-bb68-0316e3df5ffe admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:16.462934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f58e69-1b44-47df-8b92-a9292aeaeb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:16.463737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f58e69-1b44-47df-8b92-a9292aeaeb29 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:16.464026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f58e69-1b44-47df-8b92-a9292aeaeb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:16.464309 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f58e69-1b44-47df-8b92-a9292aeaeb29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:16.465156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f58e69-1b44-47df-8b92-a9292aeaeb29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:16.466794 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f58e69-1b44-47df-8b92-a9292aeaeb29 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:16.479695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1217/2441] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:16.483837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0306b4c-4689-4a57-9526-3c2143233661 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:16.493771 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0306b4c-4689-4a57-9526-3c2143233661 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:16.498575 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb078c-ee2a-4d79-8ac2-1392a6cb72e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:16.499530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb078c-ee2a-4d79-8ac2-1392a6cb72e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:16.499708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb078c-ee2a-4d79-8ac2-1392a6cb72e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:16.499988 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb078c-ee2a-4d79-8ac2-1392a6cb72e9 admin admin] PATH_INFO: `/v3/projects/8d7bc9e792b14b298996b111d1536113/users/a0b3b556640a43ac95192d04a23f8c3e/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:16.517559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb078c-ee2a-4d79-8ac2-1392a6cb72e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7bc9e792b14b298996b111d1536113, user_id=a0b3b556640a43ac95192d04a23f8c3e, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:16.520920 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb078c-ee2a-4d79-8ac2-1392a6cb72e9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:16.547391 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1225/2442] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:16 2022] PUT /identity/v3/projects/8d7bc9e792b14b298996b111d1536113/users/a0b3b556640a43ac95192d04a23f8c3e/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:16.551126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f58e69-1b44-47df-8b92-a9292aeaeb29 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:16.561258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f58e69-1b44-47df-8b92-a9292aeaeb29 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:16.620753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04705866-9d19-4679-811b-456e73dc224a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:16.621427 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04705866-9d19-4679-811b-456e73dc224a admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:16.621711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04705866-9d19-4679-811b-456e73dc224a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:16.621992 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04705866-9d19-4679-811b-456e73dc224a admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:16.622748 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04705866-9d19-4679-811b-456e73dc224a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:16.624337 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04705866-9d19-4679-811b-456e73dc224a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:16.634780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1218/2443] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:16.638724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb078c-ee2a-4d79-8ac2-1392a6cb72e9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:16.649457 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb078c-ee2a-4d79-8ac2-1392a6cb72e9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:16.654166 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd37d1-f7aa-41a4-97dc-796616c7dcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:16.655047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd37d1-f7aa-41a4-97dc-796616c7dcd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:16.655333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd37d1-f7aa-41a4-97dc-796616c7dcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:16.655619 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd37d1-f7aa-41a4-97dc-796616c7dcd4 admin admin] PATH_INFO: `/v3/projects/8d7bc9e792b14b298996b111d1536113/users/a0b3b556640a43ac95192d04a23f8c3e/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:16.657925 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd37d1-f7aa-41a4-97dc-796616c7dcd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7bc9e792b14b298996b111d1536113, user_id=a0b3b556640a43ac95192d04a23f8c3e, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:16.660656 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd37d1-f7aa-41a4-97dc-796616c7dcd4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:16.671132 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1226/2444] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:16 2022] PUT /identity/v3/projects/8d7bc9e792b14b298996b111d1536113/users/a0b3b556640a43ac95192d04a23f8c3e/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:16.682351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6bbfc-b6e2-42de-ad3e-7a510fb1fde6 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:16.682875 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6bbfc-b6e2-42de-ad3e-7a510fb1fde6 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:16.682974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6bbfc-b6e2-42de-ad3e-7a510fb1fde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:16.712041 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-7fa6bbfc-b6e2-42de-ad3e-7a510fb1fde6 None None] MFA Rules not processed for user `a0b3b556640a43ac95192d04a23f8c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:16.713267 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-7fa6bbfc-b6e2-42de-ad3e-7a510fb1fde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:16.789459 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1219/2445] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:16.800877 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd37d1-f7aa-41a4-97dc-796616c7dcd4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:16.802678 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b6fd37d1-f7aa-41a4-97dc-796616c7dcd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:16.866856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd37d1-f7aa-41a4-97dc-796616c7dcd4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:16.870251 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c4ffd-c511-477d-bd39-ee702138cf23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:16.870925 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c4ffd-c511-477d-bd39-ee702138cf23 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:16.871223 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c4ffd-c511-477d-bd39-ee702138cf23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:16.871484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c4ffd-c511-477d-bd39-ee702138cf23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:16.889211 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c4ffd-c511-477d-bd39-ee702138cf23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:16.890894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c4ffd-c511-477d-bd39-ee702138cf23 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:16.905575 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1227/2446] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:16.954984 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6bbfc-b6e2-42de-ad3e-7a510fb1fde6 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:16.956976 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-7fa6bbfc-b6e2-42de-ad3e-7a510fb1fde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:16.969617 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6bbfc-b6e2-42de-ad3e-7a510fb1fde6 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:16.973435 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a88171-dfa9-44c8-8ce0-8d2cff505ac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:16.974177 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a88171-dfa9-44c8-8ce0-8d2cff505ac4 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:16.975077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a88171-dfa9-44c8-8ce0-8d2cff505ac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:16.975077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a88171-dfa9-44c8-8ce0-8d2cff505ac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:17.034384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:17.050481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a88171-dfa9-44c8-8ce0-8d2cff505ac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:17.051913 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a88171-dfa9-44c8-8ce0-8d2cff505ac4 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:17.061118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1220/2447] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:19.121333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c4ffd-c511-477d-bd39-ee702138cf23 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:19.123046 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-556c4ffd-c511-477d-bd39-ee702138cf23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:19.147496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:19.218392 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c4ffd-c511-477d-bd39-ee702138cf23 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:19.224502 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f6bb0-1e69-46a3-99b7-eead60bb2421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:19.225166 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f6bb0-1e69-46a3-99b7-eead60bb2421 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:19.225447 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f6bb0-1e69-46a3-99b7-eead60bb2421 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:19.225724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f6bb0-1e69-46a3-99b7-eead60bb2421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:19.227528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9e8f6bb0-1e69-46a3-99b7-eead60bb2421 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:19.303219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f6bb0-1e69-46a3-99b7-eead60bb2421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:19.304230 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f6bb0-1e69-46a3-99b7-eead60bb2421 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:19.314795 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1228/2448] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:19.324399 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a88171-dfa9-44c8-8ce0-8d2cff505ac4 service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:19.325877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b1a88171-dfa9-44c8-8ce0-8d2cff505ac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:19.398018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a88171-dfa9-44c8-8ce0-8d2cff505ac4 service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:19.402609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbd4e7-fe14-405f-b498-1b1264e04f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:19.403937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbd4e7-fe14-405f-b498-1b1264e04f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:19.404245 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbd4e7-fe14-405f-b498-1b1264e04f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:19.404692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbd4e7-fe14-405f-b498-1b1264e04f30 admin admin] PATH_INFO: `/v3/users/170f479a814646e0b8822c1133cc9be4` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:19.406242 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbd4e7-fe14-405f-b498-1b1264e04f30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=170f479a814646e0b8822c1133cc9be4)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:19.409731 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbd4e7-fe14-405f-b498-1b1264e04f30 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:19.467956 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a9dbd4e7-fe14-405f-b498-1b1264e04f30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '170f479a814646e0b8822c1133cc9be4'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:19.468706 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a9dbd4e7-fe14-405f-b498-1b1264e04f30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '170f479a814646e0b8822c1133cc9be4'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:19.469322 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a9dbd4e7-fe14-405f-b498-1b1264e04f30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '170f479a814646e0b8822c1133cc9be4'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:19.483877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a9dbd4e7-fe14-405f-b498-1b1264e04f30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '170f479a814646e0b8822c1133cc9be4'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:19.491892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a9dbd4e7-fe14-405f-b498-1b1264e04f30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '170f479a814646e0b8822c1133cc9be4'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:19.507692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1221/2449] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:19 2022] DELETE /identity/v3/users/170f479a814646e0b8822c1133cc9be4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:19.724043 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f6bb0-1e69-46a3-99b7-eead60bb2421 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:19.736427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f6bb0-1e69-46a3-99b7-eead60bb2421 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:19.797590 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84032113-14a0-4a08-a623-6fae0fed6146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:19.798497 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84032113-14a0-4a08-a623-6fae0fed6146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:19.798777 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84032113-14a0-4a08-a623-6fae0fed6146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:19.799088 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84032113-14a0-4a08-a623-6fae0fed6146 admin admin] PATH_INFO: `/v3/projects/2a70ec04c37d4e228c14fbc6106dedfc` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:19.800281 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84032113-14a0-4a08-a623-6fae0fed6146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a70ec04c37d4e228c14fbc6106dedfc)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:19.802379 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84032113-14a0-4a08-a623-6fae0fed6146 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:19.849559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-84032113-14a0-4a08-a623-6fae0fed6146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a70ec04c37d4e228c14fbc6106dedfc', 'request_id': 'req-84032113-14a0-4a08-a623-6fae0fed6146'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:19.854131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:19.855655 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-84032113-14a0-4a08-a623-6fae0fed6146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a70ec04c37d4e228c14fbc6106dedfc', 'request_id': 'req-84032113-14a0-4a08-a623-6fae0fed6146'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:19.863222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-84032113-14a0-4a08-a623-6fae0fed6146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a70ec04c37d4e228c14fbc6106dedfc', 'request_id': 'req-84032113-14a0-4a08-a623-6fae0fed6146'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:19.875751 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-84032113-14a0-4a08-a623-6fae0fed6146 admin admin] The token cache is being invalidate because project 2a70ec04c37d4e228c14fbc6106dedfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:19.876090 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-84032113-14a0-4a08-a623-6fae0fed6146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:19.876728 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-84032113-14a0-4a08-a623-6fae0fed6146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:19.878878 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1229/2450] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:19 2022] DELETE /identity/v3/projects/2a70ec04c37d4e228c14fbc6106dedfc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:19.883804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19233b65-453b-4c0f-82ae-a35fbae6a1b9 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:19.884137 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19233b65-453b-4c0f-82ae-a35fbae6a1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:19.884410 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19233b65-453b-4c0f-82ae-a35fbae6a1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:19.905077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-19233b65-453b-4c0f-82ae-a35fbae6a1b9 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:19.906349 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-19233b65-453b-4c0f-82ae-a35fbae6a1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:19.971361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1222/2451] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:19.979279 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d378d1e-af26-47fc-9ea5-009d61a68db6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:19.979452 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d378d1e-af26-47fc-9ea5-009d61a68db6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:19.979730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d378d1e-af26-47fc-9ea5-009d61a68db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:20.003867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6d378d1e-af26-47fc-9ea5-009d61a68db6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:20.005207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6d378d1e-af26-47fc-9ea5-009d61a68db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:20.013806 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1230/2452] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:20.018243 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19233b65-453b-4c0f-82ae-a35fbae6a1b9 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:20.028035 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19233b65-453b-4c0f-82ae-a35fbae6a1b9 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:20.032556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47703f8-921c-4301-9528-61085c899392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:20.033236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47703f8-921c-4301-9528-61085c899392 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:20.033549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47703f8-921c-4301-9528-61085c899392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:20.033823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47703f8-921c-4301-9528-61085c899392 admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:20.034620 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47703f8-921c-4301-9528-61085c899392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:20:20.035204 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47703f8-921c-4301-9528-61085c899392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:20.037163 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47703f8-921c-4301-9528-61085c899392 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:20.039920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:20.052932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1223/2453] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:20:20.056877 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d378d1e-af26-47fc-9ea5-009d61a68db6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:20.067166 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d378d1e-af26-47fc-9ea5-009d61a68db6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:20.071707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a07e0b-0006-4666-8c5c-350e60824390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:20.072364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a07e0b-0006-4666-8c5c-350e60824390 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:20.072649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a07e0b-0006-4666-8c5c-350e60824390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:20.072924 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a07e0b-0006-4666-8c5c-350e60824390 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:20.073616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a07e0b-0006-4666-8c5c-350e60824390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:20.075574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a07e0b-0006-4666-8c5c-350e60824390 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:20.103286 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1231/2454] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:20 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:20.107924 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47703f8-921c-4301-9528-61085c899392 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:20.119327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47703f8-921c-4301-9528-61085c899392 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:20.181054 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfdfa9-c636-4427-afa0-d7bbd9e47618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:20.181668 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfdfa9-c636-4427-afa0-d7bbd9e47618 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:20.181950 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfdfa9-c636-4427-afa0-d7bbd9e47618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:20.182264 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfdfa9-c636-4427-afa0-d7bbd9e47618 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:20.182957 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfdfa9-c636-4427-afa0-d7bbd9e47618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:20.184867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfdfa9-c636-4427-afa0-d7bbd9e47618 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:20.208290 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1224/2455] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:20 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:20.212622 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a07e0b-0006-4666-8c5c-350e60824390 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:20.224343 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a07e0b-0006-4666-8c5c-350e60824390 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:20.230855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd13b6-a87f-4b00-9cc0-74a48fb96447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:20.231092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd13b6-a87f-4b00-9cc0-74a48fb96447 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:20.231320 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd13b6-a87f-4b00-9cc0-74a48fb96447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:20.231603 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd13b6-a87f-4b00-9cc0-74a48fb96447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:20.232366 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd13b6-a87f-4b00-9cc0-74a48fb96447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:20.234112 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd13b6-a87f-4b00-9cc0-74a48fb96447 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:20.248769 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1232/2456] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:20.249855 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfdfa9-c636-4427-afa0-d7bbd9e47618 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:20.263716 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfdfa9-c636-4427-afa0-d7bbd9e47618 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:20.268002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70758f7e-4a8f-4369-8d3a-242a15d29450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:20.268742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70758f7e-4a8f-4369-8d3a-242a15d29450 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:20.269181 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70758f7e-4a8f-4369-8d3a-242a15d29450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:20.269472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70758f7e-4a8f-4369-8d3a-242a15d29450 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:20.270415 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70758f7e-4a8f-4369-8d3a-242a15d29450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:20.272181 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70758f7e-4a8f-4369-8d3a-242a15d29450 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:20.283231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1225/2457] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:20.287406 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd13b6-a87f-4b00-9cc0-74a48fb96447 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:20.302186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd13b6-a87f-4b00-9cc0-74a48fb96447 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:20.308753 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbad66-79b3-41d4-9e8e-1d4d9db507fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:20.309670 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbad66-79b3-41d4-9e8e-1d4d9db507fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:20.310108 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbad66-79b3-41d4-9e8e-1d4d9db507fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:20.310386 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbad66-79b3-41d4-9e8e-1d4d9db507fa admin admin] PATH_INFO: `/v3/projects/90ab01d53ace40b2990da529375f9aa5/users/0e2d3474a2ec49aea63568b791bdd0bc/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:20.327782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbad66-79b3-41d4-9e8e-1d4d9db507fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ab01d53ace40b2990da529375f9aa5, user_id=0e2d3474a2ec49aea63568b791bdd0bc, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:20.331442 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbad66-79b3-41d4-9e8e-1d4d9db507fa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:20.344939 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1233/2458] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:20 2022] PUT /identity/v3/projects/90ab01d53ace40b2990da529375f9aa5/users/0e2d3474a2ec49aea63568b791bdd0bc/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:20.356619 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9362a49-f146-4f46-879f-bfd72dbda992 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:20.357138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9362a49-f146-4f46-879f-bfd72dbda992 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:20.357264 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9362a49-f146-4f46-879f-bfd72dbda992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:20.389894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-d9362a49-f146-4f46-879f-bfd72dbda992 None None] MFA Rules not processed for user `0e2d3474a2ec49aea63568b791bdd0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:20.391318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d9362a49-f146-4f46-879f-bfd72dbda992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:20.462948 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1226/2459] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:20.467297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbad66-79b3-41d4-9e8e-1d4d9db507fa admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:20.478142 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9362a49-f146-4f46-879f-bfd72dbda992 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:20.479686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d9362a49-f146-4f46-879f-bfd72dbda992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:20.533584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbad66-79b3-41d4-9e8e-1d4d9db507fa admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:20.538474 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a414e-c7ac-4a0c-b3d1-a4f73ab5ec47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:20.539131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a414e-c7ac-4a0c-b3d1-a4f73ab5ec47 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:20.539415 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a414e-c7ac-4a0c-b3d1-a4f73ab5ec47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:20.539691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a414e-c7ac-4a0c-b3d1-a4f73ab5ec47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:20.540395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a414e-c7ac-4a0c-b3d1-a4f73ab5ec47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:20.542341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a414e-c7ac-4a0c-b3d1-a4f73ab5ec47 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:20.545689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9362a49-f146-4f46-879f-bfd72dbda992 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:20.550474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8443d68-1ebd-44d7-ae3b-0835805dfc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:20.551346 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8443d68-1ebd-44d7-ae3b-0835805dfc1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:20.551627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8443d68-1ebd-44d7-ae3b-0835805dfc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:20.551912 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8443d68-1ebd-44d7-ae3b-0835805dfc1d admin admin] PATH_INFO: `/v3/users/aba6c6237c3049c19f0a9a0886972e2b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:20.553133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8443d68-1ebd-44d7-ae3b-0835805dfc1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba6c6237c3049c19f0a9a0886972e2b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:20.555090 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8443d68-1ebd-44d7-ae3b-0835805dfc1d admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:20.559922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:20.570906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1234/2460] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:20 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:20.575100 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a414e-c7ac-4a0c-b3d1-a4f73ab5ec47 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:20.606041 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c8443d68-1ebd-44d7-ae3b-0835805dfc1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba6c6237c3049c19f0a9a0886972e2b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:20.606718 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c8443d68-1ebd-44d7-ae3b-0835805dfc1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba6c6237c3049c19f0a9a0886972e2b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:20.607347 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c8443d68-1ebd-44d7-ae3b-0835805dfc1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba6c6237c3049c19f0a9a0886972e2b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:20.619944 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c8443d68-1ebd-44d7-ae3b-0835805dfc1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba6c6237c3049c19f0a9a0886972e2b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:20.627696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c8443d68-1ebd-44d7-ae3b-0835805dfc1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba6c6237c3049c19f0a9a0886972e2b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:20.639303 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a414e-c7ac-4a0c-b3d1-a4f73ab5ec47 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:20.641094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1227/2461] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:20 2022] DELETE /identity/v3/users/aba6c6237c3049c19f0a9a0886972e2b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:20.645833 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c140cbc-124d-4ba0-9873-05b4b67e2a02 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:20.646138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c140cbc-124d-4ba0-9873-05b4b67e2a02 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:20.646477 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c140cbc-124d-4ba0-9873-05b4b67e2a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:20.649081 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:20.682830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-7c140cbc-124d-4ba0-9873-05b4b67e2a02 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:20.684046 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-7c140cbc-124d-4ba0-9873-05b4b67e2a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:20.723529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fcbea-9915-4966-9c7d-104c918e7305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:20.724388 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fcbea-9915-4966-9c7d-104c918e7305 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:20.724748 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fcbea-9915-4966-9c7d-104c918e7305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:20.725203 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fcbea-9915-4966-9c7d-104c918e7305 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:20.726027 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fcbea-9915-4966-9c7d-104c918e7305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:20.728162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fcbea-9915-4966-9c7d-104c918e7305 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:20.757109 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1235/2462] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:20 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:20.763356 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fcbea-9915-4966-9c7d-104c918e7305 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:20.767457 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2c2fcbea-9915-4966-9c7d-104c918e7305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:20.771476 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1228/2463] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:20.782117 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c140cbc-124d-4ba0-9873-05b4b67e2a02 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:20.783953 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-7c140cbc-124d-4ba0-9873-05b4b67e2a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:20.788323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fcbea-9915-4966-9c7d-104c918e7305 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:20.794023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ac8f1-fdad-43be-81ed-b3c78c3b5621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:20.795646 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ac8f1-fdad-43be-81ed-b3c78c3b5621 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:20.796227 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ac8f1-fdad-43be-81ed-b3c78c3b5621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:20.796582 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ac8f1-fdad-43be-81ed-b3c78c3b5621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:20.797655 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ac8f1-fdad-43be-81ed-b3c78c3b5621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:20.800138 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ac8f1-fdad-43be-81ed-b3c78c3b5621 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:20.812277 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1236/2464] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:20.816980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ac8f1-fdad-43be-81ed-b3c78c3b5621 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:20.827952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ac8f1-fdad-43be-81ed-b3c78c3b5621 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:20.832897 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e200860-ff93-44c2-a1c9-0b971d2d24fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:20.833994 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e200860-ff93-44c2-a1c9-0b971d2d24fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:20.834120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e200860-ff93-44c2-a1c9-0b971d2d24fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:20.834343 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e200860-ff93-44c2-a1c9-0b971d2d24fb admin admin] PATH_INFO: `/v3/projects/e0c7c86dfed7431185ab626c7c71520b/users/565760384dcd481ba86f2fa2e4eecba0/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:20.849587 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e200860-ff93-44c2-a1c9-0b971d2d24fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c7c86dfed7431185ab626c7c71520b, user_id=565760384dcd481ba86f2fa2e4eecba0, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:20.852395 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e200860-ff93-44c2-a1c9-0b971d2d24fb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:20.866963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1237/2465] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:20 2022] PUT /identity/v3/projects/e0c7c86dfed7431185ab626c7c71520b/users/565760384dcd481ba86f2fa2e4eecba0/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:20.868985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c140cbc-124d-4ba0-9873-05b4b67e2a02 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:20.871071 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e200860-ff93-44c2-a1c9-0b971d2d24fb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:20.910672 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:20.924587 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f4846-6068-4cdb-81f0-eb85f7c113c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:20.925493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f4846-6068-4cdb-81f0-eb85f7c113c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:20.926023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f4846-6068-4cdb-81f0-eb85f7c113c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:20.926453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f4846-6068-4cdb-81f0-eb85f7c113c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:20.948531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e200860-ff93-44c2-a1c9-0b971d2d24fb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:20.953612 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608f2d1-702b-44ef-b904-d875dbe9f1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:20.954347 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608f2d1-702b-44ef-b904-d875dbe9f1ca admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:20.954622 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608f2d1-702b-44ef-b904-d875dbe9f1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:20.954886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608f2d1-702b-44ef-b904-d875dbe9f1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:20.955675 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608f2d1-702b-44ef-b904-d875dbe9f1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:20.957272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608f2d1-702b-44ef-b904-d875dbe9f1ca admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:20.968389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1238/2466] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:20.972984 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608f2d1-702b-44ef-b904-d875dbe9f1ca admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:20.983857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608f2d1-702b-44ef-b904-d875dbe9f1ca admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:20.989563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892fd59-0948-442a-8bda-148bbb30808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:20.990535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892fd59-0948-442a-8bda-148bbb30808c admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:20.990833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892fd59-0948-442a-8bda-148bbb30808c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:20.991614 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892fd59-0948-442a-8bda-148bbb30808c admin admin] PATH_INFO: `/v3/projects/e0c7c86dfed7431185ab626c7c71520b/users/565760384dcd481ba86f2fa2e4eecba0/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:20.993183 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892fd59-0948-442a-8bda-148bbb30808c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c7c86dfed7431185ab626c7c71520b, user_id=565760384dcd481ba86f2fa2e4eecba0, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:20.995916 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892fd59-0948-442a-8bda-148bbb30808c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:20.998578 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f4846-6068-4cdb-81f0-eb85f7c113c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:21.000854 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f4846-6068-4cdb-81f0-eb85f7c113c1 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:21.009331 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1239/2467] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:20 2022] PUT /identity/v3/projects/e0c7c86dfed7431185ab626c7c71520b/users/565760384dcd481ba86f2fa2e4eecba0/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:21.017578 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1229/2468] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:20:21.022583 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628549b-b670-40fd-aa07-fa265da19ed4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:21.022944 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628549b-b670-40fd-aa07-fa265da19ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:21.023407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628549b-b670-40fd-aa07-fa265da19ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:21.054819 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3628549b-b670-40fd-aa07-fa265da19ed4 None None] MFA Rules not processed for user `565760384dcd481ba86f2fa2e4eecba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:21.056675 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3628549b-b670-40fd-aa07-fa265da19ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:21.109920 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:21.160043 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1240/2469] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:21.172153 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f4846-6068-4cdb-81f0-eb85f7c113c1 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:21.173571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6d7f4846-6068-4cdb-81f0-eb85f7c113c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:21.242379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f4846-6068-4cdb-81f0-eb85f7c113c1 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:21.299384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac3e12-2efa-473c-aa9f-db859655236d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:21.300062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac3e12-2efa-473c-aa9f-db859655236d service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:21.300355 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac3e12-2efa-473c-aa9f-db859655236d service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:21.300634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac3e12-2efa-473c-aa9f-db859655236d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:21.310669 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac3e12-2efa-473c-aa9f-db859655236d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:21.312155 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac3e12-2efa-473c-aa9f-db859655236d service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:21.324971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1230/2470] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:21 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:21.363742 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628549b-b670-40fd-aa07-fa265da19ed4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:21.365948 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3628549b-b670-40fd-aa07-fa265da19ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:21.445701 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628549b-b670-40fd-aa07-fa265da19ed4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:21.451754 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f6f55-8bdf-4810-9ff3-283ff39d0b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:21.452618 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f6f55-8bdf-4810-9ff3-283ff39d0b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:21.452897 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f6f55-8bdf-4810-9ff3-283ff39d0b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:21.453198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f6f55-8bdf-4810-9ff3-283ff39d0b6d admin admin] PATH_INFO: `/v3/projects/e9c59bc3ec4d49b8a8f4f652430423d1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:21.454573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f6f55-8bdf-4810-9ff3-283ff39d0b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9c59bc3ec4d49b8a8f4f652430423d1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:21.457052 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f6f55-8bdf-4810-9ff3-283ff39d0b6d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:21.505788 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e56f6f55-8bdf-4810-9ff3-283ff39d0b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9c59bc3ec4d49b8a8f4f652430423d1', 'request_id': 'req-e56f6f55-8bdf-4810-9ff3-283ff39d0b6d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:21.513953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e56f6f55-8bdf-4810-9ff3-283ff39d0b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9c59bc3ec4d49b8a8f4f652430423d1', 'request_id': 'req-e56f6f55-8bdf-4810-9ff3-283ff39d0b6d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:21.518489 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e56f6f55-8bdf-4810-9ff3-283ff39d0b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9c59bc3ec4d49b8a8f4f652430423d1', 'request_id': 'req-e56f6f55-8bdf-4810-9ff3-283ff39d0b6d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:21.531099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e56f6f55-8bdf-4810-9ff3-283ff39d0b6d admin admin] The token cache is being invalidate because project e9c59bc3ec4d49b8a8f4f652430423d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:21.531389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e56f6f55-8bdf-4810-9ff3-283ff39d0b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:21.532016 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e56f6f55-8bdf-4810-9ff3-283ff39d0b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:21.533588 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1241/2471] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:21 2022] DELETE /identity/v3/projects/e9c59bc3ec4d49b8a8f4f652430423d1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:21.537928 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac3e12-2efa-473c-aa9f-db859655236d service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:21.549638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac3e12-2efa-473c-aa9f-db859655236d service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:21.600601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:21.614203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50dfdc-0ed7-44c9-bd8a-5a2bf1a8fff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:21.615071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50dfdc-0ed7-44c9-bd8a-5a2bf1a8fff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:21.615350 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50dfdc-0ed7-44c9-bd8a-5a2bf1a8fff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:21.615625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50dfdc-0ed7-44c9-bd8a-5a2bf1a8fff6 admin admin] PATH_INFO: `/v3/users/a0b3b556640a43ac95192d04a23f8c3e` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:21.616807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50dfdc-0ed7-44c9-bd8a-5a2bf1a8fff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b3b556640a43ac95192d04a23f8c3e)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:21.618747 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50dfdc-0ed7-44c9-bd8a-5a2bf1a8fff6 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:21.671634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-8d50dfdc-0ed7-44c9-bd8a-5a2bf1a8fff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b3b556640a43ac95192d04a23f8c3e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:21.672305 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-8d50dfdc-0ed7-44c9-bd8a-5a2bf1a8fff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b3b556640a43ac95192d04a23f8c3e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:21.673174 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-8d50dfdc-0ed7-44c9-bd8a-5a2bf1a8fff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b3b556640a43ac95192d04a23f8c3e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:21.688339 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-8d50dfdc-0ed7-44c9-bd8a-5a2bf1a8fff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b3b556640a43ac95192d04a23f8c3e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:21.698052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-8d50dfdc-0ed7-44c9-bd8a-5a2bf1a8fff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b3b556640a43ac95192d04a23f8c3e'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:21.716566 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1231/2472] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:21 2022] DELETE /identity/v3/users/a0b3b556640a43ac95192d04a23f8c3e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:21.767971 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f6f55-8bdf-4810-9ff3-283ff39d0b6d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:21.769414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e56f6f55-8bdf-4810-9ff3-283ff39d0b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:21.783039 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f6f55-8bdf-4810-9ff3-283ff39d0b6d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:21.844381 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb80d9b-febd-44e8-b7c7-e2e573dd633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:21.845265 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb80d9b-febd-44e8-b7c7-e2e573dd633d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:21.845546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb80d9b-febd-44e8-b7c7-e2e573dd633d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:21.845821 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb80d9b-febd-44e8-b7c7-e2e573dd633d admin admin] PATH_INFO: `/v3/users/0e2d3474a2ec49aea63568b791bdd0bc` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:21.847586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb80d9b-febd-44e8-b7c7-e2e573dd633d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e2d3474a2ec49aea63568b791bdd0bc)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:21.849537 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb80d9b-febd-44e8-b7c7-e2e573dd633d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:21.856148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:21.914139 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ebb80d9b-febd-44e8-b7c7-e2e573dd633d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e2d3474a2ec49aea63568b791bdd0bc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:21.914811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ebb80d9b-febd-44e8-b7c7-e2e573dd633d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e2d3474a2ec49aea63568b791bdd0bc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:21.915430 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ebb80d9b-febd-44e8-b7c7-e2e573dd633d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e2d3474a2ec49aea63568b791bdd0bc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:21.928272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ebb80d9b-febd-44e8-b7c7-e2e573dd633d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e2d3474a2ec49aea63568b791bdd0bc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:21.936519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ebb80d9b-febd-44e8-b7c7-e2e573dd633d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e2d3474a2ec49aea63568b791bdd0bc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:21.949926 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1242/2473] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:21 2022] DELETE /identity/v3/users/0e2d3474a2ec49aea63568b791bdd0bc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:21.954488 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110f30e-83eb-4459-9dd1-9d68e75618d2 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:21.954774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110f30e-83eb-4459-9dd1-9d68e75618d2 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:21.955053 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110f30e-83eb-4459-9dd1-9d68e75618d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:21.975072 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-5110f30e-83eb-4459-9dd1-9d68e75618d2 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:21.976368 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5110f30e-83eb-4459-9dd1-9d68e75618d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:22.041675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1232/2474] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:22.053508 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb80d9b-febd-44e8-b7c7-e2e573dd633d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:22.055410 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ebb80d9b-febd-44e8-b7c7-e2e573dd633d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:22.109930 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110f30e-83eb-4459-9dd1-9d68e75618d2 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:22.112465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5110f30e-83eb-4459-9dd1-9d68e75618d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:22.127600 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110f30e-83eb-4459-9dd1-9d68e75618d2 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:22.134095 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a815a-16ec-45d4-abfe-38ca48f7439a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:22.134783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a815a-16ec-45d4-abfe-38ca48f7439a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:22.135370 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a815a-16ec-45d4-abfe-38ca48f7439a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:22.135586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a815a-16ec-45d4-abfe-38ca48f7439a admin admin] PATH_INFO: `/v3/projects/8d7bc9e792b14b298996b111d1536113` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:22.138898 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a815a-16ec-45d4-abfe-38ca48f7439a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7bc9e792b14b298996b111d1536113)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:22.141047 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a815a-16ec-45d4-abfe-38ca48f7439a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:22.164626 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb80d9b-febd-44e8-b7c7-e2e573dd633d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:22.169081 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d64d4-0657-4c5c-8c42-7fd616241c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:22.170048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d64d4-0657-4c5c-8c42-7fd616241c6d service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:22.170568 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d64d4-0657-4c5c-8c42-7fd616241c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:22.170971 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d64d4-0657-4c5c-8c42-7fd616241c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:22.192271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d64d4-0657-4c5c-8c42-7fd616241c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:22.193919 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d64d4-0657-4c5c-8c42-7fd616241c6d service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:22.217182 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1243/2475] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:22.223819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d28a815a-16ec-45d4-abfe-38ca48f7439a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7bc9e792b14b298996b111d1536113', 'request_id': 'req-d28a815a-16ec-45d4-abfe-38ca48f7439a'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:22.232497 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d28a815a-16ec-45d4-abfe-38ca48f7439a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7bc9e792b14b298996b111d1536113', 'request_id': 'req-d28a815a-16ec-45d4-abfe-38ca48f7439a'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:22.240017 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:22.242751 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d28a815a-16ec-45d4-abfe-38ca48f7439a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7bc9e792b14b298996b111d1536113', 'request_id': 'req-d28a815a-16ec-45d4-abfe-38ca48f7439a'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:22.274258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d28a815a-16ec-45d4-abfe-38ca48f7439a admin admin] The token cache is being invalidate because project 8d7bc9e792b14b298996b111d1536113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:22.274258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d28a815a-16ec-45d4-abfe-38ca48f7439a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:22.274258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-d28a815a-16ec-45d4-abfe-38ca48f7439a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:22.274258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1233/2476] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:22 2022] DELETE /identity/v3/projects/8d7bc9e792b14b298996b111d1536113 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:22.276636 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a145278-6d87-492a-95c1-7d9be756ba7c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:22.276943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a145278-6d87-492a-95c1-7d9be756ba7c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:22.277257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a145278-6d87-492a-95c1-7d9be756ba7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:22.304593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3a145278-6d87-492a-95c1-7d9be756ba7c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:22.305748 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3a145278-6d87-492a-95c1-7d9be756ba7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:22.378436 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1244/2477] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:20:22.387813 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb272da-e789-4f93-80b2-574f39924ec6 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:22.388111 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb272da-e789-4f93-80b2-574f39924ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:22.388377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb272da-e789-4f93-80b2-574f39924ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:22.410472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-6eb272da-e789-4f93-80b2-574f39924ec6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:22.411794 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6eb272da-e789-4f93-80b2-574f39924ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:22.420424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1234/2478] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:22.425257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a145278-6d87-492a-95c1-7d9be756ba7c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:22.436912 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a145278-6d87-492a-95c1-7d9be756ba7c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:22.442558 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e877fb-f1c2-4136-8179-822e4e2a493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:22.444054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e877fb-f1c2-4136-8179-822e4e2a493a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:22.444525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e877fb-f1c2-4136-8179-822e4e2a493a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:22.445193 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e877fb-f1c2-4136-8179-822e4e2a493a admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:22.446847 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e877fb-f1c2-4136-8179-822e4e2a493a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:20:22.447335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e877fb-f1c2-4136-8179-822e4e2a493a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:22.449148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e877fb-f1c2-4136-8179-822e4e2a493a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:22.462893 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1245/2479] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:20:22.467414 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb272da-e789-4f93-80b2-574f39924ec6 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:22.477355 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb272da-e789-4f93-80b2-574f39924ec6 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:22.486149 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152fec5-872e-4f1d-a98a-7ccc620576e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:22.486920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152fec5-872e-4f1d-a98a-7ccc620576e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:22.487290 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152fec5-872e-4f1d-a98a-7ccc620576e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:22.487640 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152fec5-872e-4f1d-a98a-7ccc620576e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:22.488415 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152fec5-872e-4f1d-a98a-7ccc620576e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:22.490427 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152fec5-872e-4f1d-a98a-7ccc620576e2 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:22.529770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1235/2480] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:22 2022] POST /identity/v3/projects => generated 397 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:22.536229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e877fb-f1c2-4136-8179-822e4e2a493a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:22.537635 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152fec5-872e-4f1d-a98a-7ccc620576e2 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:22.539320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b152fec5-872e-4f1d-a98a-7ccc620576e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:22.547724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e877fb-f1c2-4136-8179-822e4e2a493a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:22.560894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:22.622475 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a64065-1448-4b9d-a1f4-f59d92e12e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:22.623787 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a64065-1448-4b9d-a1f4-f59d92e12e0e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:22.624512 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a64065-1448-4b9d-a1f4-f59d92e12e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:22.624771 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a64065-1448-4b9d-a1f4-f59d92e12e0e admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:22.625469 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a64065-1448-4b9d-a1f4-f59d92e12e0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:22.628120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152fec5-872e-4f1d-a98a-7ccc620576e2 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:22.628530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a64065-1448-4b9d-a1f4-f59d92e12e0e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:22.633100 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1887bc5-b10a-40f4-b58d-f32d678f62bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:22.633940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1887bc5-b10a-40f4-b58d-f32d678f62bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:22.634269 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1887bc5-b10a-40f4-b58d-f32d678f62bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:22.634549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1887bc5-b10a-40f4-b58d-f32d678f62bb admin admin] PATH_INFO: `/v3/projects/90ab01d53ace40b2990da529375f9aa5` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:22.635774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1887bc5-b10a-40f4-b58d-f32d678f62bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ab01d53ace40b2990da529375f9aa5)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:22.637941 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1887bc5-b10a-40f4-b58d-f32d678f62bb admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:22.659046 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1246/2481] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:22 2022] POST /identity/v3/users => generated 299 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:20:22.662980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a64065-1448-4b9d-a1f4-f59d92e12e0e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:22.677298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a64065-1448-4b9d-a1f4-f59d92e12e0e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:22.682574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4da631-b6d0-445b-8d76-35a1231715ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:22.683560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4da631-b6d0-445b-8d76-35a1231715ae admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:22.683847 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4da631-b6d0-445b-8d76-35a1231715ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:22.684164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4da631-b6d0-445b-8d76-35a1231715ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:22.685031 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4da631-b6d0-445b-8d76-35a1231715ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:22.686674 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4da631-b6d0-445b-8d76-35a1231715ae admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:22.697784 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1247/2482] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:20:22.701356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b1887bc5-b10a-40f4-b58d-f32d678f62bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ab01d53ace40b2990da529375f9aa5', 'request_id': 'req-b1887bc5-b10a-40f4-b58d-f32d678f62bb'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:22.701694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4da631-b6d0-445b-8d76-35a1231715ae admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:22.710527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b1887bc5-b10a-40f4-b58d-f32d678f62bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ab01d53ace40b2990da529375f9aa5', 'request_id': 'req-b1887bc5-b10a-40f4-b58d-f32d678f62bb'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:22.713367 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4da631-b6d0-445b-8d76-35a1231715ae admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:22.716655 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b1887bc5-b10a-40f4-b58d-f32d678f62bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ab01d53ace40b2990da529375f9aa5', 'request_id': 'req-b1887bc5-b10a-40f4-b58d-f32d678f62bb'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:22.729712 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b1887bc5-b10a-40f4-b58d-f32d678f62bb admin admin] The token cache is being invalidate because project 90ab01d53ace40b2990da529375f9aa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:22.730029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b1887bc5-b10a-40f4-b58d-f32d678f62bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:22.730744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b1887bc5-b10a-40f4-b58d-f32d678f62bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:22.732318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1236/2483] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:22 2022] DELETE /identity/v3/projects/90ab01d53ace40b2990da529375f9aa5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:22.736132 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1887bc5-b10a-40f4-b58d-f32d678f62bb admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:22.737685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b1887bc5-b10a-40f4-b58d-f32d678f62bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:22.774801 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a903343-e306-41c0-8b92-8f825a0e5a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:22.775474 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a903343-e306-41c0-8b92-8f825a0e5a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:22.775752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a903343-e306-41c0-8b92-8f825a0e5a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:22.776048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a903343-e306-41c0-8b92-8f825a0e5a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:22.776763 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a903343-e306-41c0-8b92-8f825a0e5a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:22.778414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a903343-e306-41c0-8b92-8f825a0e5a6e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:22.790028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1248/2484] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:20:22.792981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a903343-e306-41c0-8b92-8f825a0e5a6e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:22.794676 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2a903343-e306-41c0-8b92-8f825a0e5a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:22.796674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:22.807220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a903343-e306-41c0-8b92-8f825a0e5a6e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:22.810520 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1887bc5-b10a-40f4-b58d-f32d678f62bb admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:22.812125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c33677-0402-4fb8-ac41-6344b89b2f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:22.812989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c33677-0402-4fb8-ac41-6344b89b2f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:22.813271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c33677-0402-4fb8-ac41-6344b89b2f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:22.813547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c33677-0402-4fb8-ac41-6344b89b2f46 admin admin] PATH_INFO: `/v3/projects/623cb8c132df47bd941e86fbb7645383/users/c3b44ba094c148d78c21d34dd9eb6246/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:22.816592 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b83f7-da35-4826-bb60-44bb85f9c43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:22.817462 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b83f7-da35-4826-bb60-44bb85f9c43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:22.817751 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b83f7-da35-4826-bb60-44bb85f9c43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:22.818049 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b83f7-da35-4826-bb60-44bb85f9c43e admin admin] PATH_INFO: `/v3/users/565760384dcd481ba86f2fa2e4eecba0` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:22.819270 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b83f7-da35-4826-bb60-44bb85f9c43e admin admin] RBAC: Authorizing `identity:delete_user(user_id=565760384dcd481ba86f2fa2e4eecba0)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:22.821183 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b83f7-da35-4826-bb60-44bb85f9c43e admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:22.830036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c33677-0402-4fb8-ac41-6344b89b2f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=623cb8c132df47bd941e86fbb7645383, user_id=c3b44ba094c148d78c21d34dd9eb6246, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:22.833361 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c33677-0402-4fb8-ac41-6344b89b2f46 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:22.847682 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1249/2485] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:22 2022] PUT /identity/v3/projects/623cb8c132df47bd941e86fbb7645383/users/c3b44ba094c148d78c21d34dd9eb6246/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:22.859860 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb28283-9ad5-4131-a299-35cd5f308cea None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:22.860153 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb28283-9ad5-4131-a299-35cd5f308cea None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:22.860785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb28283-9ad5-4131-a299-35cd5f308cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:22.868123 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-903b83f7-da35-4826-bb60-44bb85f9c43e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565760384dcd481ba86f2fa2e4eecba0'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:22.868796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-903b83f7-da35-4826-bb60-44bb85f9c43e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565760384dcd481ba86f2fa2e4eecba0'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:22.869419 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-903b83f7-da35-4826-bb60-44bb85f9c43e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565760384dcd481ba86f2fa2e4eecba0'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:22.882643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-903b83f7-da35-4826-bb60-44bb85f9c43e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565760384dcd481ba86f2fa2e4eecba0'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:22.889617 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8cb28283-9ad5-4131-a299-35cd5f308cea None None] MFA Rules not processed for user `c3b44ba094c148d78c21d34dd9eb6246`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:22.889973 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-903b83f7-da35-4826-bb60-44bb85f9c43e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565760384dcd481ba86f2fa2e4eecba0'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:22.890885 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8cb28283-9ad5-4131-a299-35cd5f308cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:22.903351 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1237/2486] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:22 2022] DELETE /identity/v3/users/565760384dcd481ba86f2fa2e4eecba0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:22.954878 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:22.970611 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1250/2487] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:20:22.975664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b83f7-da35-4826-bb60-44bb85f9c43e admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:22.977881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-903b83f7-da35-4826-bb60-44bb85f9c43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:23.051059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b83f7-da35-4826-bb60-44bb85f9c43e admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:23.059503 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e35f8-242a-4ba0-90cf-e8b6feadb070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:23.060195 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e35f8-242a-4ba0-90cf-e8b6feadb070 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:23.060554 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e35f8-242a-4ba0-90cf-e8b6feadb070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:23.061206 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e35f8-242a-4ba0-90cf-e8b6feadb070 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:23.061752 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e35f8-242a-4ba0-90cf-e8b6feadb070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:23.063768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e35f8-242a-4ba0-90cf-e8b6feadb070 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:23.098147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1238/2488] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:22 2022] POST /identity/v3/projects => generated 399 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:23.100750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb28283-9ad5-4131-a299-35cd5f308cea None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:23.198092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb28283-9ad5-4131-a299-35cd5f308cea None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:23.230428 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e35f8-242a-4ba0-90cf-e8b6feadb070 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:23.232794 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d80e35f8-242a-4ba0-90cf-e8b6feadb070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:23.293525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebad11-6e71-49bf-9957-7b429eb97d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:23.294356 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebad11-6e71-49bf-9957-7b429eb97d9f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:23.294708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebad11-6e71-49bf-9957-7b429eb97d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:23.295075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebad11-6e71-49bf-9957-7b429eb97d9f admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:23.295994 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebad11-6e71-49bf-9957-7b429eb97d9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:23.298955 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebad11-6e71-49bf-9957-7b429eb97d9f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:23.321147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:23.325835 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e35f8-242a-4ba0-90cf-e8b6feadb070 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:23.326382 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1251/2489] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:23 2022] POST /identity/v3/users => generated 306 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:23.330350 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebad11-6e71-49bf-9957-7b429eb97d9f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:23.338719 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fc7f5-3620-4c69-9328-0b625df3af65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:23.339607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fc7f5-3620-4c69-9328-0b625df3af65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:23.339893 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fc7f5-3620-4c69-9328-0b625df3af65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:23.340167 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fc7f5-3620-4c69-9328-0b625df3af65 admin admin] PATH_INFO: `/v3/projects/e0c7c86dfed7431185ab626c7c71520b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:23.341299 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebad11-6e71-49bf-9957-7b429eb97d9f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:23.341408 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fc7f5-3620-4c69-9328-0b625df3af65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c7c86dfed7431185ab626c7c71520b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:23.343492 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fc7f5-3620-4c69-9328-0b625df3af65 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:23.347168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5daf8-ff3f-46e3-ad60-6076611c1966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:23.348087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5daf8-ff3f-46e3-ad60-6076611c1966 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:23.348372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5daf8-ff3f-46e3-ad60-6076611c1966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:23.348647 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5daf8-ff3f-46e3-ad60-6076611c1966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:23.349375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5daf8-ff3f-46e3-ad60-6076611c1966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:23.351500 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5daf8-ff3f-46e3-ad60-6076611c1966 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:23.366453 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1252/2490] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:20:23.367465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5daf8-ff3f-46e3-ad60-6076611c1966 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:23.378125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5daf8-ff3f-46e3-ad60-6076611c1966 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:23.383522 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1ee44-4a25-41f9-a72a-a8ffaee7f220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:23.384455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1ee44-4a25-41f9-a72a-a8ffaee7f220 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:23.384819 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1ee44-4a25-41f9-a72a-a8ffaee7f220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:23.385114 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1ee44-4a25-41f9-a72a-a8ffaee7f220 admin admin] PATH_INFO: `/v3/projects/e3e460436c0947cd9030b3bc731c3efa/users/3c124318ce6c40cbb4903e97ea543517/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:23.395758 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-467fc7f5-3620-4c69-9328-0b625df3af65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c7c86dfed7431185ab626c7c71520b', 'request_id': 'req-467fc7f5-3620-4c69-9328-0b625df3af65'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:23.400750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1ee44-4a25-41f9-a72a-a8ffaee7f220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e460436c0947cd9030b3bc731c3efa, user_id=3c124318ce6c40cbb4903e97ea543517, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:23.403833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1ee44-4a25-41f9-a72a-a8ffaee7f220 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:23.404012 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-467fc7f5-3620-4c69-9328-0b625df3af65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c7c86dfed7431185ab626c7c71520b', 'request_id': 'req-467fc7f5-3620-4c69-9328-0b625df3af65'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:23.410563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-467fc7f5-3620-4c69-9328-0b625df3af65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c7c86dfed7431185ab626c7c71520b', 'request_id': 'req-467fc7f5-3620-4c69-9328-0b625df3af65'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:23.418058 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1253/2491] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:23 2022] PUT /identity/v3/projects/e3e460436c0947cd9030b3bc731c3efa/users/3c124318ce6c40cbb4903e97ea543517/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:23.421755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1ee44-4a25-41f9-a72a-a8ffaee7f220 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:23.426033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-467fc7f5-3620-4c69-9328-0b625df3af65 admin admin] The token cache is being invalidate because project e0c7c86dfed7431185ab626c7c71520b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:23.426333 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-467fc7f5-3620-4c69-9328-0b625df3af65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:23.426986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-467fc7f5-3620-4c69-9328-0b625df3af65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:23.428540 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1239/2492] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:23 2022] DELETE /identity/v3/projects/e0c7c86dfed7431185ab626c7c71520b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:23.433228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8acdd-f888-4cd9-8e59-64b9fae43c78 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:23.433581 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8acdd-f888-4cd9-8e59-64b9fae43c78 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:23.433889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8acdd-f888-4cd9-8e59-64b9fae43c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:23.453031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-20b8acdd-f888-4cd9-8e59-64b9fae43c78 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:23.454262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-20b8acdd-f888-4cd9-8e59-64b9fae43c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:23.483668 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:23.489192 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1ee44-4a25-41f9-a72a-a8ffaee7f220 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:23.495648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298ec88-5987-4635-a8f7-8f00d6e37a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:23.496323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298ec88-5987-4635-a8f7-8f00d6e37a59 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:23.496638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298ec88-5987-4635-a8f7-8f00d6e37a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:23.496917 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298ec88-5987-4635-a8f7-8f00d6e37a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:23.497655 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298ec88-5987-4635-a8f7-8f00d6e37a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:23.499355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298ec88-5987-4635-a8f7-8f00d6e37a59 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:23.509498 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1254/2493] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:20:23.513525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298ec88-5987-4635-a8f7-8f00d6e37a59 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:23.515175 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3298ec88-5987-4635-a8f7-8f00d6e37a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:23.515313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1240/2494] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:20:23.522709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe1b3e-6858-48b8-9001-4f965ffce43a None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:23.522997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe1b3e-6858-48b8-9001-4f965ffce43a None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:23.523264 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe1b3e-6858-48b8-9001-4f965ffce43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:23.527987 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298ec88-5987-4635-a8f7-8f00d6e37a59 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:23.532662 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bd3df-443e-4ef4-9bae-0b7bad7cc620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:23.534292 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bd3df-443e-4ef4-9bae-0b7bad7cc620 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:23.534578 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bd3df-443e-4ef4-9bae-0b7bad7cc620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:23.534858 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bd3df-443e-4ef4-9bae-0b7bad7cc620 admin admin] PATH_INFO: `/v3/projects/e3e460436c0947cd9030b3bc731c3efa/users/3c124318ce6c40cbb4903e97ea543517/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:23.537257 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bd3df-443e-4ef4-9bae-0b7bad7cc620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e460436c0947cd9030b3bc731c3efa, user_id=3c124318ce6c40cbb4903e97ea543517, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:23.540195 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bd3df-443e-4ef4-9bae-0b7bad7cc620 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:23.543234 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-37fe1b3e-6858-48b8-9001-4f965ffce43a None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:23.544446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-37fe1b3e-6858-48b8-9001-4f965ffce43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:23.552572 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1255/2495] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:23 2022] PUT /identity/v3/projects/e3e460436c0947cd9030b3bc731c3efa/users/3c124318ce6c40cbb4903e97ea543517/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:23.606856 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1241/2496] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:20:23.611246 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bd3df-443e-4ef4-9bae-0b7bad7cc620 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:23.618644 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc997fb-91f0-411f-955d-5222de9e95b5 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:23.618932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc997fb-91f0-411f-955d-5222de9e95b5 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:23.619220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc997fb-91f0-411f-955d-5222de9e95b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:23.623337 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bd3df-443e-4ef4-9bae-0b7bad7cc620 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:23.628009 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f61b43-2c08-4c26-9048-0048d0b6da25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:23.628656 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f61b43-2c08-4c26-9048-0048d0b6da25 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:23.628943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f61b43-2c08-4c26-9048-0048d0b6da25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:23.629336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f61b43-2c08-4c26-9048-0048d0b6da25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:23.630110 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f61b43-2c08-4c26-9048-0048d0b6da25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:20:23.630423 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f61b43-2c08-4c26-9048-0048d0b6da25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:23.632032 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f61b43-2c08-4c26-9048-0048d0b6da25 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:23.644506 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1256/2497] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:20:23.646782 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-2bc997fb-91f0-411f-955d-5222de9e95b5 None None] MFA Rules not processed for user `3c124318ce6c40cbb4903e97ea543517`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:23.648099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-2bc997fb-91f0-411f-955d-5222de9e95b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:23.648716 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f61b43-2c08-4c26-9048-0048d0b6da25 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:23.659159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f61b43-2c08-4c26-9048-0048d0b6da25 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:23.663888 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711ccd3-4832-4599-bb37-1aef1adc69b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:23.664519 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711ccd3-4832-4599-bb37-1aef1adc69b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:23.664804 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711ccd3-4832-4599-bb37-1aef1adc69b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:23.665083 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711ccd3-4832-4599-bb37-1aef1adc69b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:23.665377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:23.665759 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711ccd3-4832-4599-bb37-1aef1adc69b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:23.667818 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711ccd3-4832-4599-bb37-1aef1adc69b1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:23.703937 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1257/2498] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:23 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:20:23.705651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711ccd3-4832-4599-bb37-1aef1adc69b1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:23.730972 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1242/2499] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:23 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:20:23.742898 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc997fb-91f0-411f-955d-5222de9e95b5 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:23.744555 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-2bc997fb-91f0-411f-955d-5222de9e95b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:23.778368 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711ccd3-4832-4599-bb37-1aef1adc69b1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:23.785420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe11f0-2724-46f0-9e6c-857b86e5ce1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:23.786132 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe11f0-2724-46f0-9e6c-857b86e5ce1f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:23.786418 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe11f0-2724-46f0-9e6c-857b86e5ce1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:23.786696 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe11f0-2724-46f0-9e6c-857b86e5ce1f admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:23.787391 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe11f0-2724-46f0-9e6c-857b86e5ce1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:23.789352 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe11f0-2724-46f0-9e6c-857b86e5ce1f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:23.811389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc997fb-91f0-411f-955d-5222de9e95b5 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:23.815095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1258/2500] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:23 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:20:23.816166 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe11f0-2724-46f0-9e6c-857b86e5ce1f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:23.827441 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe11f0-2724-46f0-9e6c-857b86e5ce1f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:23.832969 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7294e-3aa3-4790-bd1d-5a8253ab7e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:23.833631 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7294e-3aa3-4790-bd1d-5a8253ab7e4c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:23.833917 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7294e-3aa3-4790-bd1d-5a8253ab7e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:23.834229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7294e-3aa3-4790-bd1d-5a8253ab7e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:23.834954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7294e-3aa3-4790-bd1d-5a8253ab7e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:23.836592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7294e-3aa3-4790-bd1d-5a8253ab7e4c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:23.848007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1259/2501] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:23.851861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7294e-3aa3-4790-bd1d-5a8253ab7e4c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:23.863187 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7294e-3aa3-4790-bd1d-5a8253ab7e4c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:23.868000 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e960ff-2703-4212-9299-a3c2155acc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:23.868194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d1b00-d3ae-4499-9a8d-61003a47de13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:23.868659 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e960ff-2703-4212-9299-a3c2155acc25 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:23.868802 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d1b00-d3ae-4499-9a8d-61003a47de13 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:23.868949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e960ff-2703-4212-9299-a3c2155acc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:23.869101 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d1b00-d3ae-4499-9a8d-61003a47de13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:23.869201 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e960ff-2703-4212-9299-a3c2155acc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:23.869357 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d1b00-d3ae-4499-9a8d-61003a47de13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:23.869918 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e960ff-2703-4212-9299-a3c2155acc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:23.871551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e960ff-2703-4212-9299-a3c2155acc25 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:23.884745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1260/2502] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:20:23.889274 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e960ff-2703-4212-9299-a3c2155acc25 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:23.902873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e960ff-2703-4212-9299-a3c2155acc25 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:23.908108 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8f0a3-168e-4419-a0ad-c3e70130b838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:23.909586 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8f0a3-168e-4419-a0ad-c3e70130b838 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:23.909892 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8f0a3-168e-4419-a0ad-c3e70130b838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:23.910262 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8f0a3-168e-4419-a0ad-c3e70130b838 admin admin] PATH_INFO: `/v3/projects/896902236a924011afc15923e5ba42a7/users/04853095196c42c4a15c66285a0284e7/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:23.926869 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8f0a3-168e-4419-a0ad-c3e70130b838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=896902236a924011afc15923e5ba42a7, user_id=04853095196c42c4a15c66285a0284e7, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:23.930243 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8f0a3-168e-4419-a0ad-c3e70130b838 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:23.943382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d1b00-d3ae-4499-9a8d-61003a47de13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:23.944939 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d1b00-d3ae-4499-9a8d-61003a47de13 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:23.949886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1261/2503] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:23 2022] PUT /identity/v3/projects/896902236a924011afc15923e5ba42a7/users/04853095196c42c4a15c66285a0284e7/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:23.955126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1243/2504] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:23 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:20:23.961839 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393efd2-f6d6-46a0-a1fc-c809ceaac5bf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:23.962175 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393efd2-f6d6-46a0-a1fc-c809ceaac5bf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:23.962417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393efd2-f6d6-46a0-a1fc-c809ceaac5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:23.994672 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a393efd2-f6d6-46a0-a1fc-c809ceaac5bf None None] MFA Rules not processed for user `04853095196c42c4a15c66285a0284e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:23.995899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a393efd2-f6d6-46a0-a1fc-c809ceaac5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:24.040104 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:24.041703 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d1b00-d3ae-4499-9a8d-61003a47de13 service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:24.053076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d1b00-d3ae-4499-9a8d-61003a47de13 service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:24.071035 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:24.073927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1262/2505] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:24.078359 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393efd2-f6d6-46a0-a1fc-c809ceaac5bf None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:24.108480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cf317-ea84-4852-aba6-f3cf9dcc31cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:24.109283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cf317-ea84-4852-aba6-f3cf9dcc31cd service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:24.109510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cf317-ea84-4852-aba6-f3cf9dcc31cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:24.109785 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cf317-ea84-4852-aba6-f3cf9dcc31cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:24.111727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-844cf317-ea84-4852-aba6-f3cf9dcc31cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:24.147614 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393efd2-f6d6-46a0-a1fc-c809ceaac5bf None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:24.152389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cf199-edfd-40f4-9cd0-28ab0e183455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:24.153127 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf199-edfd-40f4-9cd0-28ab0e183455 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:24.153480 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf199-edfd-40f4-9cd0-28ab0e183455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:24.153826 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf199-edfd-40f4-9cd0-28ab0e183455 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:24.154640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cf199-edfd-40f4-9cd0-28ab0e183455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:24.156621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cf199-edfd-40f4-9cd0-28ab0e183455 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:24.173071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cf317-ea84-4852-aba6-f3cf9dcc31cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:24.174800 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cf317-ea84-4852-aba6-f3cf9dcc31cd service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:24.186524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1263/2506] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:24 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:24.186687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1244/2507] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:20:24.187486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cf199-edfd-40f4-9cd0-28ab0e183455 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:24.250604 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cf199-edfd-40f4-9cd0-28ab0e183455 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:24.255899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bc21b-84ce-4fa7-a313-22e7477317cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:24.256603 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc21b-84ce-4fa7-a313-22e7477317cc admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:24.256886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc21b-84ce-4fa7-a313-22e7477317cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:24.257164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc21b-84ce-4fa7-a313-22e7477317cc admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:24.257855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bc21b-84ce-4fa7-a313-22e7477317cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:24.259817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bc21b-84ce-4fa7-a313-22e7477317cc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:24.283975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1264/2508] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:24 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:20:24.288018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cf317-ea84-4852-aba6-f3cf9dcc31cd service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:24.298512 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cf317-ea84-4852-aba6-f3cf9dcc31cd service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:24.303779 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb885877-296a-49d0-b918-d678536c36e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:24.304443 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb885877-296a-49d0-b918-d678536c36e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:24.304736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb885877-296a-49d0-b918-d678536c36e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:24.305009 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb885877-296a-49d0-b918-d678536c36e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:24.305734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb885877-296a-49d0-b918-d678536c36e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:24.307342 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb885877-296a-49d0-b918-d678536c36e3 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:24.321932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1245/2509] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:24.323191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bc21b-84ce-4fa7-a313-22e7477317cc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:24.334520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bc21b-84ce-4fa7-a313-22e7477317cc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:24.341452 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa5207-d62e-483d-b638-e6c8a0b89914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:24.342413 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa5207-d62e-483d-b638-e6c8a0b89914 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:24.342696 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa5207-d62e-483d-b638-e6c8a0b89914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:24.342965 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa5207-d62e-483d-b638-e6c8a0b89914 admin admin] PATH_INFO: `/v3/projects/f8f4301bf1b34d7a9066b2c24f7ff8c0/users/4dfdbb81a7c64fa69dcb2b79a883e06c/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:24.358549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa5207-d62e-483d-b638-e6c8a0b89914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f4301bf1b34d7a9066b2c24f7ff8c0, user_id=4dfdbb81a7c64fa69dcb2b79a883e06c, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:24.361255 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa5207-d62e-483d-b638-e6c8a0b89914 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:24.376315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1265/2510] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:24 2022] PUT /identity/v3/projects/f8f4301bf1b34d7a9066b2c24f7ff8c0/users/4dfdbb81a7c64fa69dcb2b79a883e06c/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:24.380564 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb885877-296a-49d0-b918-d678536c36e3 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:24.390902 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb885877-296a-49d0-b918-d678536c36e3 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:24.490546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea3769-7a9f-46a6-9827-50d6a0c0b173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:24.502786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea3769-7a9f-46a6-9827-50d6a0c0b173 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:24.502786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea3769-7a9f-46a6-9827-50d6a0c0b173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:24.502786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea3769-7a9f-46a6-9827-50d6a0c0b173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:24.502786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea3769-7a9f-46a6-9827-50d6a0c0b173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:24.502786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea3769-7a9f-46a6-9827-50d6a0c0b173 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:24.505565 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1246/2511] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:24.509407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa5207-d62e-483d-b638-e6c8a0b89914 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:24.521170 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa5207-d62e-483d-b638-e6c8a0b89914 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:24.526207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7289a-794f-43da-95d5-3dca80884567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:24.527199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7289a-794f-43da-95d5-3dca80884567 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:24.527555 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7289a-794f-43da-95d5-3dca80884567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:24.527904 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7289a-794f-43da-95d5-3dca80884567 admin admin] PATH_INFO: `/v3/projects/f8f4301bf1b34d7a9066b2c24f7ff8c0/users/4dfdbb81a7c64fa69dcb2b79a883e06c/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:24.530671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7289a-794f-43da-95d5-3dca80884567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f4301bf1b34d7a9066b2c24f7ff8c0, user_id=4dfdbb81a7c64fa69dcb2b79a883e06c, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:24.533502 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7289a-794f-43da-95d5-3dca80884567 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:24.544774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1266/2512] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:24 2022] PUT /identity/v3/projects/f8f4301bf1b34d7a9066b2c24f7ff8c0/users/4dfdbb81a7c64fa69dcb2b79a883e06c/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:24.555952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca2042-e333-4d5b-985c-9932652e0cc0 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:24.556458 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca2042-e333-4d5b-985c-9932652e0cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:24.556572 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca2042-e333-4d5b-985c-9932652e0cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:24.585733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-a5ca2042-e333-4d5b-985c-9932652e0cc0 None None] MFA Rules not processed for user `4dfdbb81a7c64fa69dcb2b79a883e06c`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:24.586968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a5ca2042-e333-4d5b-985c-9932652e0cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:24.633658 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:24.654553 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1247/2513] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:24.666285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7289a-794f-43da-95d5-3dca80884567 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:24.684529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:24.724674 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7289a-794f-43da-95d5-3dca80884567 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:24.728295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1299fc-9007-4814-b485-9543e7354c58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:24.728932 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1299fc-9007-4814-b485-9543e7354c58 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:24.729212 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1299fc-9007-4814-b485-9543e7354c58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:24.729483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1299fc-9007-4814-b485-9543e7354c58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:24.738978 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1299fc-9007-4814-b485-9543e7354c58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:24.740452 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1299fc-9007-4814-b485-9543e7354c58 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:24.750741 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1267/2514] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:24.815834 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca2042-e333-4d5b-985c-9932652e0cc0 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:24.875638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca2042-e333-4d5b-985c-9932652e0cc0 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:24.880182 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121d529-a3c3-4a65-adfc-635c6a650710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:24.881031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121d529-a3c3-4a65-adfc-635c6a650710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:24.881310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121d529-a3c3-4a65-adfc-635c6a650710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:24.881580 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121d529-a3c3-4a65-adfc-635c6a650710 admin admin] PATH_INFO: `/v3/users/04853095196c42c4a15c66285a0284e7` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:24.882827 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121d529-a3c3-4a65-adfc-635c6a650710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04853095196c42c4a15c66285a0284e7)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:24.884708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121d529-a3c3-4a65-adfc-635c6a650710 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:24.929565 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-2121d529-a3c3-4a65-adfc-635c6a650710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04853095196c42c4a15c66285a0284e7'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:24.930329 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-2121d529-a3c3-4a65-adfc-635c6a650710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04853095196c42c4a15c66285a0284e7'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:24.930936 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-2121d529-a3c3-4a65-adfc-635c6a650710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04853095196c42c4a15c66285a0284e7'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:24.942915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-2121d529-a3c3-4a65-adfc-635c6a650710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04853095196c42c4a15c66285a0284e7'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:24.949586 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-2121d529-a3c3-4a65-adfc-635c6a650710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04853095196c42c4a15c66285a0284e7'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:24.961978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1248/2515] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:24 2022] DELETE /identity/v3/users/04853095196c42c4a15c66285a0284e7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:24.966561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224acb6-e3c3-421c-b02e-ada3ec692e3b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:24.966856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224acb6-e3c3-421c-b02e-ada3ec692e3b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:24.967154 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224acb6-e3c3-421c-b02e-ada3ec692e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:24.985900 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b224acb6-e3c3-421c-b02e-ada3ec692e3b None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:24.987744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b224acb6-e3c3-421c-b02e-ada3ec692e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:25.044971 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1268/2516] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:25.055192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121d529-a3c3-4a65-adfc-635c6a650710 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:25.056562 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-2121d529-a3c3-4a65-adfc-635c6a650710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:25.112714 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121d529-a3c3-4a65-adfc-635c6a650710 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:25.116348 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf04ec-c7f9-4a05-bd87-4c214598ae7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:25.116986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf04ec-c7f9-4a05-bd87-4c214598ae7e service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:25.117267 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf04ec-c7f9-4a05-bd87-4c214598ae7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:25.117542 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf04ec-c7f9-4a05-bd87-4c214598ae7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:25.126363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf04ec-c7f9-4a05-bd87-4c214598ae7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:25.127803 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf04ec-c7f9-4a05-bd87-4c214598ae7e service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:25.137061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1249/2517] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:25.490583 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224acb6-e3c3-421c-b02e-ada3ec692e3b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:25.492062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b224acb6-e3c3-421c-b02e-ada3ec692e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:25.508521 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224acb6-e3c3-421c-b02e-ada3ec692e3b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:25.513156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14604d-b947-4940-8e40-c9222b91c680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:25.514044 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14604d-b947-4940-8e40-c9222b91c680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:25.514397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14604d-b947-4940-8e40-c9222b91c680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:25.514589 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14604d-b947-4940-8e40-c9222b91c680 admin admin] PATH_INFO: `/v3/projects/896902236a924011afc15923e5ba42a7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:25.515801 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14604d-b947-4940-8e40-c9222b91c680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=896902236a924011afc15923e5ba42a7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:25.517705 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14604d-b947-4940-8e40-c9222b91c680 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:25.571886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fa14604d-b947-4940-8e40-c9222b91c680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896902236a924011afc15923e5ba42a7', 'request_id': 'req-fa14604d-b947-4940-8e40-c9222b91c680'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:25.578307 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fa14604d-b947-4940-8e40-c9222b91c680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896902236a924011afc15923e5ba42a7', 'request_id': 'req-fa14604d-b947-4940-8e40-c9222b91c680'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:25.585373 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fa14604d-b947-4940-8e40-c9222b91c680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896902236a924011afc15923e5ba42a7', 'request_id': 'req-fa14604d-b947-4940-8e40-c9222b91c680'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:25.601901 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fa14604d-b947-4940-8e40-c9222b91c680 admin admin] The token cache is being invalidate because project 896902236a924011afc15923e5ba42a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:25.602237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fa14604d-b947-4940-8e40-c9222b91c680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:25.603279 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fa14604d-b947-4940-8e40-c9222b91c680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:25.608426 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1269/2518] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:25 2022] DELETE /identity/v3/projects/896902236a924011afc15923e5ba42a7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:25.610428 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf04ec-c7f9-4a05-bd87-4c214598ae7e service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:25.620909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf04ec-c7f9-4a05-bd87-4c214598ae7e service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:25.624774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:25.694277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1e2c4-897e-4632-8a6d-9f8c11dca901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:25.695375 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1e2c4-897e-4632-8a6d-9f8c11dca901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:25.695664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1e2c4-897e-4632-8a6d-9f8c11dca901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:25.695945 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1e2c4-897e-4632-8a6d-9f8c11dca901 admin admin] PATH_INFO: `/v3/users/4dfdbb81a7c64fa69dcb2b79a883e06c` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:25.697200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1e2c4-897e-4632-8a6d-9f8c11dca901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dfdbb81a7c64fa69dcb2b79a883e06c)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:25.699168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1e2c4-897e-4632-8a6d-9f8c11dca901 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:25.775079 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-33e1e2c4-897e-4632-8a6d-9f8c11dca901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dfdbb81a7c64fa69dcb2b79a883e06c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:25.775784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-33e1e2c4-897e-4632-8a6d-9f8c11dca901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dfdbb81a7c64fa69dcb2b79a883e06c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:25.776767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-33e1e2c4-897e-4632-8a6d-9f8c11dca901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dfdbb81a7c64fa69dcb2b79a883e06c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:25.791763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-33e1e2c4-897e-4632-8a6d-9f8c11dca901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dfdbb81a7c64fa69dcb2b79a883e06c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:25.801370 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-33e1e2c4-897e-4632-8a6d-9f8c11dca901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dfdbb81a7c64fa69dcb2b79a883e06c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:25.815568 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1250/2519] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:25 2022] DELETE /identity/v3/users/4dfdbb81a7c64fa69dcb2b79a883e06c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:26.420063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14604d-b947-4940-8e40-c9222b91c680 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:26.421922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fa14604d-b947-4940-8e40-c9222b91c680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:26.435818 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14604d-b947-4940-8e40-c9222b91c680 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:26.487847 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:26.508923 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc00136-7f41-4894-b70a-f40e59bd84d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:26.509791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc00136-7f41-4894-b70a-f40e59bd84d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:26.510117 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc00136-7f41-4894-b70a-f40e59bd84d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:26.510382 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc00136-7f41-4894-b70a-f40e59bd84d4 admin admin] PATH_INFO: `/v3/projects/f8f4301bf1b34d7a9066b2c24f7ff8c0` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:26.511593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc00136-7f41-4894-b70a-f40e59bd84d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8f4301bf1b34d7a9066b2c24f7ff8c0)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:26.514398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc00136-7f41-4894-b70a-f40e59bd84d4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:26.562943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5dc00136-7f41-4894-b70a-f40e59bd84d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8f4301bf1b34d7a9066b2c24f7ff8c0', 'request_id': 'req-5dc00136-7f41-4894-b70a-f40e59bd84d4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:26.571489 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5dc00136-7f41-4894-b70a-f40e59bd84d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8f4301bf1b34d7a9066b2c24f7ff8c0', 'request_id': 'req-5dc00136-7f41-4894-b70a-f40e59bd84d4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:26.579662 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5dc00136-7f41-4894-b70a-f40e59bd84d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8f4301bf1b34d7a9066b2c24f7ff8c0', 'request_id': 'req-5dc00136-7f41-4894-b70a-f40e59bd84d4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:26.594246 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5dc00136-7f41-4894-b70a-f40e59bd84d4 admin admin] The token cache is being invalidate because project f8f4301bf1b34d7a9066b2c24f7ff8c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:26.594534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5dc00136-7f41-4894-b70a-f40e59bd84d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:26.595145 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5dc00136-7f41-4894-b70a-f40e59bd84d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:26.596708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1270/2520] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:26 2022] DELETE /identity/v3/projects/f8f4301bf1b34d7a9066b2c24f7ff8c0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:26.601574 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13e061-20a6-4846-8666-4a1156af3f8d None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:26.601863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13e061-20a6-4846-8666-4a1156af3f8d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:26.602170 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13e061-20a6-4846-8666-4a1156af3f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:26.621502 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-6c13e061-20a6-4846-8666-4a1156af3f8d None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:26.622734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6c13e061-20a6-4846-8666-4a1156af3f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:26.684178 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1251/2521] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:26.692883 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d1526-b503-4430-838b-4d0d204097a1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:26.693193 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d1526-b503-4430-838b-4d0d204097a1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:26.693466 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d1526-b503-4430-838b-4d0d204097a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:26.714764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4b1d1526-b503-4430-838b-4d0d204097a1 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:26.716028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4b1d1526-b503-4430-838b-4d0d204097a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:26.724345 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1271/2522] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:26.728926 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13e061-20a6-4846-8666-4a1156af3f8d None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:26.740548 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13e061-20a6-4846-8666-4a1156af3f8d None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:26.745432 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86910b5c-42d0-4210-b092-2e2e29ac2839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:26.746155 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86910b5c-42d0-4210-b092-2e2e29ac2839 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:26.746440 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86910b5c-42d0-4210-b092-2e2e29ac2839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:26.746716 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86910b5c-42d0-4210-b092-2e2e29ac2839 admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:26.747462 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86910b5c-42d0-4210-b092-2e2e29ac2839 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:20:26.747769 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86910b5c-42d0-4210-b092-2e2e29ac2839 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:26.749550 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86910b5c-42d0-4210-b092-2e2e29ac2839 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:26.762818 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1252/2523] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:20:26.767228 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d1526-b503-4430-838b-4d0d204097a1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:26.777122 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d1526-b503-4430-838b-4d0d204097a1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:26.781901 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45453561-6a85-4c9f-9082-fb9315b52db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:26.782613 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45453561-6a85-4c9f-9082-fb9315b52db5 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:26.782897 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45453561-6a85-4c9f-9082-fb9315b52db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:26.783173 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45453561-6a85-4c9f-9082-fb9315b52db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:26.783914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45453561-6a85-4c9f-9082-fb9315b52db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:26.785928 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45453561-6a85-4c9f-9082-fb9315b52db5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:26.819154 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1272/2524] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:26 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:26.823383 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86910b5c-42d0-4210-b092-2e2e29ac2839 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:26.834563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86910b5c-42d0-4210-b092-2e2e29ac2839 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:26.844478 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:26.909247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379c29a-71da-4f89-a031-6a8b75c44be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:26.910226 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379c29a-71da-4f89-a031-6a8b75c44be6 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:26.910583 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379c29a-71da-4f89-a031-6a8b75c44be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:26.910931 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379c29a-71da-4f89-a031-6a8b75c44be6 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:26.911776 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379c29a-71da-4f89-a031-6a8b75c44be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:26.914274 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379c29a-71da-4f89-a031-6a8b75c44be6 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:26.947213 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1253/2525] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:26 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:20:26.951186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45453561-6a85-4c9f-9082-fb9315b52db5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:26.963949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45453561-6a85-4c9f-9082-fb9315b52db5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:26.969546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7e69d-b624-4c3f-9b4b-a8bd25129a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:26.970356 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7e69d-b624-4c3f-9b4b-a8bd25129a46 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:26.970711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7e69d-b624-4c3f-9b4b-a8bd25129a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:26.971106 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7e69d-b624-4c3f-9b4b-a8bd25129a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:26.972051 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7e69d-b624-4c3f-9b4b-a8bd25129a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:26.974041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7e69d-b624-4c3f-9b4b-a8bd25129a46 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:27.009648 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1273/2526] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:20:27.013728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379c29a-71da-4f89-a031-6a8b75c44be6 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:27.025387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379c29a-71da-4f89-a031-6a8b75c44be6 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:27.031057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce72793-11db-4380-a41c-d44fadbe2dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:27.031684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce72793-11db-4380-a41c-d44fadbe2dac admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:27.031973 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce72793-11db-4380-a41c-d44fadbe2dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:27.033262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce72793-11db-4380-a41c-d44fadbe2dac admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:27.033712 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce72793-11db-4380-a41c-d44fadbe2dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:27.038743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce72793-11db-4380-a41c-d44fadbe2dac admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:27.064519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1254/2527] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:27.069785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7e69d-b624-4c3f-9b4b-a8bd25129a46 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:27.083670 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7e69d-b624-4c3f-9b4b-a8bd25129a46 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:27.090812 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00976a-40b3-4ae9-bcdf-3b7327d0279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:27.091726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00976a-40b3-4ae9-bcdf-3b7327d0279b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:27.092005 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00976a-40b3-4ae9-bcdf-3b7327d0279b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:27.092274 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00976a-40b3-4ae9-bcdf-3b7327d0279b admin admin] PATH_INFO: `/v3/projects/308a31dfd792409c803beabf1e701692/users/4f869b64fa374b038bfa440709ea3569/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:27.118129 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00976a-40b3-4ae9-bcdf-3b7327d0279b admin admin] RBAC: Authorizing `identity:create_grant(project_id=308a31dfd792409c803beabf1e701692, user_id=4f869b64fa374b038bfa440709ea3569, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:27.120828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00976a-40b3-4ae9-bcdf-3b7327d0279b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:27.154407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1274/2528] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:27 2022] PUT /identity/v3/projects/308a31dfd792409c803beabf1e701692/users/4f869b64fa374b038bfa440709ea3569/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:27.165708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373f781-6d52-40a7-a409-134b18d8db4d None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:27.166183 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373f781-6d52-40a7-a409-134b18d8db4d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:27.166765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373f781-6d52-40a7-a409-134b18d8db4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:27.196102 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00976a-40b3-4ae9-bcdf-3b7327d0279b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:27.198386 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3c00976a-40b3-4ae9-bcdf-3b7327d0279b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:27.222755 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-f373f781-6d52-40a7-a409-134b18d8db4d None None] MFA Rules not processed for user `4f869b64fa374b038bfa440709ea3569`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:27.224382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-f373f781-6d52-40a7-a409-134b18d8db4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:27.316239 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00976a-40b3-4ae9-bcdf-3b7327d0279b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:27.318616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1255/2529] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:27.322980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373f781-6d52-40a7-a409-134b18d8db4d None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:27.327531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6daa3-7762-4ab6-838f-6aed3e208a14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:27.328272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6daa3-7762-4ab6-838f-6aed3e208a14 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:27.328621 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6daa3-7762-4ab6-838f-6aed3e208a14 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:27.329020 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6daa3-7762-4ab6-838f-6aed3e208a14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:27.331793 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cae6daa3-7762-4ab6-838f-6aed3e208a14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:27.345263 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:27.350174 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6daa3-7762-4ab6-838f-6aed3e208a14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:27.351978 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6daa3-7762-4ab6-838f-6aed3e208a14 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:27.366258 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1275/2530] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:20:27.423055 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373f781-6d52-40a7-a409-134b18d8db4d None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:27.427846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040b72b-5fb7-4a42-b929-598006ac3e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:27.428508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040b72b-5fb7-4a42-b929-598006ac3e4b admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:27.428796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040b72b-5fb7-4a42-b929-598006ac3e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:27.429074 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040b72b-5fb7-4a42-b929-598006ac3e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:27.429771 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040b72b-5fb7-4a42-b929-598006ac3e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:27.431771 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040b72b-5fb7-4a42-b929-598006ac3e4b admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:27.466434 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1256/2531] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:27 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:20:27.469981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6daa3-7762-4ab6-838f-6aed3e208a14 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:27.482802 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6daa3-7762-4ab6-838f-6aed3e208a14 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:27.547635 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c23d7a-7b70-4c0f-89ac-b545921f8469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:27.549237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c23d7a-7b70-4c0f-89ac-b545921f8469 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:27.549530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c23d7a-7b70-4c0f-89ac-b545921f8469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:27.549812 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c23d7a-7b70-4c0f-89ac-b545921f8469 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:27.550558 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c23d7a-7b70-4c0f-89ac-b545921f8469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:27.552640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c23d7a-7b70-4c0f-89ac-b545921f8469 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:27.577094 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1276/2532] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:27 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:27.585478 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040b72b-5fb7-4a42-b929-598006ac3e4b admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:27.596692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040b72b-5fb7-4a42-b929-598006ac3e4b admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:27.601384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee100df-2f33-4bab-9cee-aae15e5dff36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:27.602084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee100df-2f33-4bab-9cee-aae15e5dff36 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:27.602370 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee100df-2f33-4bab-9cee-aae15e5dff36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:27.602644 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee100df-2f33-4bab-9cee-aae15e5dff36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:27.603374 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee100df-2f33-4bab-9cee-aae15e5dff36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:27.604996 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee100df-2f33-4bab-9cee-aae15e5dff36 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:27.606344 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:27.620152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1257/2533] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:27.621302 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c23d7a-7b70-4c0f-89ac-b545921f8469 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:27.631697 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c23d7a-7b70-4c0f-89ac-b545921f8469 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:27.636493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dc937-115f-451a-aeac-3389cc51a2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:27.637448 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dc937-115f-451a-aeac-3389cc51a2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:27.637811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dc937-115f-451a-aeac-3389cc51a2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:27.638203 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dc937-115f-451a-aeac-3389cc51a2cc admin admin] PATH_INFO: `/v3/projects/4edd8f0a2d344f5bbcb64219df2c8b4d/users/fc9a0ec0978e4e728ee1f6040516b8a0/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:27.653827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dc937-115f-451a-aeac-3389cc51a2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4edd8f0a2d344f5bbcb64219df2c8b4d, user_id=fc9a0ec0978e4e728ee1f6040516b8a0, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:27.656654 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dc937-115f-451a-aeac-3389cc51a2cc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:27.674639 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1277/2534] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:27 2022] PUT /identity/v3/projects/4edd8f0a2d344f5bbcb64219df2c8b4d/users/fc9a0ec0978e4e728ee1f6040516b8a0/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:27.678361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee100df-2f33-4bab-9cee-aae15e5dff36 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:27.696774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee100df-2f33-4bab-9cee-aae15e5dff36 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:27.779040 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52061e-c1f8-442a-934e-35a6109a9356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:27.779840 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52061e-c1f8-442a-934e-35a6109a9356 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:27.780119 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52061e-c1f8-442a-934e-35a6109a9356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:27.780395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52061e-c1f8-442a-934e-35a6109a9356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:27.781117 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52061e-c1f8-442a-934e-35a6109a9356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:27.782901 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52061e-c1f8-442a-934e-35a6109a9356 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:27.797192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1258/2535] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:27.798608 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dc937-115f-451a-aeac-3389cc51a2cc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:27.809698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dc937-115f-451a-aeac-3389cc51a2cc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:27.815057 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621c22a-45a6-40a0-8d08-ceb6f6471abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:27.815951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621c22a-45a6-40a0-8d08-ceb6f6471abd admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:27.816237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621c22a-45a6-40a0-8d08-ceb6f6471abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:27.816514 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621c22a-45a6-40a0-8d08-ceb6f6471abd admin admin] PATH_INFO: `/v3/projects/4edd8f0a2d344f5bbcb64219df2c8b4d/users/fc9a0ec0978e4e728ee1f6040516b8a0/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:27.818760 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621c22a-45a6-40a0-8d08-ceb6f6471abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4edd8f0a2d344f5bbcb64219df2c8b4d, user_id=fc9a0ec0978e4e728ee1f6040516b8a0, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:27.821401 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621c22a-45a6-40a0-8d08-ceb6f6471abd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:27.833591 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1278/2536] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:27 2022] PUT /identity/v3/projects/4edd8f0a2d344f5bbcb64219df2c8b4d/users/fc9a0ec0978e4e728ee1f6040516b8a0/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:27.844781 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895691c-3415-4f50-b210-2a12541a6106 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:27.844950 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895691c-3415-4f50-b210-2a12541a6106 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:27.845207 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895691c-3415-4f50-b210-2a12541a6106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:27.878073 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-d895691c-3415-4f50-b210-2a12541a6106 None None] MFA Rules not processed for user `fc9a0ec0978e4e728ee1f6040516b8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:27.879355 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d895691c-3415-4f50-b210-2a12541a6106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:27.951624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1259/2537] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:27.964392 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621c22a-45a6-40a0-8d08-ceb6f6471abd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:27.966284 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1621c22a-45a6-40a0-8d08-ceb6f6471abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:28.027429 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621c22a-45a6-40a0-8d08-ceb6f6471abd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:28.031197 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4df270-bfdd-4752-addf-e74bb50a3e0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:28.031851 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4df270-bfdd-4752-addf-e74bb50a3e0b service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:28.032129 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4df270-bfdd-4752-addf-e74bb50a3e0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:28.032399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4df270-bfdd-4752-addf-e74bb50a3e0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:28.044383 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4df270-bfdd-4752-addf-e74bb50a3e0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:28.046214 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4df270-bfdd-4752-addf-e74bb50a3e0b service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:28.058115 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1279/2538] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:28.497365 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895691c-3415-4f50-b210-2a12541a6106 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:28.501322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4df270-bfdd-4752-addf-e74bb50a3e0b service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:28.503747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6a4df270-bfdd-4752-addf-e74bb50a3e0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:28.558505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:28.567948 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895691c-3415-4f50-b210-2a12541a6106 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:28.572515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f864b-bf08-4b0d-9c90-877279230912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:28.573418 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f864b-bf08-4b0d-9c90-877279230912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:28.573693 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f864b-bf08-4b0d-9c90-877279230912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:28.573959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f864b-bf08-4b0d-9c90-877279230912 admin admin] PATH_INFO: `/v3/users/4f869b64fa374b038bfa440709ea3569` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:28.575184 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f864b-bf08-4b0d-9c90-877279230912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f869b64fa374b038bfa440709ea3569)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:28.575374 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4df270-bfdd-4752-addf-e74bb50a3e0b service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:28.577083 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f864b-bf08-4b0d-9c90-877279230912 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:28.580198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb21ea0-7207-4d6e-a9cb-4fcdd4f51631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:28.581584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb21ea0-7207-4d6e-a9cb-4fcdd4f51631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:28.581871 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb21ea0-7207-4d6e-a9cb-4fcdd4f51631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:28.582187 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb21ea0-7207-4d6e-a9cb-4fcdd4f51631 admin admin] PATH_INFO: `/v3/users/c3b44ba094c148d78c21d34dd9eb6246` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:28.583375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb21ea0-7207-4d6e-a9cb-4fcdd4f51631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b44ba094c148d78c21d34dd9eb6246)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:28.585289 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb21ea0-7207-4d6e-a9cb-4fcdd4f51631 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:28.599994 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:28.626696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-aa3f864b-bf08-4b0d-9c90-877279230912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f869b64fa374b038bfa440709ea3569'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:28.627881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-aa3f864b-bf08-4b0d-9c90-877279230912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f869b64fa374b038bfa440709ea3569'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:28.628487 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-aa3f864b-bf08-4b0d-9c90-877279230912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f869b64fa374b038bfa440709ea3569'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:28.634374 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7cb21ea0-7207-4d6e-a9cb-4fcdd4f51631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b44ba094c148d78c21d34dd9eb6246'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:28.635017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7cb21ea0-7207-4d6e-a9cb-4fcdd4f51631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b44ba094c148d78c21d34dd9eb6246'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:28.635622 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7cb21ea0-7207-4d6e-a9cb-4fcdd4f51631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b44ba094c148d78c21d34dd9eb6246'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:28.641223 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-aa3f864b-bf08-4b0d-9c90-877279230912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f869b64fa374b038bfa440709ea3569'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:28.648734 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7cb21ea0-7207-4d6e-a9cb-4fcdd4f51631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b44ba094c148d78c21d34dd9eb6246'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:28.649556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-aa3f864b-bf08-4b0d-9c90-877279230912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f869b64fa374b038bfa440709ea3569'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:28.657429 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7cb21ea0-7207-4d6e-a9cb-4fcdd4f51631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b44ba094c148d78c21d34dd9eb6246'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:28.665473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1260/2539] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:28 2022] DELETE /identity/v3/users/4f869b64fa374b038bfa440709ea3569 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:28.670027 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509a9e5-b4ba-401f-96e9-8ad4d3df9820 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:28.670330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509a9e5-b4ba-401f-96e9-8ad4d3df9820 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:28.670545 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1280/2540] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:28 2022] DELETE /identity/v3/users/c3b44ba094c148d78c21d34dd9eb6246 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:28.670692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509a9e5-b4ba-401f-96e9-8ad4d3df9820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:28.674691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ba5dc-620c-49ce-bcbf-7f402232b743 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:28.674987 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ba5dc-620c-49ce-bcbf-7f402232b743 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:28.675268 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ba5dc-620c-49ce-bcbf-7f402232b743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:28.690154 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-8509a9e5-b4ba-401f-96e9-8ad4d3df9820 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:28.691517 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-8509a9e5-b4ba-401f-96e9-8ad4d3df9820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:28.694308 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d72ba5dc-620c-49ce-bcbf-7f402232b743 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:28.695623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d72ba5dc-620c-49ce-bcbf-7f402232b743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:28.753588 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1261/2541] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:20:28.754579 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1281/2542] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:20:28.767688 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509a9e5-b4ba-401f-96e9-8ad4d3df9820 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:28.768485 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ba5dc-620c-49ce-bcbf-7f402232b743 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:28.769622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-8509a9e5-b4ba-401f-96e9-8ad4d3df9820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:28.769831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d72ba5dc-620c-49ce-bcbf-7f402232b743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:28.833615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509a9e5-b4ba-401f-96e9-8ad4d3df9820 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:28.836334 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ba5dc-620c-49ce-bcbf-7f402232b743 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:28.839147 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad3bd6-8b9b-4121-ac6e-5f5e0558e590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:28.839831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad3bd6-8b9b-4121-ac6e-5f5e0558e590 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:28.840188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad3bd6-8b9b-4121-ac6e-5f5e0558e590 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:28.840508 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1f62c-7dc8-4896-9351-954f16331ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:28.840625 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad3bd6-8b9b-4121-ac6e-5f5e0558e590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:28.841162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1f62c-7dc8-4896-9351-954f16331ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:28.841488 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1f62c-7dc8-4896-9351-954f16331ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:28.841709 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1f62c-7dc8-4896-9351-954f16331ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:28.851685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad3bd6-8b9b-4121-ac6e-5f5e0558e590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:28.851850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1f62c-7dc8-4896-9351-954f16331ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:28.853180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1f62c-7dc8-4896-9351-954f16331ec5 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:28.853287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad3bd6-8b9b-4121-ac6e-5f5e0558e590 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:28.868167 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1262/2543] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:28.869886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1282/2544] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:20:29.518060 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad3bd6-8b9b-4121-ac6e-5f5e0558e590 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:29.523402 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-4cad3bd6-8b9b-4121-ac6e-5f5e0558e590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:29.554110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad3bd6-8b9b-4121-ac6e-5f5e0558e590 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:29.563887 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1f62c-7dc8-4896-9351-954f16331ec5 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:29.565675 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ede1f62c-7dc8-4896-9351-954f16331ec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:29.579980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c46e4-98f8-4d69-92f3-b9932277063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:29.582155 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c46e4-98f8-4d69-92f3-b9932277063a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:29.583536 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c46e4-98f8-4d69-92f3-b9932277063a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:29.585660 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c46e4-98f8-4d69-92f3-b9932277063a admin admin] PATH_INFO: `/v3/projects/308a31dfd792409c803beabf1e701692` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:29.587292 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c46e4-98f8-4d69-92f3-b9932277063a admin admin] RBAC: Authorizing `identity:delete_project(project_id=308a31dfd792409c803beabf1e701692)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:29.591047 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c46e4-98f8-4d69-92f3-b9932277063a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:29.591929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1f62c-7dc8-4896-9351-954f16331ec5 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:29.604755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af85fdb-605a-4d40-bd0d-ce1e7e107a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:29.605739 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af85fdb-605a-4d40-bd0d-ce1e7e107a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:29.606047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af85fdb-605a-4d40-bd0d-ce1e7e107a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:29.606407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af85fdb-605a-4d40-bd0d-ce1e7e107a22 admin admin] PATH_INFO: `/v3/projects/623cb8c132df47bd941e86fbb7645383` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:29.611050 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af85fdb-605a-4d40-bd0d-ce1e7e107a22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=623cb8c132df47bd941e86fbb7645383)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:29.615404 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af85fdb-605a-4d40-bd0d-ce1e7e107a22 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:29.624815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:29.639306 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:29.661972 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7e9c46e4-98f8-4d69-92f3-b9932277063a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '308a31dfd792409c803beabf1e701692', 'request_id': 'req-7e9c46e4-98f8-4d69-92f3-b9932277063a'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.675268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7e9c46e4-98f8-4d69-92f3-b9932277063a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '308a31dfd792409c803beabf1e701692', 'request_id': 'req-7e9c46e4-98f8-4d69-92f3-b9932277063a'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.683300 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7e9c46e4-98f8-4d69-92f3-b9932277063a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '308a31dfd792409c803beabf1e701692', 'request_id': 'req-7e9c46e4-98f8-4d69-92f3-b9932277063a'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.683935 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5af85fdb-605a-4d40-bd0d-ce1e7e107a22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '623cb8c132df47bd941e86fbb7645383', 'request_id': 'req-5af85fdb-605a-4d40-bd0d-ce1e7e107a22'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.691054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5af85fdb-605a-4d40-bd0d-ce1e7e107a22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '623cb8c132df47bd941e86fbb7645383', 'request_id': 'req-5af85fdb-605a-4d40-bd0d-ce1e7e107a22'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.700434 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7e9c46e4-98f8-4d69-92f3-b9932277063a admin admin] The token cache is being invalidate because project 308a31dfd792409c803beabf1e701692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:29.701007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5af85fdb-605a-4d40-bd0d-ce1e7e107a22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '623cb8c132df47bd941e86fbb7645383', 'request_id': 'req-5af85fdb-605a-4d40-bd0d-ce1e7e107a22'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.701148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7e9c46e4-98f8-4d69-92f3-b9932277063a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.701477 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-7e9c46e4-98f8-4d69-92f3-b9932277063a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.706347 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1263/2545] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:29 2022] DELETE /identity/v3/projects/308a31dfd792409c803beabf1e701692 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:29.707796 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c46e4-98f8-4d69-92f3-b9932277063a admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:29.709710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-7e9c46e4-98f8-4d69-92f3-b9932277063a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:29.723160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5af85fdb-605a-4d40-bd0d-ce1e7e107a22 admin admin] The token cache is being invalidate because project 623cb8c132df47bd941e86fbb7645383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:29.723481 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5af85fdb-605a-4d40-bd0d-ce1e7e107a22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.724983 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5af85fdb-605a-4d40-bd0d-ce1e7e107a22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.727658 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1283/2546] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:29 2022] DELETE /identity/v3/projects/623cb8c132df47bd941e86fbb7645383 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:29.732793 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af85fdb-605a-4d40-bd0d-ce1e7e107a22 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:29.735366 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5af85fdb-605a-4d40-bd0d-ce1e7e107a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:29.797231 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c46e4-98f8-4d69-92f3-b9932277063a admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:29.844350 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af85fdb-605a-4d40-bd0d-ce1e7e107a22 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:29.852374 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad2882-9543-4e65-ae83-08c8e9d44421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:29.853278 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad2882-9543-4e65-ae83-08c8e9d44421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:29.853568 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad2882-9543-4e65-ae83-08c8e9d44421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:29.854218 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad2882-9543-4e65-ae83-08c8e9d44421 admin admin] PATH_INFO: `/v3/users/3c124318ce6c40cbb4903e97ea543517` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:29.858790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad2882-9543-4e65-ae83-08c8e9d44421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c124318ce6c40cbb4903e97ea543517)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:29.862544 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad2882-9543-4e65-ae83-08c8e9d44421 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:29.889278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e4bd3-2d92-4cae-a296-97f128a4acec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:29.890646 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4bd3-2d92-4cae-a296-97f128a4acec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:29.890960 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4bd3-2d92-4cae-a296-97f128a4acec admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:29.891415 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4bd3-2d92-4cae-a296-97f128a4acec admin admin] PATH_INFO: `/v3/users/fc9a0ec0978e4e728ee1f6040516b8a0` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:29.894196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e4bd3-2d92-4cae-a296-97f128a4acec admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc9a0ec0978e4e728ee1f6040516b8a0)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:29.897690 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e4bd3-2d92-4cae-a296-97f128a4acec admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:29.935553 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1ad2882-9543-4e65-ae83-08c8e9d44421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c124318ce6c40cbb4903e97ea543517'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.937551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1ad2882-9543-4e65-ae83-08c8e9d44421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c124318ce6c40cbb4903e97ea543517'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.939069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1ad2882-9543-4e65-ae83-08c8e9d44421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c124318ce6c40cbb4903e97ea543517'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.967919 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1ad2882-9543-4e65-ae83-08c8e9d44421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c124318ce6c40cbb4903e97ea543517'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.978401 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-ac8e4bd3-2d92-4cae-a296-97f128a4acec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc9a0ec0978e4e728ee1f6040516b8a0'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.979189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-ac8e4bd3-2d92-4cae-a296-97f128a4acec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc9a0ec0978e4e728ee1f6040516b8a0'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.979730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1ad2882-9543-4e65-ae83-08c8e9d44421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c124318ce6c40cbb4903e97ea543517'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.979944 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-ac8e4bd3-2d92-4cae-a296-97f128a4acec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc9a0ec0978e4e728ee1f6040516b8a0'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.992746 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-ac8e4bd3-2d92-4cae-a296-97f128a4acec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc9a0ec0978e4e728ee1f6040516b8a0'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:29.997707 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1284/2547] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:29 2022] DELETE /identity/v3/users/3c124318ce6c40cbb4903e97ea543517 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:30.008268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:30.010495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-ac8e4bd3-2d92-4cae-a296-97f128a4acec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc9a0ec0978e4e728ee1f6040516b8a0'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:30.029989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1264/2548] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:29 2022] DELETE /identity/v3/users/fc9a0ec0978e4e728ee1f6040516b8a0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:30.290975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad2882-9543-4e65-ae83-08c8e9d44421 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:30.294514 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b1ad2882-9543-4e65-ae83-08c8e9d44421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:30.320270 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:30.326278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e4bd3-2d92-4cae-a296-97f128a4acec admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:30.327862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ac8e4bd3-2d92-4cae-a296-97f128a4acec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:30.382671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad2882-9543-4e65-ae83-08c8e9d44421 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:30.404024 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e4bd3-2d92-4cae-a296-97f128a4acec admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:30.408695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb674a-0d24-44dd-ab17-e0b2c2a52fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:30.409545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb674a-0d24-44dd-ab17-e0b2c2a52fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:30.409827 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb674a-0d24-44dd-ab17-e0b2c2a52fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:30.410133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb674a-0d24-44dd-ab17-e0b2c2a52fd0 admin admin] PATH_INFO: `/v3/projects/4edd8f0a2d344f5bbcb64219df2c8b4d` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:30.411349 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb674a-0d24-44dd-ab17-e0b2c2a52fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4edd8f0a2d344f5bbcb64219df2c8b4d)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:30.413240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb674a-0d24-44dd-ab17-e0b2c2a52fd0 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:30.444371 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fc6d4-304b-4b1d-833d-c0a7f9a774bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:30.445434 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fc6d4-304b-4b1d-833d-c0a7f9a774bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:30.445721 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fc6d4-304b-4b1d-833d-c0a7f9a774bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:30.446020 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fc6d4-304b-4b1d-833d-c0a7f9a774bc admin admin] PATH_INFO: `/v3/projects/e3e460436c0947cd9030b3bc731c3efa` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:30.447274 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555fc6d4-304b-4b1d-833d-c0a7f9a774bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3e460436c0947cd9030b3bc731c3efa)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:30.449204 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555fc6d4-304b-4b1d-833d-c0a7f9a774bc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:30.471477 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-29eb674a-0d24-44dd-ab17-e0b2c2a52fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4edd8f0a2d344f5bbcb64219df2c8b4d', 'request_id': 'req-29eb674a-0d24-44dd-ab17-e0b2c2a52fd0'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:30.480252 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-29eb674a-0d24-44dd-ab17-e0b2c2a52fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4edd8f0a2d344f5bbcb64219df2c8b4d', 'request_id': 'req-29eb674a-0d24-44dd-ab17-e0b2c2a52fd0'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:30.485965 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-29eb674a-0d24-44dd-ab17-e0b2c2a52fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4edd8f0a2d344f5bbcb64219df2c8b4d', 'request_id': 'req-29eb674a-0d24-44dd-ab17-e0b2c2a52fd0'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:30.498364 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-29eb674a-0d24-44dd-ab17-e0b2c2a52fd0 admin admin] The token cache is being invalidate because project 4edd8f0a2d344f5bbcb64219df2c8b4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:30.498654 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-29eb674a-0d24-44dd-ab17-e0b2c2a52fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:30.499302 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-29eb674a-0d24-44dd-ab17-e0b2c2a52fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:30.500846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1265/2549] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:30 2022] DELETE /identity/v3/projects/4edd8f0a2d344f5bbcb64219df2c8b4d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:30.500961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-555fc6d4-304b-4b1d-833d-c0a7f9a774bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3e460436c0947cd9030b3bc731c3efa', 'request_id': 'req-555fc6d4-304b-4b1d-833d-c0a7f9a774bc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:30.506193 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a79b28-a620-4243-8ccd-adba2b6e6cc7 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:30.506524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a79b28-a620-4243-8ccd-adba2b6e6cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:30.506760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a79b28-a620-4243-8ccd-adba2b6e6cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:30.508410 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-555fc6d4-304b-4b1d-833d-c0a7f9a774bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3e460436c0947cd9030b3bc731c3efa', 'request_id': 'req-555fc6d4-304b-4b1d-833d-c0a7f9a774bc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:30.514999 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-555fc6d4-304b-4b1d-833d-c0a7f9a774bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3e460436c0947cd9030b3bc731c3efa', 'request_id': 'req-555fc6d4-304b-4b1d-833d-c0a7f9a774bc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:30.525684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-19a79b28-a620-4243-8ccd-adba2b6e6cc7 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:30.526910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-19a79b28-a620-4243-8ccd-adba2b6e6cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:30.527731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-555fc6d4-304b-4b1d-833d-c0a7f9a774bc admin admin] The token cache is being invalidate because project e3e460436c0947cd9030b3bc731c3efa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:30.528022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-555fc6d4-304b-4b1d-833d-c0a7f9a774bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:30.528643 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-555fc6d4-304b-4b1d-833d-c0a7f9a774bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:30.530224 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1285/2550] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:30 2022] DELETE /identity/v3/projects/e3e460436c0947cd9030b3bc731c3efa => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:30.534993 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732bdfa-d4c8-4c7a-b2ca-8b42a1e471b4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:30.535282 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732bdfa-d4c8-4c7a-b2ca-8b42a1e471b4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:30.535563 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732bdfa-d4c8-4c7a-b2ca-8b42a1e471b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:30.555156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4732bdfa-d4c8-4c7a-b2ca-8b42a1e471b4 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:30.556388 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4732bdfa-d4c8-4c7a-b2ca-8b42a1e471b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:30.588804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1266/2551] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:20:30.596827 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5d660-92bb-4c2b-bf63-0c976b98f195 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:30.597118 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5d660-92bb-4c2b-bf63-0c976b98f195 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:30.597388 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5d660-92bb-4c2b-bf63-0c976b98f195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:30.605241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:30.619007 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-58e5d660-92bb-4c2b-bf63-0c976b98f195 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:30.620219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-58e5d660-92bb-4c2b-bf63-0c976b98f195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:30.628837 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1267/2552] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:20:30.632677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1286/2553] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:20:30.632959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5d660-92bb-4c2b-bf63-0c976b98f195 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:30.634103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a243e8b-4593-45bd-851c-bf7e46e03b14 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:30.634402 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a243e8b-4593-45bd-851c-bf7e46e03b14 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:30.634686 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a243e8b-4593-45bd-851c-bf7e46e03b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:30.642462 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5d660-92bb-4c2b-bf63-0c976b98f195 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:30.647260 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dae834-0189-4cb3-bee1-3008875c1a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:30.647917 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dae834-0189-4cb3-bee1-3008875c1a9b admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:30.648203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dae834-0189-4cb3-bee1-3008875c1a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:30.648481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dae834-0189-4cb3-bee1-3008875c1a9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:30.649219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dae834-0189-4cb3-bee1-3008875c1a9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:20:30.649527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dae834-0189-4cb3-bee1-3008875c1a9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:30.651190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dae834-0189-4cb3-bee1-3008875c1a9b admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:30.658992 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2a243e8b-4593-45bd-851c-bf7e46e03b14 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:30.660252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2a243e8b-4593-45bd-851c-bf7e46e03b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:30.660764 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:30.666364 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1268/2554] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:20:30.669218 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dae834-0189-4cb3-bee1-3008875c1a9b admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:30.671103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1287/2555] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:30.675499 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a243e8b-4593-45bd-851c-bf7e46e03b14 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:30.684270 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dae834-0189-4cb3-bee1-3008875c1a9b admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:30.686322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a243e8b-4593-45bd-851c-bf7e46e03b14 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:30.689516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea692e-782a-44d8-a84a-a85fd14c2a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:30.690768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea692e-782a-44d8-a84a-a85fd14c2a86 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:30.691051 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea692e-782a-44d8-a84a-a85fd14c2a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:30.691329 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea692e-782a-44d8-a84a-a85fd14c2a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:30.692021 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea692e-782a-44d8-a84a-a85fd14c2a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:30.693959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea692e-782a-44d8-a84a-a85fd14c2a86 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:30.696183 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b64f6e-379a-46b3-806f-2c1d2e836b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:30.696976 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b64f6e-379a-46b3-806f-2c1d2e836b5a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:30.697264 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b64f6e-379a-46b3-806f-2c1d2e836b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:30.697540 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b64f6e-379a-46b3-806f-2c1d2e836b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:30.698306 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b64f6e-379a-46b3-806f-2c1d2e836b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:20:30.698614 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b64f6e-379a-46b3-806f-2c1d2e836b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:30.700206 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b64f6e-379a-46b3-806f-2c1d2e836b5a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:30.713314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1288/2556] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:20:30.718690 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b64f6e-379a-46b3-806f-2c1d2e836b5a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:30.724072 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1269/2557] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:30 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:20:30.728115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea692e-782a-44d8-a84a-a85fd14c2a86 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:30.728635 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b64f6e-379a-46b3-806f-2c1d2e836b5a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:30.789653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e85d9-3de5-412d-9acd-86339d095017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:30.790261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e85d9-3de5-412d-9acd-86339d095017 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:30.790539 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e85d9-3de5-412d-9acd-86339d095017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:30.790809 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e85d9-3de5-412d-9acd-86339d095017 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:30.791489 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e85d9-3de5-412d-9acd-86339d095017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:30.794089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e85d9-3de5-412d-9acd-86339d095017 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:30.797403 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea692e-782a-44d8-a84a-a85fd14c2a86 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:30.802930 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235b116-7faf-4bcc-9282-bc8deb1b993a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:30.803600 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235b116-7faf-4bcc-9282-bc8deb1b993a admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:30.803888 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235b116-7faf-4bcc-9282-bc8deb1b993a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:30.804164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235b116-7faf-4bcc-9282-bc8deb1b993a admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:30.804861 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235b116-7faf-4bcc-9282-bc8deb1b993a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:30.806818 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235b116-7faf-4bcc-9282-bc8deb1b993a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:30.828663 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1289/2558] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:30 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:30.832675 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e85d9-3de5-412d-9acd-86339d095017 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:30.833821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1270/2559] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:30 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:20:30.837817 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235b116-7faf-4bcc-9282-bc8deb1b993a admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:30.849656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235b116-7faf-4bcc-9282-bc8deb1b993a admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:30.902055 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e85d9-3de5-412d-9acd-86339d095017 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:30.906747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3846f-702f-4c66-997e-29288892c2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:30.907412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3846f-702f-4c66-997e-29288892c2bd admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:30.907691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3846f-702f-4c66-997e-29288892c2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:30.907963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3846f-702f-4c66-997e-29288892c2bd admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:30.909182 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3846f-702f-4c66-997e-29288892c2bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:30.911143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3846f-702f-4c66-997e-29288892c2bd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:30.912418 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9ec12-6359-4edc-b003-44bf5fbf6520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:30.913088 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9ec12-6359-4edc-b003-44bf5fbf6520 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:30.913373 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9ec12-6359-4edc-b003-44bf5fbf6520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:30.913647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9ec12-6359-4edc-b003-44bf5fbf6520 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:30.914421 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9ec12-6359-4edc-b003-44bf5fbf6520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:30.915997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9ec12-6359-4edc-b003-44bf5fbf6520 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:30.930049 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1271/2560] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:20:30.931568 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9ec12-6359-4edc-b003-44bf5fbf6520 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:30.940450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1290/2561] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:30 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:20:30.941693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3846f-702f-4c66-997e-29288892c2bd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:30.943190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9ec12-6359-4edc-b003-44bf5fbf6520 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:30.948566 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d56da0-ac36-4d1c-98ef-1451d6e419dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:30.949260 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d56da0-ac36-4d1c-98ef-1451d6e419dc admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:30.949546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d56da0-ac36-4d1c-98ef-1451d6e419dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:30.949834 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d56da0-ac36-4d1c-98ef-1451d6e419dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:30.950634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d56da0-ac36-4d1c-98ef-1451d6e419dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:30.952256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d56da0-ac36-4d1c-98ef-1451d6e419dc admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:30.952396 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3846f-702f-4c66-997e-29288892c2bd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:30.956915 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bdf56-26d0-4233-ad7c-d33f1959eab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:30.957562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bdf56-26d0-4233-ad7c-d33f1959eab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:30.957967 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bdf56-26d0-4233-ad7c-d33f1959eab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:30.958298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bdf56-26d0-4233-ad7c-d33f1959eab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:30.959033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bdf56-26d0-4233-ad7c-d33f1959eab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:30.960601 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bdf56-26d0-4233-ad7c-d33f1959eab0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:30.962790 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1272/2562] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:20:30.966943 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d56da0-ac36-4d1c-98ef-1451d6e419dc admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:30.974034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1291/2563] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:30.978951 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bdf56-26d0-4233-ad7c-d33f1959eab0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:30.982579 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d56da0-ac36-4d1c-98ef-1451d6e419dc admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:30.988860 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055b27c-1d8b-4a84-85b0-96c02d71ce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:30.989756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055b27c-1d8b-4a84-85b0-96c02d71ce50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:30.990060 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055b27c-1d8b-4a84-85b0-96c02d71ce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:30.990340 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055b27c-1d8b-4a84-85b0-96c02d71ce50 admin admin] PATH_INFO: `/v3/projects/d26fd4809ffb4cd59c14ef795476ef9d/users/a5e33f9993f6423793f30a86b6958dcc/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:30.990811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bdf56-26d0-4233-ad7c-d33f1959eab0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:30.996126 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb750c0-f65c-4f13-86ca-279ae2020e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:30.997122 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb750c0-f65c-4f13-86ca-279ae2020e2b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:30.997312 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb750c0-f65c-4f13-86ca-279ae2020e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:30.997639 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb750c0-f65c-4f13-86ca-279ae2020e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:30.998619 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb750c0-f65c-4f13-86ca-279ae2020e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:31.000391 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb750c0-f65c-4f13-86ca-279ae2020e2b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:31.008032 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055b27c-1d8b-4a84-85b0-96c02d71ce50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26fd4809ffb4cd59c14ef795476ef9d, user_id=a5e33f9993f6423793f30a86b6958dcc, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:31.010851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055b27c-1d8b-4a84-85b0-96c02d71ce50 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:31.013325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1292/2564] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:31.023050 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb750c0-f65c-4f13-86ca-279ae2020e2b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:31.032437 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1273/2565] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:30 2022] PUT /identity/v3/projects/d26fd4809ffb4cd59c14ef795476ef9d/users/a5e33f9993f6423793f30a86b6958dcc/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:31.037767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d17b0-22cb-4fc4-9d97-58cf564ceed7 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:31.038116 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d17b0-22cb-4fc4-9d97-58cf564ceed7 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:31.038487 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d17b0-22cb-4fc4-9d97-58cf564ceed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:31.042654 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb750c0-f65c-4f13-86ca-279ae2020e2b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:31.060062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-283d17b0-22cb-4fc4-9d97-58cf564ceed7 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:31.061399 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-283d17b0-22cb-4fc4-9d97-58cf564ceed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:31.065877 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:31.096727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:31.117941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada23816-29e7-46f7-8ba1-4b9949bd0c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:31.119019 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23816-29e7-46f7-8ba1-4b9949bd0c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:31.119543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23816-29e7-46f7-8ba1-4b9949bd0c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:31.120213 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23816-29e7-46f7-8ba1-4b9949bd0c86 admin admin] PATH_INFO: `/v3/projects/e93781b71b2e4565b32aabee57a906d9/users/50eb88a2bc4c4ca2923b3f85c353cdd8/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:31.139659 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada23816-29e7-46f7-8ba1-4b9949bd0c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93781b71b2e4565b32aabee57a906d9, user_id=50eb88a2bc4c4ca2923b3f85c353cdd8, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:31.142587 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada23816-29e7-46f7-8ba1-4b9949bd0c86 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:31.147288 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1274/2566] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:31.160228 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d17b0-22cb-4fc4-9d97-58cf564ceed7 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:31.161814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-283d17b0-22cb-4fc4-9d97-58cf564ceed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:31.165618 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1293/2567] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:31 2022] PUT /identity/v3/projects/e93781b71b2e4565b32aabee57a906d9/users/50eb88a2bc4c4ca2923b3f85c353cdd8/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:31.177954 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23658c6-bcf0-40cc-80dd-f44046136900 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:31.178273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23658c6-bcf0-40cc-80dd-f44046136900 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:31.178548 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23658c6-bcf0-40cc-80dd-f44046136900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:31.227842 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a23658c6-bcf0-40cc-80dd-f44046136900 None None] MFA Rules not processed for user `50eb88a2bc4c4ca2923b3f85c353cdd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:31.229201 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a23658c6-bcf0-40cc-80dd-f44046136900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:31.243770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d17b0-22cb-4fc4-9d97-58cf564ceed7 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:31.304874 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8b54b-cbb2-4358-b54b-fecd6bde2d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:31.305446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8b54b-cbb2-4358-b54b-fecd6bde2d77 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:31.305817 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8b54b-cbb2-4358-b54b-fecd6bde2d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:31.306139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8b54b-cbb2-4358-b54b-fecd6bde2d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:31.309424 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1294/2568] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:20:31.310908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee6cb5-a8b6-4ad4-818b-90d4faf95306 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:31.311280 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee6cb5-a8b6-4ad4-818b-90d4faf95306 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:31.311864 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee6cb5-a8b6-4ad4-818b-90d4faf95306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:31.333375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2bee6cb5-a8b6-4ad4-818b-90d4faf95306 None None] MFA Rules not processed for user `30c0516b85e74bdb829a3019e71e6ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:31.334779 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2bee6cb5-a8b6-4ad4-818b-90d4faf95306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:31.374564 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8b54b-cbb2-4358-b54b-fecd6bde2d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:31.376203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8b54b-cbb2-4358-b54b-fecd6bde2d77 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:31.387878 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1275/2569] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:31.388684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8b54b-cbb2-4358-b54b-fecd6bde2d77 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:31.395267 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1295/2570] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 12:20:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:31.398742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8b54b-cbb2-4358-b54b-fecd6bde2d77 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:31.405554 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcbb9a-3624-4352-baa9-674fb281b191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:31.406316 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcbb9a-3624-4352-baa9-674fb281b191 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:31.406600 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcbb9a-3624-4352-baa9-674fb281b191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:31.406871 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcbb9a-3624-4352-baa9-674fb281b191 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:31.407969 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcbb9a-3624-4352-baa9-674fb281b191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:31.412386 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee6cb5-a8b6-4ad4-818b-90d4faf95306 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:31.413249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcbb9a-3624-4352-baa9-674fb281b191 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:31.414362 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2bee6cb5-a8b6-4ad4-818b-90d4faf95306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:31.448287 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1276/2571] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:31 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:31.452367 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcbb9a-3624-4352-baa9-674fb281b191 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:31.470353 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:31.473620 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:31.506251 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee6cb5-a8b6-4ad4-818b-90d4faf95306 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:31.534760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcbb9a-3624-4352-baa9-674fb281b191 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:31.540788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef6036-6f88-44b1-9489-2a57d807e24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:31.541505 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef6036-6f88-44b1-9489-2a57d807e24c admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:31.541740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef6036-6f88-44b1-9489-2a57d807e24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:31.542025 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef6036-6f88-44b1-9489-2a57d807e24c admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:31.542721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef6036-6f88-44b1-9489-2a57d807e24c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:31.544622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef6036-6f88-44b1-9489-2a57d807e24c admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:31.569969 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1277/2572] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:31 2022] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:31.573667 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef6036-6f88-44b1-9489-2a57d807e24c admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:31.583592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bffb0-de22-4855-9163-0993b20ae766 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71de21b4b6d4971953f0c1ca92d9f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:31.584303 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bffb0-de22-4855-9163-0993b20ae766 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:31.584433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef6036-6f88-44b1-9489-2a57d807e24c admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:31.584636 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bffb0-de22-4855-9163-0993b20ae766 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:31.585085 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bffb0-de22-4855-9163-0993b20ae766 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:31.589871 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953214c-707d-486f-bbde-da54e3688892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:31.590664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953214c-707d-486f-bbde-da54e3688892 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:31.590960 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953214c-707d-486f-bbde-da54e3688892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:31.591258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953214c-707d-486f-bbde-da54e3688892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:31.592000 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953214c-707d-486f-bbde-da54e3688892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:31.593684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953214c-707d-486f-bbde-da54e3688892 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:31.609942 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1278/2573] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:31.610920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953214c-707d-486f-bbde-da54e3688892 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:31.621921 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953214c-707d-486f-bbde-da54e3688892 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:31.629702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a51afe-dec5-4802-9033-9252c17007c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:31.630946 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a51afe-dec5-4802-9033-9252c17007c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:31.631103 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a51afe-dec5-4802-9033-9252c17007c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:31.631411 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a51afe-dec5-4802-9033-9252c17007c7 admin admin] PATH_INFO: `/v3/projects/1c5865cd74c745d4bb9943bef916ad1e/users/2aa8508ec326444ca2f627fd60fd8120/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:31.648897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a51afe-dec5-4802-9033-9252c17007c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5865cd74c745d4bb9943bef916ad1e, user_id=2aa8508ec326444ca2f627fd60fd8120, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:31.651565 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bffb0-de22-4855-9163-0993b20ae766 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:31.652024 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a51afe-dec5-4802-9033-9252c17007c7 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:31.653158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bffb0-de22-4855-9163-0993b20ae766 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:31.663658 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1296/2574] 10.222.0.48 () {60 vars in 1384 bytes} [Mon Jul 25 12:20:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 12:20:31.669059 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1279/2575] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:31 2022] PUT /identity/v3/projects/1c5865cd74c745d4bb9943bef916ad1e/users/2aa8508ec326444ca2f627fd60fd8120/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:31.672781 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bffb0-de22-4855-9163-0993b20ae766 service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:31.684318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bffb0-de22-4855-9163-0993b20ae766 service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:31.787242 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec12e9b-e50f-444e-a0a8-663a9d12b61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:31.787926 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec12e9b-e50f-444e-a0a8-663a9d12b61c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:31.788265 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec12e9b-e50f-444e-a0a8-663a9d12b61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:31.788552 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec12e9b-e50f-444e-a0a8-663a9d12b61c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:31.789533 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec12e9b-e50f-444e-a0a8-663a9d12b61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:31.791374 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec12e9b-e50f-444e-a0a8-663a9d12b61c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:31.807279 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1297/2576] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:31.811094 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a51afe-dec5-4802-9033-9252c17007c7 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:31.825392 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a51afe-dec5-4802-9033-9252c17007c7 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:31.833975 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288981e-6677-4044-864f-e09c9569baa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:31.835178 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288981e-6677-4044-864f-e09c9569baa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:31.835523 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288981e-6677-4044-864f-e09c9569baa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:31.835948 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288981e-6677-4044-864f-e09c9569baa0 admin admin] PATH_INFO: `/v3/projects/1c5865cd74c745d4bb9943bef916ad1e/users/2aa8508ec326444ca2f627fd60fd8120/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:31.839744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288981e-6677-4044-864f-e09c9569baa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5865cd74c745d4bb9943bef916ad1e, user_id=2aa8508ec326444ca2f627fd60fd8120, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:31.843474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288981e-6677-4044-864f-e09c9569baa0 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:31.866027 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1280/2577] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:31 2022] PUT /identity/v3/projects/1c5865cd74c745d4bb9943bef916ad1e/users/2aa8508ec326444ca2f627fd60fd8120/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:31.876437 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab8eb8-a4a6-495d-a13f-e406d961b2af None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:31.876945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab8eb8-a4a6-495d-a13f-e406d961b2af None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:31.877830 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab8eb8-a4a6-495d-a13f-e406d961b2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:31.924827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f3ab8eb8-a4a6-495d-a13f-e406d961b2af None None] MFA Rules not processed for user `2aa8508ec326444ca2f627fd60fd8120`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:31.926155 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f3ab8eb8-a4a6-495d-a13f-e406d961b2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:31.940409 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:32.046037 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1298/2578] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:32.056402 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288981e-6677-4044-864f-e09c9569baa0 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:32.058722 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-0288981e-6677-4044-864f-e09c9569baa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:32.183387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288981e-6677-4044-864f-e09c9569baa0 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:32.190881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff939298-0074-4cd5-beb4-bf7a8de44bdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:32.191904 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff939298-0074-4cd5-beb4-bf7a8de44bdc service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:32.192391 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff939298-0074-4cd5-beb4-bf7a8de44bdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:32.192898 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff939298-0074-4cd5-beb4-bf7a8de44bdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:32.210264 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff939298-0074-4cd5-beb4-bf7a8de44bdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:32.215889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff939298-0074-4cd5-beb4-bf7a8de44bdc service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:32.254919 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1281/2579] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:32.311167 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b8088-e68a-476b-9234-448d7366440f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:32.311458 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b8088-e68a-476b-9234-448d7366440f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:32.311740 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b8088-e68a-476b-9234-448d7366440f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:32.396328 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-726b8088-e68a-476b-9234-448d7366440f None None] MFA Rules not processed for user `a5e33f9993f6423793f30a86b6958dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:32.397588 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-726b8088-e68a-476b-9234-448d7366440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:32.549294 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1299/2580] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:32.553543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff939298-0074-4cd5-beb4-bf7a8de44bdc service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:32.677299 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:32.683454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff939298-0074-4cd5-beb4-bf7a8de44bdc service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:32.690312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f84ad-4b12-4ac9-bfce-c53440606ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:32.691280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f84ad-4b12-4ac9-bfce-c53440606ffc admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:32.691792 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f84ad-4b12-4ac9-bfce-c53440606ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:32.692280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f84ad-4b12-4ac9-bfce-c53440606ffc admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:32.693334 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f84ad-4b12-4ac9-bfce-c53440606ffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:32.695394 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f84ad-4b12-4ac9-bfce-c53440606ffc admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:32.737241 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1282/2581] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:32 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:32.741305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b8088-e68a-476b-9234-448d7366440f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:32.763017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b8088-e68a-476b-9234-448d7366440f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:32.857237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680574e-de8b-4e30-9db0-d75257d4848c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:32.858013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680574e-de8b-4e30-9db0-d75257d4848c admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:32.858333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680574e-de8b-4e30-9db0-d75257d4848c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:32.858575 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680574e-de8b-4e30-9db0-d75257d4848c admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:32.859271 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680574e-de8b-4e30-9db0-d75257d4848c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:32.862585 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680574e-de8b-4e30-9db0-d75257d4848c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:32.892066 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1300/2582] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:32 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:32.893485 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f84ad-4b12-4ac9-bfce-c53440606ffc admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:32.908343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f84ad-4b12-4ac9-bfce-c53440606ffc admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:32.920255 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f4e6d-c1b7-4de1-b877-6056df04fc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:32.920972 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f4e6d-c1b7-4de1-b877-6056df04fc3d admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:32.921262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f4e6d-c1b7-4de1-b877-6056df04fc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:32.921636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f4e6d-c1b7-4de1-b877-6056df04fc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:32.931488 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f4e6d-c1b7-4de1-b877-6056df04fc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:32.934084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f4e6d-c1b7-4de1-b877-6056df04fc3d admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:32.966462 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1283/2583] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:32.966668 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680574e-de8b-4e30-9db0-d75257d4848c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:32.977608 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680574e-de8b-4e30-9db0-d75257d4848c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:32.983165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cef1ea-8314-48a9-86c2-60dd299028c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:32.984212 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cef1ea-8314-48a9-86c2-60dd299028c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:32.984505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cef1ea-8314-48a9-86c2-60dd299028c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:32.984629 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cef1ea-8314-48a9-86c2-60dd299028c2 admin admin] PATH_INFO: `/v3/projects/ccf08c8828da4164b7a2d76cd96f35c7/users/0ccf3ec33c92432a80519f7f41354f14/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:33.008746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cef1ea-8314-48a9-86c2-60dd299028c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf08c8828da4164b7a2d76cd96f35c7, user_id=0ccf3ec33c92432a80519f7f41354f14, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:33.012388 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cef1ea-8314-48a9-86c2-60dd299028c2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:33.036837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1301/2584] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:32 2022] PUT /identity/v3/projects/ccf08c8828da4164b7a2d76cd96f35c7/users/0ccf3ec33c92432a80519f7f41354f14/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:33.038691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f4e6d-c1b7-4de1-b877-6056df04fc3d admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:33.048360 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f4e6d-c1b7-4de1-b877-6056df04fc3d admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:33.136436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0352c-0249-4f64-9384-aabbca299f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:33.137571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0352c-0249-4f64-9384-aabbca299f1e admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:33.138440 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0352c-0249-4f64-9384-aabbca299f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:33.138947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0352c-0249-4f64-9384-aabbca299f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:33.140002 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0352c-0249-4f64-9384-aabbca299f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:33.141868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0352c-0249-4f64-9384-aabbca299f1e admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:33.166684 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1284/2585] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:33.167689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cef1ea-8314-48a9-86c2-60dd299028c2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:33.174828 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:33.182948 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cef1ea-8314-48a9-86c2-60dd299028c2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:33.190290 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd157078-4598-4f93-8aec-a8eae563ad80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:33.191201 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd157078-4598-4f93-8aec-a8eae563ad80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:33.192033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd157078-4598-4f93-8aec-a8eae563ad80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:33.192033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd157078-4598-4f93-8aec-a8eae563ad80 admin admin] PATH_INFO: `/v3/projects/ccf08c8828da4164b7a2d76cd96f35c7/users/0ccf3ec33c92432a80519f7f41354f14/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:33.193823 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd157078-4598-4f93-8aec-a8eae563ad80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf08c8828da4164b7a2d76cd96f35c7, user_id=0ccf3ec33c92432a80519f7f41354f14, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:33.196632 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd157078-4598-4f93-8aec-a8eae563ad80 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:33.216007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1302/2586] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:33 2022] PUT /identity/v3/projects/ccf08c8828da4164b7a2d76cd96f35c7/users/0ccf3ec33c92432a80519f7f41354f14/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:33.232692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0352c-0249-4f64-9384-aabbca299f1e admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:33.246696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0352c-0249-4f64-9384-aabbca299f1e admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:33.326393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f902a8d-b9b2-4c55-ab7d-54354186a7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:33.327407 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f902a8d-b9b2-4c55-ab7d-54354186a7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:33.327691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f902a8d-b9b2-4c55-ab7d-54354186a7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:33.327965 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f902a8d-b9b2-4c55-ab7d-54354186a7e7 admin admin] PATH_INFO: `/v3/users/50eb88a2bc4c4ca2923b3f85c353cdd8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:33.329503 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f902a8d-b9b2-4c55-ab7d-54354186a7e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50eb88a2bc4c4ca2923b3f85c353cdd8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:33.332336 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f902a8d-b9b2-4c55-ab7d-54354186a7e7 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:33.415353 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9f902a8d-b9b2-4c55-ab7d-54354186a7e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50eb88a2bc4c4ca2923b3f85c353cdd8'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:33.417135 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9f902a8d-b9b2-4c55-ab7d-54354186a7e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50eb88a2bc4c4ca2923b3f85c353cdd8'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:33.417135 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9f902a8d-b9b2-4c55-ab7d-54354186a7e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50eb88a2bc4c4ca2923b3f85c353cdd8'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:33.441039 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9f902a8d-b9b2-4c55-ab7d-54354186a7e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50eb88a2bc4c4ca2923b3f85c353cdd8'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:33.451697 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:33.455857 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9f902a8d-b9b2-4c55-ab7d-54354186a7e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50eb88a2bc4c4ca2923b3f85c353cdd8'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:33.486062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1285/2587] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:33 2022] DELETE /identity/v3/users/50eb88a2bc4c4ca2923b3f85c353cdd8 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:33.490240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b882d3-ecc2-4a83-9b4c-9d633cf7006c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:33.490819 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b882d3-ecc2-4a83-9b4c-9d633cf7006c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:33.491258 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b882d3-ecc2-4a83-9b4c-9d633cf7006c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:33.517439 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-94b882d3-ecc2-4a83-9b4c-9d633cf7006c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:33.520273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-94b882d3-ecc2-4a83-9b4c-9d633cf7006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:33.608259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1303/2588] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:33.622687 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f902a8d-b9b2-4c55-ab7d-54354186a7e7 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:33.624698 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-9f902a8d-b9b2-4c55-ab7d-54354186a7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:33.692783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f902a8d-b9b2-4c55-ab7d-54354186a7e7 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:33.697582 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e2d0b-80d7-454c-a088-6ed422727b38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:33.698496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e2d0b-80d7-454c-a088-6ed422727b38 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:33.698968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e2d0b-80d7-454c-a088-6ed422727b38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:33.699639 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e2d0b-80d7-454c-a088-6ed422727b38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:33.711607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e2d0b-80d7-454c-a088-6ed422727b38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:33.713137 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e2d0b-80d7-454c-a088-6ed422727b38 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:33.725697 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1286/2589] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:33.961251 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b882d3-ecc2-4a83-9b4c-9d633cf7006c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:33.962730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-94b882d3-ecc2-4a83-9b4c-9d633cf7006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:33.977251 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b882d3-ecc2-4a83-9b4c-9d633cf7006c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:33.983659 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba6a32-a872-4536-83df-bcb9e84af42a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:33.984850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba6a32-a872-4536-83df-bcb9e84af42a service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:33.984850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba6a32-a872-4536-83df-bcb9e84af42a service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:33.985067 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba6a32-a872-4536-83df-bcb9e84af42a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:33.987051 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-56ba6a32-a872-4536-83df-bcb9e84af42a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:34.005312 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba6a32-a872-4536-83df-bcb9e84af42a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:34.006998 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba6a32-a872-4536-83df-bcb9e84af42a service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:34.020365 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1304/2590] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:34.335626 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e2d0b-80d7-454c-a088-6ed422727b38 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:34.337099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c67e2d0b-80d7-454c-a088-6ed422727b38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:34.362318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e2d0b-80d7-454c-a088-6ed422727b38 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:34.376252 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539e97a-9b16-4e81-a50a-36558274b920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:34.379352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539e97a-9b16-4e81-a50a-36558274b920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:34.380011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539e97a-9b16-4e81-a50a-36558274b920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:34.380989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539e97a-9b16-4e81-a50a-36558274b920 admin admin] PATH_INFO: `/v3/projects/e93781b71b2e4565b32aabee57a906d9` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:34.385016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539e97a-9b16-4e81-a50a-36558274b920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93781b71b2e4565b32aabee57a906d9)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:34.388602 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539e97a-9b16-4e81-a50a-36558274b920 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:34.406766 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92724177-653e-49a4-9df0-1f98a11100e5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:34.407063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92724177-653e-49a4-9df0-1f98a11100e5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:34.407336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92724177-653e-49a4-9df0-1f98a11100e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:34.489324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-92724177-653e-49a4-9df0-1f98a11100e5 None None] MFA Rules not processed for user `0ccf3ec33c92432a80519f7f41354f14`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:34.494526 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-92724177-653e-49a4-9df0-1f98a11100e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:34.521357 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-0539e97a-9b16-4e81-a50a-36558274b920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93781b71b2e4565b32aabee57a906d9', 'request_id': 'req-0539e97a-9b16-4e81-a50a-36558274b920'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:34.556372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-0539e97a-9b16-4e81-a50a-36558274b920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93781b71b2e4565b32aabee57a906d9', 'request_id': 'req-0539e97a-9b16-4e81-a50a-36558274b920'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:34.565880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-0539e97a-9b16-4e81-a50a-36558274b920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93781b71b2e4565b32aabee57a906d9', 'request_id': 'req-0539e97a-9b16-4e81-a50a-36558274b920'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:34.580268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-0539e97a-9b16-4e81-a50a-36558274b920 admin admin] The token cache is being invalidate because project e93781b71b2e4565b32aabee57a906d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:34.580561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-0539e97a-9b16-4e81-a50a-36558274b920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:34.581354 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-0539e97a-9b16-4e81-a50a-36558274b920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:34.587117 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1287/2591] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:34 2022] DELETE /identity/v3/projects/e93781b71b2e4565b32aabee57a906d9 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:34.589082 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539e97a-9b16-4e81-a50a-36558274b920 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:34.590594 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-0539e97a-9b16-4e81-a50a-36558274b920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:34.680013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1305/2592] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:34.693090 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37f410-cc67-44e1-88af-82c14dc99c6d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:34.693452 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37f410-cc67-44e1-88af-82c14dc99c6d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:34.693652 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37f410-cc67-44e1-88af-82c14dc99c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:34.727983 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fb37f410-cc67-44e1-88af-82c14dc99c6d None None] MFA Rules not processed for user `a5e33f9993f6423793f30a86b6958dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:34.730029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fb37f410-cc67-44e1-88af-82c14dc99c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:34.754686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539e97a-9b16-4e81-a50a-36558274b920 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:34.767916 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc1c7b-bec8-4a8a-911d-33c728108b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:34.769321 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc1c7b-bec8-4a8a-911d-33c728108b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:34.771148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc1c7b-bec8-4a8a-911d-33c728108b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:34.771529 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc1c7b-bec8-4a8a-911d-33c728108b27 admin admin] PATH_INFO: `/v3/users/2aa8508ec326444ca2f627fd60fd8120` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:34.773956 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc1c7b-bec8-4a8a-911d-33c728108b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa8508ec326444ca2f627fd60fd8120)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:34.780489 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc1c7b-bec8-4a8a-911d-33c728108b27 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:34.826510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:34.858808 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1306/2593] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:20:34.871022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37f410-cc67-44e1-88af-82c14dc99c6d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:34.873270 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fb37f410-cc67-44e1-88af-82c14dc99c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:34.880958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b7dc1c7b-bec8-4a8a-911d-33c728108b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa8508ec326444ca2f627fd60fd8120'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:34.881899 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b7dc1c7b-bec8-4a8a-911d-33c728108b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa8508ec326444ca2f627fd60fd8120'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:34.882838 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b7dc1c7b-bec8-4a8a-911d-33c728108b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa8508ec326444ca2f627fd60fd8120'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:34.888633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:34.906064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b7dc1c7b-bec8-4a8a-911d-33c728108b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa8508ec326444ca2f627fd60fd8120'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:34.925043 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b7dc1c7b-bec8-4a8a-911d-33c728108b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa8508ec326444ca2f627fd60fd8120'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:34.948394 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1288/2594] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:34 2022] DELETE /identity/v3/users/2aa8508ec326444ca2f627fd60fd8120 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:35.037126 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37f410-cc67-44e1-88af-82c14dc99c6d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:35.169495 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cce50-ed9c-4fbb-bab5-ef52f88ca35c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:35.170222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cce50-ed9c-4fbb-bab5-ef52f88ca35c service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:35.170673 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cce50-ed9c-4fbb-bab5-ef52f88ca35c service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:35.171041 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cce50-ed9c-4fbb-bab5-ef52f88ca35c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:35.173634 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bb3cce50-ed9c-4fbb-bab5-ef52f88ca35c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:35.276052 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cce50-ed9c-4fbb-bab5-ef52f88ca35c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:35.277620 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cce50-ed9c-4fbb-bab5-ef52f88ca35c service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:35.289038 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1307/2595] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:20:35.423037 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc1c7b-bec8-4a8a-911d-33c728108b27 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:35.425865 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b7dc1c7b-bec8-4a8a-911d-33c728108b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:35.530734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc1c7b-bec8-4a8a-911d-33c728108b27 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:35.537337 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e50c50-93cf-4549-8c51-66ebbc525a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:35.538487 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e50c50-93cf-4549-8c51-66ebbc525a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:35.538933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e50c50-93cf-4549-8c51-66ebbc525a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:35.539369 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e50c50-93cf-4549-8c51-66ebbc525a1b admin admin] PATH_INFO: `/v3/projects/1c5865cd74c745d4bb9943bef916ad1e` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:35.540839 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e50c50-93cf-4549-8c51-66ebbc525a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5865cd74c745d4bb9943bef916ad1e)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:35.542974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e50c50-93cf-4549-8c51-66ebbc525a1b admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:35.621971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-21e50c50-93cf-4549-8c51-66ebbc525a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5865cd74c745d4bb9943bef916ad1e', 'request_id': 'req-21e50c50-93cf-4549-8c51-66ebbc525a1b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:35.638464 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-21e50c50-93cf-4549-8c51-66ebbc525a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5865cd74c745d4bb9943bef916ad1e', 'request_id': 'req-21e50c50-93cf-4549-8c51-66ebbc525a1b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:35.649343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-21e50c50-93cf-4549-8c51-66ebbc525a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5865cd74c745d4bb9943bef916ad1e', 'request_id': 'req-21e50c50-93cf-4549-8c51-66ebbc525a1b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:35.663637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-21e50c50-93cf-4549-8c51-66ebbc525a1b admin admin] The token cache is being invalidate because project 1c5865cd74c745d4bb9943bef916ad1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:35.663989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-21e50c50-93cf-4549-8c51-66ebbc525a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:35.664936 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-21e50c50-93cf-4549-8c51-66ebbc525a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:35.666556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1289/2596] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:35 2022] DELETE /identity/v3/projects/1c5865cd74c745d4bb9943bef916ad1e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:35.865401 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cce50-ed9c-4fbb-bab5-ef52f88ca35c service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:35.866773 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bb3cce50-ed9c-4fbb-bab5-ef52f88ca35c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:35.972815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:35.999508 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cce50-ed9c-4fbb-bab5-ef52f88ca35c service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:36.106237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b75d7-702e-4144-974d-7605304a2eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:36.106901 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b75d7-702e-4144-974d-7605304a2eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:36.107189 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b75d7-702e-4144-974d-7605304a2eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:36.107618 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b75d7-702e-4144-974d-7605304a2eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:36.109596 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ad9b75d7-702e-4144-974d-7605304a2eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:36.120309 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b75d7-702e-4144-974d-7605304a2eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:36.121753 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b75d7-702e-4144-974d-7605304a2eb1 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:36.132241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1308/2597] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:36.878662 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e50c50-93cf-4549-8c51-66ebbc525a1b admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:36.880300 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-21e50c50-93cf-4549-8c51-66ebbc525a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:36.910686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:36.994699 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e50c50-93cf-4549-8c51-66ebbc525a1b admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:36.999929 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60c4c3-81bf-43e3-b1a3-4ee6b497306a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f748b0f6b1433c87012793f0dda307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:37.000595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60c4c3-81bf-43e3-b1a3-4ee6b497306a service placement] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:37.000882 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60c4c3-81bf-43e3-b1a3-4ee6b497306a service placement] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:37.001156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60c4c3-81bf-43e3-b1a3-4ee6b497306a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:37.003678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-bb60c4c3-81bf-43e3-b1a3-4ee6b497306a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:37.016872 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60c4c3-81bf-43e3-b1a3-4ee6b497306a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:37.018612 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60c4c3-81bf-43e3-b1a3-4ee6b497306a service placement] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:37.029337 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1290/2598] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:39.097320 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b75d7-702e-4144-974d-7605304a2eb1 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:39.098916 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ad9b75d7-702e-4144-974d-7605304a2eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:39.236033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b75d7-702e-4144-974d-7605304a2eb1 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:39.249198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9847c92-491e-41b7-9f43-ae775c0c51df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:39.250997 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9847c92-491e-41b7-9f43-ae775c0c51df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:39.251337 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9847c92-491e-41b7-9f43-ae775c0c51df admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:39.251692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9847c92-491e-41b7-9f43-ae775c0c51df admin admin] PATH_INFO: `/v3/users/0dd62c26ee6a438495abdc3ca489b85e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:39.253629 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9847c92-491e-41b7-9f43-ae775c0c51df admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd62c26ee6a438495abdc3ca489b85e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:39.256524 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9847c92-491e-41b7-9f43-ae775c0c51df admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:39.343547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9847c92-491e-41b7-9f43-ae775c0c51df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd62c26ee6a438495abdc3ca489b85e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:39.345496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9847c92-491e-41b7-9f43-ae775c0c51df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd62c26ee6a438495abdc3ca489b85e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:39.347184 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9847c92-491e-41b7-9f43-ae775c0c51df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd62c26ee6a438495abdc3ca489b85e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:39.363623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9847c92-491e-41b7-9f43-ae775c0c51df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd62c26ee6a438495abdc3ca489b85e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:39.376757 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9847c92-491e-41b7-9f43-ae775c0c51df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd62c26ee6a438495abdc3ca489b85e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:39.394061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1309/2599] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:39 2022] DELETE /identity/v3/users/0dd62c26ee6a438495abdc3ca489b85e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:39.545016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60c4c3-81bf-43e3-b1a3-4ee6b497306a service placement] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:39.546483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-bb60c4c3-81bf-43e3-b1a3-4ee6b497306a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:39.579732 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60c4c3-81bf-43e3-b1a3-4ee6b497306a service placement] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:39.595702 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9847c92-491e-41b7-9f43-ae775c0c51df admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:39.598136 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f9847c92-491e-41b7-9f43-ae775c0c51df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:39.633097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:39.678291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87eefc-5c58-4e0f-b678-4f7b8f372b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:39.679012 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87eefc-5c58-4e0f-b678-4f7b8f372b86 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:39.679227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87eefc-5c58-4e0f-b678-4f7b8f372b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:39.679537 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87eefc-5c58-4e0f-b678-4f7b8f372b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:39.681305 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-2e87eefc-5c58-4e0f-b678-4f7b8f372b86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:39.692316 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87eefc-5c58-4e0f-b678-4f7b8f372b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:39.692577 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9847c92-491e-41b7-9f43-ae775c0c51df admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:39.692770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87eefc-5c58-4e0f-b678-4f7b8f372b86 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:39.698663 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c3be8-7ea9-426b-a59f-9a8e4bb5f12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:39.699666 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c3be8-7ea9-426b-a59f-9a8e4bb5f12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:39.700062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c3be8-7ea9-426b-a59f-9a8e4bb5f12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:39.700435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c3be8-7ea9-426b-a59f-9a8e4bb5f12e admin admin] PATH_INFO: `/v3/projects/5ba69184111e41228067740300c97d28` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:39.701947 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c3be8-7ea9-426b-a59f-9a8e4bb5f12e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ba69184111e41228067740300c97d28)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:39.704153 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c3be8-7ea9-426b-a59f-9a8e4bb5f12e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:39.707448 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1291/2600] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:39.796355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5b7c3be8-7ea9-426b-a59f-9a8e4bb5f12e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ba69184111e41228067740300c97d28', 'request_id': 'req-5b7c3be8-7ea9-426b-a59f-9a8e4bb5f12e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:39.803382 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5b7c3be8-7ea9-426b-a59f-9a8e4bb5f12e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ba69184111e41228067740300c97d28', 'request_id': 'req-5b7c3be8-7ea9-426b-a59f-9a8e4bb5f12e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:39.810302 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5b7c3be8-7ea9-426b-a59f-9a8e4bb5f12e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ba69184111e41228067740300c97d28', 'request_id': 'req-5b7c3be8-7ea9-426b-a59f-9a8e4bb5f12e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:39.827909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5b7c3be8-7ea9-426b-a59f-9a8e4bb5f12e admin admin] The token cache is being invalidate because project 5ba69184111e41228067740300c97d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:39.828198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5b7c3be8-7ea9-426b-a59f-9a8e4bb5f12e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:39.828854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5b7c3be8-7ea9-426b-a59f-9a8e4bb5f12e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:39.838455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1310/2601] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:39 2022] DELETE /identity/v3/projects/5ba69184111e41228067740300c97d28 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:39.842546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebab43-c8ed-4b01-bd8c-b7c12300adf2 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:39.843152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebab43-c8ed-4b01-bd8c-b7c12300adf2 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:39.843718 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebab43-c8ed-4b01-bd8c-b7c12300adf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:39.879125 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-fdebab43-c8ed-4b01-bd8c-b7c12300adf2 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:39.880157 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-fdebab43-c8ed-4b01-bd8c-b7c12300adf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:40.002830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1292/2602] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:40.011884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bb031-7209-4979-b4f5-180e25c4bcdd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:40.012243 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bb031-7209-4979-b4f5-180e25c4bcdd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:40.012592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bb031-7209-4979-b4f5-180e25c4bcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:40.042504 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b65bb031-7209-4979-b4f5-180e25c4bcdd None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:40.043834 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b65bb031-7209-4979-b4f5-180e25c4bcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:40.053277 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1311/2603] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:40.057860 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebab43-c8ed-4b01-bd8c-b7c12300adf2 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:40.085708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebab43-c8ed-4b01-bd8c-b7c12300adf2 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:40.085708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b695a8c-6aa8-49a7-817a-48a908e88cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:40.085708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b695a8c-6aa8-49a7-817a-48a908e88cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:40.085708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b695a8c-6aa8-49a7-817a-48a908e88cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:40.086244 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b695a8c-6aa8-49a7-817a-48a908e88cdb admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:40.086244 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b695a8c-6aa8-49a7-817a-48a908e88cdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:20:40.086244 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b695a8c-6aa8-49a7-817a-48a908e88cdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:40.086500 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b695a8c-6aa8-49a7-817a-48a908e88cdb admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:40.106647 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bb031-7209-4979-b4f5-180e25c4bcdd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:40.112345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1293/2604] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:20:40.120750 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bb031-7209-4979-b4f5-180e25c4bcdd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:40.126919 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4da88-c285-483b-90cb-a6694928b804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:40.128454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4da88-c285-483b-90cb-a6694928b804 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:40.128915 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4da88-c285-483b-90cb-a6694928b804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:40.129285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4da88-c285-483b-90cb-a6694928b804 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:40.130155 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4da88-c285-483b-90cb-a6694928b804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:40.132610 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4da88-c285-483b-90cb-a6694928b804 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:40.173521 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1312/2605] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:40 2022] POST /identity/v3/projects => generated 367 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:40.175452 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b695a8c-6aa8-49a7-817a-48a908e88cdb admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:40.191436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b695a8c-6aa8-49a7-817a-48a908e88cdb admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:40.238598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:40.261448 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b948896-b092-4da8-94ea-138447e292d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:40.262573 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b948896-b092-4da8-94ea-138447e292d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:40.262573 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b948896-b092-4da8-94ea-138447e292d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:40.262934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b948896-b092-4da8-94ea-138447e292d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:40.263486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b948896-b092-4da8-94ea-138447e292d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:40.265847 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b948896-b092-4da8-94ea-138447e292d0 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:40.294686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1294/2606] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:40 2022] POST /identity/v3/users => generated 284 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:20:40.298752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4da88-c285-483b-90cb-a6694928b804 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:40.311414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4da88-c285-483b-90cb-a6694928b804 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:40.321001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a08fa-5883-4fee-ab88-5996df13e316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:40.322051 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a08fa-5883-4fee-ab88-5996df13e316 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:40.322452 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a08fa-5883-4fee-ab88-5996df13e316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:40.322820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a08fa-5883-4fee-ab88-5996df13e316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:40.323868 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a08fa-5883-4fee-ab88-5996df13e316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:40.325796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a08fa-5883-4fee-ab88-5996df13e316 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:40.342688 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1313/2607] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:40.343395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b948896-b092-4da8-94ea-138447e292d0 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:40.362483 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b948896-b092-4da8-94ea-138447e292d0 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:40.380915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd7762-f28c-413e-a69b-5d2bceaf0032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:40.381609 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd7762-f28c-413e-a69b-5d2bceaf0032 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:40.382480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd7762-f28c-413e-a69b-5d2bceaf0032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:40.382480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd7762-f28c-413e-a69b-5d2bceaf0032 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:40.383392 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd7762-f28c-413e-a69b-5d2bceaf0032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:40.385732 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd7762-f28c-413e-a69b-5d2bceaf0032 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:40.402826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1295/2608] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:40.404649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a08fa-5883-4fee-ab88-5996df13e316 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:40.421023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a08fa-5883-4fee-ab88-5996df13e316 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:40.434826 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623a225-1d14-403f-9fdf-d00ef39b8f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:40.435933 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623a225-1d14-403f-9fdf-d00ef39b8f66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:40.436315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623a225-1d14-403f-9fdf-d00ef39b8f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:40.436688 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623a225-1d14-403f-9fdf-d00ef39b8f66 admin admin] PATH_INFO: `/v3/projects/a45195ea567d4cffb442541c749272f6/users/bf39e4a14ff7414ab069c0c0b4228b17/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:40.461835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623a225-1d14-403f-9fdf-d00ef39b8f66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45195ea567d4cffb442541c749272f6, user_id=bf39e4a14ff7414ab069c0c0b4228b17, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:40.464471 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623a225-1d14-403f-9fdf-d00ef39b8f66 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:40.496107 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1314/2609] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:40 2022] PUT /identity/v3/projects/a45195ea567d4cffb442541c749272f6/users/bf39e4a14ff7414ab069c0c0b4228b17/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:40.506742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f648f-4521-436f-81cf-32fdb90929a9 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:40.507122 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f648f-4521-436f-81cf-32fdb90929a9 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:40.507318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f648f-4521-436f-81cf-32fdb90929a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:40.554378 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-6f5f648f-4521-436f-81cf-32fdb90929a9 None None] MFA Rules not processed for user `bf39e4a14ff7414ab069c0c0b4228b17`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:40.558305 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6f5f648f-4521-436f-81cf-32fdb90929a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:40.645091 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1296/2610] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:40.654965 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623a225-1d14-403f-9fdf-d00ef39b8f66 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:40.656785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f623a225-1d14-403f-9fdf-d00ef39b8f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:40.773474 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:40.779209 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623a225-1d14-403f-9fdf-d00ef39b8f66 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:40.785488 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abd41f-73aa-4c09-bf83-951ec0fcd9ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:40.786190 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abd41f-73aa-4c09-bf83-951ec0fcd9ca service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:40.786584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abd41f-73aa-4c09-bf83-951ec0fcd9ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:40.786986 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abd41f-73aa-4c09-bf83-951ec0fcd9ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:40.801928 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abd41f-73aa-4c09-bf83-951ec0fcd9ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:40.803553 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abd41f-73aa-4c09-bf83-951ec0fcd9ca service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:40.825020 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1315/2611] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:45.788665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f648f-4521-436f-81cf-32fdb90929a9 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:45.791783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6f5f648f-4521-436f-81cf-32fdb90929a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:45.872847 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f648f-4521-436f-81cf-32fdb90929a9 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:45.878707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b318c62-eba0-4aa5-90a9-41489bcca804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:45.881065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b318c62-eba0-4aa5-90a9-41489bcca804 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:45.881357 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b318c62-eba0-4aa5-90a9-41489bcca804 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:45.881823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b318c62-eba0-4aa5-90a9-41489bcca804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:45.884486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-8b318c62-eba0-4aa5-90a9-41489bcca804 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:45.906854 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b318c62-eba0-4aa5-90a9-41489bcca804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:45.909132 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b318c62-eba0-4aa5-90a9-41489bcca804 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:45.922386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1297/2612] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:48.485364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d711365-8d37-4a58-93f9-4bc917b2ae77 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:48.485873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d711365-8d37-4a58-93f9-4bc917b2ae77 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:48.485965 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d711365-8d37-4a58-93f9-4bc917b2ae77 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:48.487547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1316/2613] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 12:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:20:48.493971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8bb23-3ce4-4dcd-b578-b94016dba25d None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:48.495102 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8bb23-3ce4-4dcd-b578-b94016dba25d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:48.495590 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8bb23-3ce4-4dcd-b578-b94016dba25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:48.522187 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-bbf8bb23-3ce4-4dcd-b578-b94016dba25d None None] MFA Rules not processed for user `6d9db26891a04b0bb7e655c21feeffdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:48.523441 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-bbf8bb23-3ce4-4dcd-b578-b94016dba25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:48.534168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1298/2614] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:20:48.549318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d711365-8d37-4a58-93f9-4bc917b2ae77 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:48.551422 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3d711365-8d37-4a58-93f9-4bc917b2ae77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:48.625389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d711365-8d37-4a58-93f9-4bc917b2ae77 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:48.630827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea415f-3e9b-4a5e-bc7f-e108a1a3d9ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52ff8138094d64bce9de60c819ab4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:48.631727 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea415f-3e9b-4a5e-bc7f-e108a1a3d9ff service glance] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:48.631860 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea415f-3e9b-4a5e-bc7f-e108a1a3d9ff service glance] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:48.632032 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea415f-3e9b-4a5e-bc7f-e108a1a3d9ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:48.645297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea415f-3e9b-4a5e-bc7f-e108a1a3d9ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:48.646786 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea415f-3e9b-4a5e-bc7f-e108a1a3d9ff service glance] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:48.660367 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1317/2615] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:48.740727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af7101-66b8-41f8-a0c9-d2078e61c6af None None] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:48.741013 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af7101-66b8-41f8-a0c9-d2078e61c6af None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:48.741308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af7101-66b8-41f8-a0c9-d2078e61c6af None None] PATH_INFO: `/` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:48.742976 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1299/2616] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 12:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:20:48.748046 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67c78a-80fc-44a1-8185-8ce5cb4b3835 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:48.748413 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67c78a-80fc-44a1-8185-8ce5cb4b3835 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:48.748695 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67c78a-80fc-44a1-8185-8ce5cb4b3835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:48.769549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6f67c78a-80fc-44a1-8185-8ce5cb4b3835 None None] MFA Rules not processed for user `fbc9fad7089b4c95ac92e846d46cb5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:48.770781 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6f67c78a-80fc-44a1-8185-8ce5cb4b3835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:48.827168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1318/2617] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:48.840230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af7101-66b8-41f8-a0c9-d2078e61c6af None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:48.842014 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c8af7101-66b8-41f8-a0c9-d2078e61c6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:48.855706 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af7101-66b8-41f8-a0c9-d2078e61c6af None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:48.859285 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed1564-3e79-4870-ab06-6ae71e5644f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:48.859921 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed1564-3e79-4870-ab06-6ae71e5644f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:48.860201 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed1564-3e79-4870-ab06-6ae71e5644f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:48.860473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed1564-3e79-4870-ab06-6ae71e5644f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:48.868087 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed1564-3e79-4870-ab06-6ae71e5644f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:48.869521 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed1564-3e79-4870-ab06-6ae71e5644f6 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:48.877934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1300/2618] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:20:48.966028 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51fc79-98c6-444a-b89c-3d096ec36ea2 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:48.966431 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51fc79-98c6-444a-b89c-3d096ec36ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:48.966774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51fc79-98c6-444a-b89c-3d096ec36ea2 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:48.968225 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1319/2619] 10.222.0.48 () {54 vars in 921 bytes} [Mon Jul 25 12:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:20:48.975679 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40e5e6-cc33-4555-97f0-6bf00de48b5b None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:48.975972 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40e5e6-cc33-4555-97f0-6bf00de48b5b None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:48.976248 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40e5e6-cc33-4555-97f0-6bf00de48b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:48.995912 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-ae40e5e6-cc33-4555-97f0-6bf00de48b5b None None] MFA Rules not processed for user `6d9db26891a04b0bb7e655c21feeffdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:48.997115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ae40e5e6-cc33-4555-97f0-6bf00de48b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:49.007543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1301/2620] 10.222.0.48 () {58 vars in 1018 bytes} [Mon Jul 25 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:49.018216 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51fc79-98c6-444a-b89c-3d096ec36ea2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:49.030627 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51fc79-98c6-444a-b89c-3d096ec36ea2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:49.034607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3f18b-59d2-439b-b797-d80077666102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:49.034976 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3f18b-59d2-439b-b797-d80077666102 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:49.035258 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3f18b-59d2-439b-b797-d80077666102 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:49.035537 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3f18b-59d2-439b-b797-d80077666102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:49.047277 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3f18b-59d2-439b-b797-d80077666102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:49.048724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3f18b-59d2-439b-b797-d80077666102 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:49.062153 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1320/2621] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:49.650141 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40e5e6-cc33-4555-97f0-6bf00de48b5b None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:49.661643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:49.721073 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40e5e6-cc33-4555-97f0-6bf00de48b5b None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:49.726604 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bc10f-0d6d-4531-b910-a3233644d02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:49.727724 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bc10f-0d6d-4531-b910-a3233644d02b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:49.728071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bc10f-0d6d-4531-b910-a3233644d02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:49.728933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bc10f-0d6d-4531-b910-a3233644d02b admin admin] PATH_INFO: `/v3/users/bf39e4a14ff7414ab069c0c0b4228b17` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:49.730241 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bc10f-0d6d-4531-b910-a3233644d02b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf39e4a14ff7414ab069c0c0b4228b17)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:49.732210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bc10f-0d6d-4531-b910-a3233644d02b admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:49.782367 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-119bc10f-0d6d-4531-b910-a3233644d02b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf39e4a14ff7414ab069c0c0b4228b17'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:49.783023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-119bc10f-0d6d-4531-b910-a3233644d02b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf39e4a14ff7414ab069c0c0b4228b17'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:49.783662 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-119bc10f-0d6d-4531-b910-a3233644d02b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf39e4a14ff7414ab069c0c0b4228b17'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:49.796639 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-119bc10f-0d6d-4531-b910-a3233644d02b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf39e4a14ff7414ab069c0c0b4228b17'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:49.803484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-119bc10f-0d6d-4531-b910-a3233644d02b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf39e4a14ff7414ab069c0c0b4228b17'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:49.818153 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1302/2622] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:49 2022] DELETE /identity/v3/users/bf39e4a14ff7414ab069c0c0b4228b17 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:49.822890 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560ffef-6a5e-4eb6-a86c-81d6ec1d5654 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:49.823356 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560ffef-6a5e-4eb6-a86c-81d6ec1d5654 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:49.823469 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560ffef-6a5e-4eb6-a86c-81d6ec1d5654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:49.843140 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d560ffef-6a5e-4eb6-a86c-81d6ec1d5654 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:49.844412 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d560ffef-6a5e-4eb6-a86c-81d6ec1d5654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:49.902640 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1321/2623] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:20:49.913914 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bc10f-0d6d-4531-b910-a3233644d02b admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:49.915379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-119bc10f-0d6d-4531-b910-a3233644d02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:49.975016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bc10f-0d6d-4531-b910-a3233644d02b admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:49.978695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08798dcd-7ffb-459e-8df1-3bba0ab8c0d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:49.979289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08798dcd-7ffb-459e-8df1-3bba0ab8c0d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:49.979571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08798dcd-7ffb-459e-8df1-3bba0ab8c0d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:49.979845 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08798dcd-7ffb-459e-8df1-3bba0ab8c0d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:49.989210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08798dcd-7ffb-459e-8df1-3bba0ab8c0d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:49.990672 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08798dcd-7ffb-459e-8df1-3bba0ab8c0d2 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:50.000152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1303/2624] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:50.418224 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560ffef-6a5e-4eb6-a86c-81d6ec1d5654 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:50.420175 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d560ffef-6a5e-4eb6-a86c-81d6ec1d5654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:50.435975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560ffef-6a5e-4eb6-a86c-81d6ec1d5654 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:50.450364 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02627b51-e3e4-4e7d-af7b-09844ba86685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:50.454450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02627b51-e3e4-4e7d-af7b-09844ba86685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:50.454810 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02627b51-e3e4-4e7d-af7b-09844ba86685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:50.455165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02627b51-e3e4-4e7d-af7b-09844ba86685 admin admin] PATH_INFO: `/v3/projects/a45195ea567d4cffb442541c749272f6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:50.456668 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02627b51-e3e4-4e7d-af7b-09844ba86685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45195ea567d4cffb442541c749272f6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:50.458866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02627b51-e3e4-4e7d-af7b-09844ba86685 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:50.494381 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:50.526988 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-02627b51-e3e4-4e7d-af7b-09844ba86685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45195ea567d4cffb442541c749272f6', 'request_id': 'req-02627b51-e3e4-4e7d-af7b-09844ba86685'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:50.533534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-02627b51-e3e4-4e7d-af7b-09844ba86685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45195ea567d4cffb442541c749272f6', 'request_id': 'req-02627b51-e3e4-4e7d-af7b-09844ba86685'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:50.540886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-02627b51-e3e4-4e7d-af7b-09844ba86685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45195ea567d4cffb442541c749272f6', 'request_id': 'req-02627b51-e3e4-4e7d-af7b-09844ba86685'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:50.554662 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-02627b51-e3e4-4e7d-af7b-09844ba86685 admin admin] The token cache is being invalidate because project a45195ea567d4cffb442541c749272f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:50.555043 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-02627b51-e3e4-4e7d-af7b-09844ba86685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:50.555580 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-02627b51-e3e4-4e7d-af7b-09844ba86685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:50.557811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1322/2625] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:50 2022] DELETE /identity/v3/projects/a45195ea567d4cffb442541c749272f6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:50.563001 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5bab8-5880-4e9d-88ed-1ebd9cb97b0f None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:50.563298 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5bab8-5880-4e9d-88ed-1ebd9cb97b0f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:50.563576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5bab8-5880-4e9d-88ed-1ebd9cb97b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:50.589245 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02627b51-e3e4-4e7d-af7b-09844ba86685 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:50.590765 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-02627b51-e3e4-4e7d-af7b-09844ba86685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:50.603253 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-2ad5bab8-5880-4e9d-88ed-1ebd9cb97b0f None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:50.604461 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-2ad5bab8-5880-4e9d-88ed-1ebd9cb97b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:50.641063 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:50.660998 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02627b51-e3e4-4e7d-af7b-09844ba86685 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:50.664766 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f81a9-460a-4b38-9b2e-d45ce5bee057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:50.665418 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f81a9-460a-4b38-9b2e-d45ce5bee057 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:50.665709 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f81a9-460a-4b38-9b2e-d45ce5bee057 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:50.666179 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f81a9-460a-4b38-9b2e-d45ce5bee057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:50.668242 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8f7f81a9-460a-4b38-9b2e-d45ce5bee057 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:50.679580 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1304/2626] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:50.687589 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b1abf-e9f8-405a-a7c4-698dc3dc37ce None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:50.687883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b1abf-e9f8-405a-a7c4-698dc3dc37ce None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:50.688165 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b1abf-e9f8-405a-a7c4-698dc3dc37ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:50.708425 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-d85b1abf-e9f8-405a-a7c4-698dc3dc37ce None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:50.709643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d85b1abf-e9f8-405a-a7c4-698dc3dc37ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:50.717890 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1305/2627] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:50.722736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b1abf-e9f8-405a-a7c4-698dc3dc37ce None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:50.732279 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b1abf-e9f8-405a-a7c4-698dc3dc37ce None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:50.737013 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e21d1-16c7-4c7e-be30-aaa74793f2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:50.738607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e21d1-16c7-4c7e-be30-aaa74793f2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:50.739043 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e21d1-16c7-4c7e-be30-aaa74793f2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:50.739442 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e21d1-16c7-4c7e-be30-aaa74793f2b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:50.740020 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f81a9-460a-4b38-9b2e-d45ce5bee057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:50.740501 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e21d1-16c7-4c7e-be30-aaa74793f2b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:20:50.741109 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e21d1-16c7-4c7e-be30-aaa74793f2b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:50.741824 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f81a9-460a-4b38-9b2e-d45ce5bee057 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:50.743016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e21d1-16c7-4c7e-be30-aaa74793f2b0 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:50.752358 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1323/2628] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:50 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:20:50.760254 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1306/2629] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:20:50.761356 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f81a9-460a-4b38-9b2e-d45ce5bee057 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:50.775314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f81a9-460a-4b38-9b2e-d45ce5bee057 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:50.780006 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bd492-b3da-4754-9025-df538dadff4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:50.780714 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bd492-b3da-4754-9025-df538dadff4f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:50.780940 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bd492-b3da-4754-9025-df538dadff4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:50.781220 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bd492-b3da-4754-9025-df538dadff4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:50.781918 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106bd492-b3da-4754-9025-df538dadff4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:50.783864 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106bd492-b3da-4754-9025-df538dadff4f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:50.807536 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac096a-55f2-4343-b38a-e9228566fad9 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:50.807953 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac096a-55f2-4343-b38a-e9228566fad9 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:50.808139 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac096a-55f2-4343-b38a-e9228566fad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:50.825952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1324/2630] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:50 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:20:50.827722 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bd492-b3da-4754-9025-df538dadff4f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:50.832647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-7cac096a-55f2-4343-b38a-e9228566fad9 None None] MFA Rules not processed for user `30c0516b85e74bdb829a3019e71e6ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:50.833865 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-7cac096a-55f2-4343-b38a-e9228566fad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:50.882973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:50.905858 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bd492-b3da-4754-9025-df538dadff4f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:50.912053 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1307/2631] 10.222.0.48 () {58 vars in 1009 bytes} [Mon Jul 25 12:20:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:20:50.917115 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc078eb1-bdcd-43aa-b3f1-adae83d21402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:50.918493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc078eb1-bdcd-43aa-b3f1-adae83d21402 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:50.919237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc078eb1-bdcd-43aa-b3f1-adae83d21402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:50.919237 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc078eb1-bdcd-43aa-b3f1-adae83d21402 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:50.920168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc078eb1-bdcd-43aa-b3f1-adae83d21402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:50.922665 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc078eb1-bdcd-43aa-b3f1-adae83d21402 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:50.924065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac096a-55f2-4343-b38a-e9228566fad9 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:50.926055 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-7cac096a-55f2-4343-b38a-e9228566fad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:50.950674 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1325/2632] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:50 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:50.954855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc078eb1-bdcd-43aa-b3f1-adae83d21402 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:50.967123 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc078eb1-bdcd-43aa-b3f1-adae83d21402 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:50.973372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a83461-4b65-445a-9858-a81362216509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:50.974166 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a83461-4b65-445a-9858-a81362216509 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:50.974517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a83461-4b65-445a-9858-a81362216509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:50.974856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a83461-4b65-445a-9858-a81362216509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:50.975692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a83461-4b65-445a-9858-a81362216509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:50.977531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a83461-4b65-445a-9858-a81362216509 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:50.989961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1326/2633] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:20:50.993838 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a83461-4b65-445a-9858-a81362216509 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:51.009709 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a83461-4b65-445a-9858-a81362216509 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:51.016100 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a3c3f-bbf4-4698-8f7c-96dfe803c209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:51.016287 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a3c3f-bbf4-4698-8f7c-96dfe803c209 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:51.016636 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a3c3f-bbf4-4698-8f7c-96dfe803c209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:51.016916 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a3c3f-bbf4-4698-8f7c-96dfe803c209 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:51.017645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a3c3f-bbf4-4698-8f7c-96dfe803c209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:51.018163 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac096a-55f2-4343-b38a-e9228566fad9 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:51.019319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a3c3f-bbf4-4698-8f7c-96dfe803c209 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:51.024111 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2757d-5dfd-4026-8d17-c9b1613c6eca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71de21b4b6d4971953f0c1ca92d9f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:51.024943 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2757d-5dfd-4026-8d17-c9b1613c6eca service swift] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:51.025368 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2757d-5dfd-4026-8d17-c9b1613c6eca service swift] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:51.025705 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2757d-5dfd-4026-8d17-c9b1613c6eca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:51.031734 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1327/2634] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:20:51.036534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a3c3f-bbf4-4698-8f7c-96dfe803c209 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:51.038876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2757d-5dfd-4026-8d17-c9b1613c6eca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:51.041036 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2757d-5dfd-4026-8d17-c9b1613c6eca service swift] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:51.051663 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a3c3f-bbf4-4698-8f7c-96dfe803c209 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:51.051832 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1308/2635] 10.222.0.48 () {60 vars in 1384 bytes} [Mon Jul 25 12:20:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 12:20:51.058080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc44c0a-73a9-4609-84b5-351da4dea6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:51.059350 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc44c0a-73a9-4609-84b5-351da4dea6c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:51.059830 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc44c0a-73a9-4609-84b5-351da4dea6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:51.060254 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc44c0a-73a9-4609-84b5-351da4dea6c8 admin admin] PATH_INFO: `/v3/projects/f144d34fce90465aa3501ec7a2609efe/users/cb24ae7427af42c6a23ed7cd1ffa8f04/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:51.078329 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc44c0a-73a9-4609-84b5-351da4dea6c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f144d34fce90465aa3501ec7a2609efe, user_id=cb24ae7427af42c6a23ed7cd1ffa8f04, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:51.081292 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc44c0a-73a9-4609-84b5-351da4dea6c8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:51.109397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1328/2636] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:51 2022] PUT /identity/v3/projects/f144d34fce90465aa3501ec7a2609efe/users/cb24ae7427af42c6a23ed7cd1ffa8f04/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:51.113522 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feab88-28e8-4caf-8a50-7eae557f2207 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:51.113816 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feab88-28e8-4caf-8a50-7eae557f2207 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:51.114128 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feab88-28e8-4caf-8a50-7eae557f2207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:51.177592 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-c9feab88-28e8-4caf-8a50-7eae557f2207 None None] MFA Rules not processed for user `cb24ae7427af42c6a23ed7cd1ffa8f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:51.179131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c9feab88-28e8-4caf-8a50-7eae557f2207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:51.260757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:51.340235 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc44c0a-73a9-4609-84b5-351da4dea6c8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:51.366124 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1309/2637] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:51.447549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc44c0a-73a9-4609-84b5-351da4dea6c8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:51.456568 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4643b1-8ff1-42eb-96d0-d32bc3d88c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:51.457868 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4643b1-8ff1-42eb-96d0-d32bc3d88c88 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:51.458297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4643b1-8ff1-42eb-96d0-d32bc3d88c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:51.458827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4643b1-8ff1-42eb-96d0-d32bc3d88c88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:51.460140 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4643b1-8ff1-42eb-96d0-d32bc3d88c88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:51.464068 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4643b1-8ff1-42eb-96d0-d32bc3d88c88 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:51.536000 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1329/2638] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:51 2022] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:51.537665 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feab88-28e8-4caf-8a50-7eae557f2207 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:51.550240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feab88-28e8-4caf-8a50-7eae557f2207 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:51.626748 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead7aac-1043-4870-b32e-c0b5bd7e15e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:51.627670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead7aac-1043-4870-b32e-c0b5bd7e15e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:51.628811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead7aac-1043-4870-b32e-c0b5bd7e15e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:51.629194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead7aac-1043-4870-b32e-c0b5bd7e15e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:51.630029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead7aac-1043-4870-b32e-c0b5bd7e15e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:51.632482 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead7aac-1043-4870-b32e-c0b5bd7e15e5 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:51.668115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1310/2639] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:51 2022] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:51.672463 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4643b1-8ff1-42eb-96d0-d32bc3d88c88 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:51.694084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4643b1-8ff1-42eb-96d0-d32bc3d88c88 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:51.701876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb0ee3-6bad-4be6-aae9-c45c29a60369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:51.702612 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb0ee3-6bad-4be6-aae9-c45c29a60369 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:51.702892 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb0ee3-6bad-4be6-aae9-c45c29a60369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:51.703164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb0ee3-6bad-4be6-aae9-c45c29a60369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:51.703901 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb0ee3-6bad-4be6-aae9-c45c29a60369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:51.705907 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb0ee3-6bad-4be6-aae9-c45c29a60369 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:51.753683 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1330/2640] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:51.754746 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead7aac-1043-4870-b32e-c0b5bd7e15e5 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:51.767883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead7aac-1043-4870-b32e-c0b5bd7e15e5 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:51.783369 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f8f53-66bb-4a4c-87b5-a4df8d2e0b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:51.784512 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f8f53-66bb-4a4c-87b5-a4df8d2e0b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:51.784766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f8f53-66bb-4a4c-87b5-a4df8d2e0b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:51.785165 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f8f53-66bb-4a4c-87b5-a4df8d2e0b45 admin admin] PATH_INFO: `/v3/projects/54965d56d5824b5b9036030f279560da/users/f7802f9d6f634777ba6136ac3ccddd08/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:51.821448 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f8f53-66bb-4a4c-87b5-a4df8d2e0b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54965d56d5824b5b9036030f279560da, user_id=f7802f9d6f634777ba6136ac3ccddd08, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:51.824751 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f8f53-66bb-4a4c-87b5-a4df8d2e0b45 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:51.844713 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1311/2641] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:51 2022] PUT /identity/v3/projects/54965d56d5824b5b9036030f279560da/users/f7802f9d6f634777ba6136ac3ccddd08/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:51.848881 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb0ee3-6bad-4be6-aae9-c45c29a60369 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:51.859529 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb0ee3-6bad-4be6-aae9-c45c29a60369 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:51.914654 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:51.921480 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd591c-633c-479a-9fb7-4f52a9e1fd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:51.922342 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd591c-633c-479a-9fb7-4f52a9e1fd68 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:51.922630 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd591c-633c-479a-9fb7-4f52a9e1fd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:51.923509 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd591c-633c-479a-9fb7-4f52a9e1fd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:51.924462 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd591c-633c-479a-9fb7-4f52a9e1fd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:51.927125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd591c-633c-479a-9fb7-4f52a9e1fd68 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:51.942397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1331/2642] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:51.943561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f8f53-66bb-4a4c-87b5-a4df8d2e0b45 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:51.955186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f8f53-66bb-4a4c-87b5-a4df8d2e0b45 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:51.960719 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3b411-b71b-4c8f-a580-132e1d828a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:51.961742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3b411-b71b-4c8f-a580-132e1d828a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:51.962133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3b411-b71b-4c8f-a580-132e1d828a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:51.962480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3b411-b71b-4c8f-a580-132e1d828a75 admin admin] PATH_INFO: `/v3/projects/54965d56d5824b5b9036030f279560da/users/f7802f9d6f634777ba6136ac3ccddd08/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:51.964948 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3b411-b71b-4c8f-a580-132e1d828a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54965d56d5824b5b9036030f279560da, user_id=f7802f9d6f634777ba6136ac3ccddd08, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:51.968061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3b411-b71b-4c8f-a580-132e1d828a75 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:51.980266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1312/2643] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:51 2022] PUT /identity/v3/projects/54965d56d5824b5b9036030f279560da/users/f7802f9d6f634777ba6136ac3ccddd08/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:51.990616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecb979-ab33-41a3-badd-170350c5ebf1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:51.990923 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecb979-ab33-41a3-badd-170350c5ebf1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:51.991200 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecb979-ab33-41a3-badd-170350c5ebf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:52.021217 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-82ecb979-ab33-41a3-badd-170350c5ebf1 None None] MFA Rules not processed for user `f7802f9d6f634777ba6136ac3ccddd08`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:52.022491 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-82ecb979-ab33-41a3-badd-170350c5ebf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:52.109801 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1332/2644] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:52.118188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3b411-b71b-4c8f-a580-132e1d828a75 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:52.119936 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-52f3b411-b71b-4c8f-a580-132e1d828a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:52.236689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3b411-b71b-4c8f-a580-132e1d828a75 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:52.240980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab52895-230f-441a-bb51-a79d128722dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:52.241692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab52895-230f-441a-bb51-a79d128722dd service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:52.241985 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab52895-230f-441a-bb51-a79d128722dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:52.242293 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab52895-230f-441a-bb51-a79d128722dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:52.252883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab52895-230f-441a-bb51-a79d128722dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:52.254923 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab52895-230f-441a-bb51-a79d128722dd service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:52.266643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1313/2645] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:52.356273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecb979-ab33-41a3-badd-170350c5ebf1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:52.367326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecb979-ab33-41a3-badd-170350c5ebf1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:52.372678 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253b089-5160-42e7-aeb9-c56c339da714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:52.373332 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253b089-5160-42e7-aeb9-c56c339da714 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:52.373614 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253b089-5160-42e7-aeb9-c56c339da714 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:52.373889 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253b089-5160-42e7-aeb9-c56c339da714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:52.435047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253b089-5160-42e7-aeb9-c56c339da714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:52.436567 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253b089-5160-42e7-aeb9-c56c339da714 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:52.447206 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1333/2646] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:52.746871 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab52895-230f-441a-bb51-a79d128722dd service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:52.784757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:52.820795 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab52895-230f-441a-bb51-a79d128722dd service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:52.825696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e7d30-d632-4a9c-9721-6c177857ad42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:52.826715 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e7d30-d632-4a9c-9721-6c177857ad42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:52.826998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e7d30-d632-4a9c-9721-6c177857ad42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:52.827272 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e7d30-d632-4a9c-9721-6c177857ad42 admin admin] PATH_INFO: `/v3/users/cb24ae7427af42c6a23ed7cd1ffa8f04` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:52.828605 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e7d30-d632-4a9c-9721-6c177857ad42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb24ae7427af42c6a23ed7cd1ffa8f04)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:52.835329 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e7d30-d632-4a9c-9721-6c177857ad42 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:52.887871 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-ec8e7d30-d632-4a9c-9721-6c177857ad42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb24ae7427af42c6a23ed7cd1ffa8f04'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:52.888763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-ec8e7d30-d632-4a9c-9721-6c177857ad42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb24ae7427af42c6a23ed7cd1ffa8f04'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:52.889595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-ec8e7d30-d632-4a9c-9721-6c177857ad42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb24ae7427af42c6a23ed7cd1ffa8f04'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:52.907591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-ec8e7d30-d632-4a9c-9721-6c177857ad42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb24ae7427af42c6a23ed7cd1ffa8f04'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:52.919630 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-ec8e7d30-d632-4a9c-9721-6c177857ad42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb24ae7427af42c6a23ed7cd1ffa8f04'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:52.943872 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1314/2647] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:52 2022] DELETE /identity/v3/users/cb24ae7427af42c6a23ed7cd1ffa8f04 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:52.948259 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca927d5-21bb-4c08-b94d-6274a17f31d0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:52.948762 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca927d5-21bb-4c08-b94d-6274a17f31d0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:52.949069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca927d5-21bb-4c08-b94d-6274a17f31d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:52.984736 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9ca927d5-21bb-4c08-b94d-6274a17f31d0 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:52.986058 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9ca927d5-21bb-4c08-b94d-6274a17f31d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:53.060645 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1334/2648] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:53.071114 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e7d30-d632-4a9c-9721-6c177857ad42 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:53.072592 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ec8e7d30-d632-4a9c-9721-6c177857ad42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:53.135113 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e7d30-d632-4a9c-9721-6c177857ad42 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:53.138914 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bdc36-4e36-4c44-a64b-cf90ffb420f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:53.139568 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bdc36-4e36-4c44-a64b-cf90ffb420f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:53.139848 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bdc36-4e36-4c44-a64b-cf90ffb420f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:53.140119 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bdc36-4e36-4c44-a64b-cf90ffb420f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:53.150823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bdc36-4e36-4c44-a64b-cf90ffb420f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:53.152248 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bdc36-4e36-4c44-a64b-cf90ffb420f9 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:53.163236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1315/2649] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:20:53.498656 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca927d5-21bb-4c08-b94d-6274a17f31d0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:53.500222 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9ca927d5-21bb-4c08-b94d-6274a17f31d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:53.530314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca927d5-21bb-4c08-b94d-6274a17f31d0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:53.537774 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e802af-49d1-4520-89ce-1dd6ca5d8b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:53.538746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e802af-49d1-4520-89ce-1dd6ca5d8b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:53.539030 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e802af-49d1-4520-89ce-1dd6ca5d8b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:53.539302 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e802af-49d1-4520-89ce-1dd6ca5d8b3d admin admin] PATH_INFO: `/v3/projects/f144d34fce90465aa3501ec7a2609efe` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:53.547159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e802af-49d1-4520-89ce-1dd6ca5d8b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f144d34fce90465aa3501ec7a2609efe)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:53.549197 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e802af-49d1-4520-89ce-1dd6ca5d8b3d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:53.569109 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:53.624721 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f8e802af-49d1-4520-89ce-1dd6ca5d8b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f144d34fce90465aa3501ec7a2609efe', 'request_id': 'req-f8e802af-49d1-4520-89ce-1dd6ca5d8b3d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:53.630845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f8e802af-49d1-4520-89ce-1dd6ca5d8b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f144d34fce90465aa3501ec7a2609efe', 'request_id': 'req-f8e802af-49d1-4520-89ce-1dd6ca5d8b3d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:53.637288 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f8e802af-49d1-4520-89ce-1dd6ca5d8b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f144d34fce90465aa3501ec7a2609efe', 'request_id': 'req-f8e802af-49d1-4520-89ce-1dd6ca5d8b3d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:53.661562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f8e802af-49d1-4520-89ce-1dd6ca5d8b3d admin admin] The token cache is being invalidate because project f144d34fce90465aa3501ec7a2609efe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:53.661855 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f8e802af-49d1-4520-89ce-1dd6ca5d8b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:53.662623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f8e802af-49d1-4520-89ce-1dd6ca5d8b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:53.665007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1335/2650] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:53 2022] DELETE /identity/v3/projects/f144d34fce90465aa3501ec7a2609efe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:53.668936 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bdc36-4e36-4c44-a64b-cf90ffb420f9 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:53.678855 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bdc36-4e36-4c44-a64b-cf90ffb420f9 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:53.731569 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:53.742773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e401391-2ea2-4917-b603-28ef1e1de159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:53.743934 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e401391-2ea2-4917-b603-28ef1e1de159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:53.744235 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e401391-2ea2-4917-b603-28ef1e1de159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:53.744510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e401391-2ea2-4917-b603-28ef1e1de159 admin admin] PATH_INFO: `/v3/users/f7802f9d6f634777ba6136ac3ccddd08` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:53.745720 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e401391-2ea2-4917-b603-28ef1e1de159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7802f9d6f634777ba6136ac3ccddd08)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:53.747670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e401391-2ea2-4917-b603-28ef1e1de159 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:53.804138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-8e401391-2ea2-4917-b603-28ef1e1de159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7802f9d6f634777ba6136ac3ccddd08'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:53.805308 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-8e401391-2ea2-4917-b603-28ef1e1de159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7802f9d6f634777ba6136ac3ccddd08'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:53.805984 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-8e401391-2ea2-4917-b603-28ef1e1de159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7802f9d6f634777ba6136ac3ccddd08'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:53.821175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-8e401391-2ea2-4917-b603-28ef1e1de159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7802f9d6f634777ba6136ac3ccddd08'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:53.829181 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-8e401391-2ea2-4917-b603-28ef1e1de159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7802f9d6f634777ba6136ac3ccddd08'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:53.845787 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1316/2651] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:20:53 2022] DELETE /identity/v3/users/f7802f9d6f634777ba6136ac3ccddd08 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:54.145437 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e802af-49d1-4520-89ce-1dd6ca5d8b3d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:54.147505 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f8e802af-49d1-4520-89ce-1dd6ca5d8b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:54.183332 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e802af-49d1-4520-89ce-1dd6ca5d8b3d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:54.281541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc1ea3-e5cf-4054-8fd3-0e93d8d81e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:54.281541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc1ea3-e5cf-4054-8fd3-0e93d8d81e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:54.281541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc1ea3-e5cf-4054-8fd3-0e93d8d81e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:54.281541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc1ea3-e5cf-4054-8fd3-0e93d8d81e22 admin admin] PATH_INFO: `/v3/projects/54965d56d5824b5b9036030f279560da` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:54.282163 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc1ea3-e5cf-4054-8fd3-0e93d8d81e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54965d56d5824b5b9036030f279560da)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:54.282163 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc1ea3-e5cf-4054-8fd3-0e93d8d81e22 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:54.327594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aecc1ea3-e5cf-4054-8fd3-0e93d8d81e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54965d56d5824b5b9036030f279560da', 'request_id': 'req-aecc1ea3-e5cf-4054-8fd3-0e93d8d81e22'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:54.334952 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aecc1ea3-e5cf-4054-8fd3-0e93d8d81e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54965d56d5824b5b9036030f279560da', 'request_id': 'req-aecc1ea3-e5cf-4054-8fd3-0e93d8d81e22'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:54.341642 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aecc1ea3-e5cf-4054-8fd3-0e93d8d81e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54965d56d5824b5b9036030f279560da', 'request_id': 'req-aecc1ea3-e5cf-4054-8fd3-0e93d8d81e22'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:54.355486 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aecc1ea3-e5cf-4054-8fd3-0e93d8d81e22 admin admin] The token cache is being invalidate because project 54965d56d5824b5b9036030f279560da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:20:54.355784 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aecc1ea3-e5cf-4054-8fd3-0e93d8d81e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:54.356431 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aecc1ea3-e5cf-4054-8fd3-0e93d8d81e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:20:54.358268 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1336/2652] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:20:54 2022] DELETE /identity/v3/projects/54965d56d5824b5b9036030f279560da => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:20:54.364416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a05eec-e882-4277-bcd0-54c220835b8d None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:54.364699 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a05eec-e882-4277-bcd0-54c220835b8d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:54.364994 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a05eec-e882-4277-bcd0-54c220835b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:54.386148 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-d0a05eec-e882-4277-bcd0-54c220835b8d None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:54.387435 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d0a05eec-e882-4277-bcd0-54c220835b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:54.451112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1317/2653] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:54.461356 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73102af-6c4f-4089-a680-5b590485faf7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:54.461743 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73102af-6c4f-4089-a680-5b590485faf7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:54.462147 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73102af-6c4f-4089-a680-5b590485faf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:54.484014 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e73102af-6c4f-4089-a680-5b590485faf7 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:54.485230 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e73102af-6c4f-4089-a680-5b590485faf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:54.493761 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1337/2654] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:54.498259 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a05eec-e882-4277-bcd0-54c220835b8d None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:54.508676 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a05eec-e882-4277-bcd0-54c220835b8d None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:54.513469 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4203d-79fe-4dd1-b91b-5909d63fcfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:54.514179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4203d-79fe-4dd1-b91b-5909d63fcfab admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:54.514468 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4203d-79fe-4dd1-b91b-5909d63fcfab admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:54.514738 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4203d-79fe-4dd1-b91b-5909d63fcfab admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:54.515468 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4203d-79fe-4dd1-b91b-5909d63fcfab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:20:54.515777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4203d-79fe-4dd1-b91b-5909d63fcfab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:54.517424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4203d-79fe-4dd1-b91b-5909d63fcfab admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:54.535126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1318/2655] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:20:54.537156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73102af-6c4f-4089-a680-5b590485faf7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:54.549274 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73102af-6c4f-4089-a680-5b590485faf7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:54.554615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531027c-c71a-40bf-a944-73c1eca9b2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:54.555536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531027c-c71a-40bf-a944-73c1eca9b2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:54.556104 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531027c-c71a-40bf-a944-73c1eca9b2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:54.556639 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531027c-c71a-40bf-a944-73c1eca9b2e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:54.557706 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531027c-c71a-40bf-a944-73c1eca9b2e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:54.560343 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531027c-c71a-40bf-a944-73c1eca9b2e7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:54.595479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1338/2656] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:20:54 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:54.597695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4203d-79fe-4dd1-b91b-5909d63fcfab admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:54.608218 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4203d-79fe-4dd1-b91b-5909d63fcfab admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:54.683558 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9905a-1414-4d6e-91ed-de27d2a05e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:54.684391 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9905a-1414-4d6e-91ed-de27d2a05e98 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:54.684696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9905a-1414-4d6e-91ed-de27d2a05e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:54.684960 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9905a-1414-4d6e-91ed-de27d2a05e98 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:54.685669 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9905a-1414-4d6e-91ed-de27d2a05e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:54.687768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9905a-1414-4d6e-91ed-de27d2a05e98 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:54.698325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:54.726408 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1319/2657] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:20:54 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:20:54.727854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531027c-c71a-40bf-a944-73c1eca9b2e7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:54.739141 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:20:54.745092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531027c-c71a-40bf-a944-73c1eca9b2e7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:54.752566 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afad54f-53e6-4d9b-93a5-4d149a73462b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:54.753300 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afad54f-53e6-4d9b-93a5-4d149a73462b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:54.753585 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afad54f-53e6-4d9b-93a5-4d149a73462b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:54.754104 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afad54f-53e6-4d9b-93a5-4d149a73462b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:54.755052 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afad54f-53e6-4d9b-93a5-4d149a73462b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:54.761820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afad54f-53e6-4d9b-93a5-4d149a73462b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:54.787069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1339/2658] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:20:54.791571 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9905a-1414-4d6e-91ed-de27d2a05e98 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:54.804083 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9905a-1414-4d6e-91ed-de27d2a05e98 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:54.809038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9dee59-4631-49e2-9ba6-d13ac7e6c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:54.809729 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9dee59-4631-49e2-9ba6-d13ac7e6c078 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:54.810052 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9dee59-4631-49e2-9ba6-d13ac7e6c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:54.810327 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9dee59-4631-49e2-9ba6-d13ac7e6c078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:54.811072 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9dee59-4631-49e2-9ba6-d13ac7e6c078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:54.812759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9dee59-4631-49e2-9ba6-d13ac7e6c078 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:54.829416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1320/2659] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:20:54.830654 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afad54f-53e6-4d9b-93a5-4d149a73462b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:54.847568 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afad54f-53e6-4d9b-93a5-4d149a73462b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:54.865247 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb45781-fa71-4c2e-8e53-d2f272d79aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:54.866302 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb45781-fa71-4c2e-8e53-d2f272d79aba admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:54.866679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb45781-fa71-4c2e-8e53-d2f272d79aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:54.867007 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb45781-fa71-4c2e-8e53-d2f272d79aba admin admin] PATH_INFO: `/v3/projects/9c568d09b95b4d2a887c8c065b60b3f3/users/0e764ad7d83643088a2ac8ebdcc365ed/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:54.883869 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb45781-fa71-4c2e-8e53-d2f272d79aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c568d09b95b4d2a887c8c065b60b3f3, user_id=0e764ad7d83643088a2ac8ebdcc365ed, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:54.886751 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb45781-fa71-4c2e-8e53-d2f272d79aba admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:54.906136 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1340/2660] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:20:54 2022] PUT /identity/v3/projects/9c568d09b95b4d2a887c8c065b60b3f3/users/0e764ad7d83643088a2ac8ebdcc365ed/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:20:54.916656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e876e-0b5e-49d5-b0cd-3b417b91c436 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:54.916954 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e876e-0b5e-49d5-b0cd-3b417b91c436 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:54.917264 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e876e-0b5e-49d5-b0cd-3b417b91c436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:54.982029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-850e876e-0b5e-49d5-b0cd-3b417b91c436 None None] MFA Rules not processed for user `0e764ad7d83643088a2ac8ebdcc365ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:20:54.982029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-850e876e-0b5e-49d5-b0cd-3b417b91c436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:55.051498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1321/2661] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:20:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:20:55.062701 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb45781-fa71-4c2e-8e53-d2f272d79aba admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:20:55.065002 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-afb45781-fa71-4c2e-8e53-d2f272d79aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:20:55.125440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb45781-fa71-4c2e-8e53-d2f272d79aba admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:20:55.129850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31a586-117c-4fb5-96b1-db3710cc4762 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52ff8138094d64bce9de60c819ab4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:20:55.130581 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31a586-117c-4fb5-96b1-db3710cc4762 service glance] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:20:55.130866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31a586-117c-4fb5-96b1-db3710cc4762 service glance] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:20:55.131135 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31a586-117c-4fb5-96b1-db3710cc4762 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:20:55.141639 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31a586-117c-4fb5-96b1-db3710cc4762 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:20:55.143132 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31a586-117c-4fb5-96b1-db3710cc4762 service glance] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:20:55.152842 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1341/2662] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:20:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:21:05.047683 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:05.148385 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=40,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:06.667998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e876e-0b5e-49d5-b0cd-3b417b91c436 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:06.669379 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-850e876e-0b5e-49d5-b0cd-3b417b91c436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:06.743066 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e876e-0b5e-49d5-b0cd-3b417b91c436 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:06.748892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca211197-5ff9-4efd-b7ac-dbd788cd1cdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:06.749545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca211197-5ff9-4efd-b7ac-dbd788cd1cdc service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:06.749830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca211197-5ff9-4efd-b7ac-dbd788cd1cdc service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:06.750146 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca211197-5ff9-4efd-b7ac-dbd788cd1cdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:06.751950 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ca211197-5ff9-4efd-b7ac-dbd788cd1cdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:06.809190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca211197-5ff9-4efd-b7ac-dbd788cd1cdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:06.810914 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca211197-5ff9-4efd-b7ac-dbd788cd1cdc service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:06.823852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1322/2663] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:21:07.207794 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad5edd-d0b1-4ec8-8105-c38eea139bfa None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:07.208246 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad5edd-d0b1-4ec8-8105-c38eea139bfa None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:07.208354 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad5edd-d0b1-4ec8-8105-c38eea139bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:07.227052 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d3ad5edd-d0b1-4ec8-8105-c38eea139bfa None None] MFA Rules not processed for user `30c0516b85e74bdb829a3019e71e6ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:07.228238 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d3ad5edd-d0b1-4ec8-8105-c38eea139bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:07.283420 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1342/2664] 10.222.0.48 () {58 vars in 967 bytes} [Mon Jul 25 12:21:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:07.306065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca211197-5ff9-4efd-b7ac-dbd788cd1cdc service nova] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:07.307498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ca211197-5ff9-4efd-b7ac-dbd788cd1cdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:07.374536 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca211197-5ff9-4efd-b7ac-dbd788cd1cdc service nova] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:07.379490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625e7e2-750e-415f-b522-64d63056659f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e71de21b4b6d4971953f0c1ca92d9f23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:07.380127 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625e7e2-750e-415f-b522-64d63056659f service swift] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:07.380413 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625e7e2-750e-415f-b522-64d63056659f service swift] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:07.380690 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625e7e2-750e-415f-b522-64d63056659f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:07.388610 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625e7e2-750e-415f-b522-64d63056659f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:07.390210 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625e7e2-750e-415f-b522-64d63056659f service swift] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:07.398132 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1323/2665] 10.222.0.48 () {60 vars in 1384 bytes} [Mon Jul 25 12:21:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:21:10.792199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad5edd-d0b1-4ec8-8105-c38eea139bfa None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:10.852913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad5edd-d0b1-4ec8-8105-c38eea139bfa None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:10.857322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1825f7-1292-48fc-94ff-b36d006028ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:10.858223 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1825f7-1292-48fc-94ff-b36d006028ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:10.858507 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1825f7-1292-48fc-94ff-b36d006028ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:10.858782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1825f7-1292-48fc-94ff-b36d006028ad admin admin] PATH_INFO: `/v3/users/0e764ad7d83643088a2ac8ebdcc365ed` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:10.859978 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1825f7-1292-48fc-94ff-b36d006028ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e764ad7d83643088a2ac8ebdcc365ed)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:10.861894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1825f7-1292-48fc-94ff-b36d006028ad admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:10.906381 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5e1825f7-1292-48fc-94ff-b36d006028ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e764ad7d83643088a2ac8ebdcc365ed'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:10.907033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5e1825f7-1292-48fc-94ff-b36d006028ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e764ad7d83643088a2ac8ebdcc365ed'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:10.907642 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5e1825f7-1292-48fc-94ff-b36d006028ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e764ad7d83643088a2ac8ebdcc365ed'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:10.919170 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5e1825f7-1292-48fc-94ff-b36d006028ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e764ad7d83643088a2ac8ebdcc365ed'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:10.925987 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5e1825f7-1292-48fc-94ff-b36d006028ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e764ad7d83643088a2ac8ebdcc365ed'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:10.938489 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1343/2666] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:21:10 2022] DELETE /identity/v3/users/0e764ad7d83643088a2ac8ebdcc365ed => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:10.943661 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44b1ca-146e-4c81-be3a-3baeccb7f9ca None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:10.944134 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44b1ca-146e-4c81-be3a-3baeccb7f9ca None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:10.944232 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44b1ca-146e-4c81-be3a-3baeccb7f9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:10.963027 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-ce44b1ca-146e-4c81-be3a-3baeccb7f9ca None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:10.964218 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ce44b1ca-146e-4c81-be3a-3baeccb7f9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:10.983960 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=100 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:11.022918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1324/2667] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:11.032407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1825f7-1292-48fc-94ff-b36d006028ad admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:11.033805 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5e1825f7-1292-48fc-94ff-b36d006028ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:11.061061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:11.092959 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1825f7-1292-48fc-94ff-b36d006028ad admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:11.096570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bf2e0-4a22-4597-bd81-4d2e07fe0c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:11.097208 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bf2e0-4a22-4597-bd81-4d2e07fe0c61 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:11.097490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bf2e0-4a22-4597-bd81-4d2e07fe0c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:11.097767 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bf2e0-4a22-4597-bd81-4d2e07fe0c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:11.106754 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bf2e0-4a22-4597-bd81-4d2e07fe0c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:11.108181 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bf2e0-4a22-4597-bd81-4d2e07fe0c61 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:11.117587 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1344/2668] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:21:11.384399 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44b1ca-146e-4c81-be3a-3baeccb7f9ca None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:11.385815 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ce44b1ca-146e-4c81-be3a-3baeccb7f9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:11.400092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44b1ca-146e-4c81-be3a-3baeccb7f9ca None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:11.405608 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279a71d-9411-4022-bbaa-69ba53ef407d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:11.406042 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279a71d-9411-4022-bbaa-69ba53ef407d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:11.406329 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279a71d-9411-4022-bbaa-69ba53ef407d admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:11.406606 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279a71d-9411-4022-bbaa-69ba53ef407d admin admin] PATH_INFO: `/v3/projects/9c568d09b95b4d2a887c8c065b60b3f3` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:11.407867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279a71d-9411-4022-bbaa-69ba53ef407d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c568d09b95b4d2a887c8c065b60b3f3)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:11.409760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279a71d-9411-4022-bbaa-69ba53ef407d admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:11.466543 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9279a71d-9411-4022-bbaa-69ba53ef407d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c568d09b95b4d2a887c8c065b60b3f3', 'request_id': 'req-9279a71d-9411-4022-bbaa-69ba53ef407d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:11.476225 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9279a71d-9411-4022-bbaa-69ba53ef407d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c568d09b95b4d2a887c8c065b60b3f3', 'request_id': 'req-9279a71d-9411-4022-bbaa-69ba53ef407d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:11.481876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9279a71d-9411-4022-bbaa-69ba53ef407d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c568d09b95b4d2a887c8c065b60b3f3', 'request_id': 'req-9279a71d-9411-4022-bbaa-69ba53ef407d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:11.493902 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9279a71d-9411-4022-bbaa-69ba53ef407d admin admin] The token cache is being invalidate because project 9c568d09b95b4d2a887c8c065b60b3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:21:11.494233 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9279a71d-9411-4022-bbaa-69ba53ef407d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:11.494884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-9279a71d-9411-4022-bbaa-69ba53ef407d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:11.496429 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1325/2669] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:21:11 2022] DELETE /identity/v3/projects/9c568d09b95b4d2a887c8c065b60b3f3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:11.501335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a0c77-fb65-4f9d-a379-23ec638bd55b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:11.501624 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a0c77-fb65-4f9d-a379-23ec638bd55b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:11.501902 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a0c77-fb65-4f9d-a379-23ec638bd55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:11.522782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-530a0c77-fb65-4f9d-a379-23ec638bd55b None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:11.524021 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-530a0c77-fb65-4f9d-a379-23ec638bd55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:11.587564 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1345/2670] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:21:11.595499 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c88c3-2393-46ed-b446-44c7f57e84db None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:11.595791 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c88c3-2393-46ed-b446-44c7f57e84db None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:11.596068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c88c3-2393-46ed-b446-44c7f57e84db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:11.616864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-935c88c3-2393-46ed-b446-44c7f57e84db None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:11.618131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-935c88c3-2393-46ed-b446-44c7f57e84db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:11.626563 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1326/2671] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:11.630846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a0c77-fb65-4f9d-a379-23ec638bd55b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:11.648972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a0c77-fb65-4f9d-a379-23ec638bd55b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:11.648972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4108fc-0522-4512-8b9e-2b71738ca8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:11.648972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4108fc-0522-4512-8b9e-2b71738ca8ef admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:11.648972 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4108fc-0522-4512-8b9e-2b71738ca8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:11.649446 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4108fc-0522-4512-8b9e-2b71738ca8ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:11.649446 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4108fc-0522-4512-8b9e-2b71738ca8ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:21:11.649446 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4108fc-0522-4512-8b9e-2b71738ca8ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:11.650148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4108fc-0522-4512-8b9e-2b71738ca8ef admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:11.671965 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c88c3-2393-46ed-b446-44c7f57e84db None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:11.677724 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1346/2672] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:21:11.682390 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c88c3-2393-46ed-b446-44c7f57e84db None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:11.689252 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc006e-c549-4111-853d-c344860b37c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:11.689921 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc006e-c549-4111-853d-c344860b37c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:11.690512 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc006e-c549-4111-853d-c344860b37c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:11.690782 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc006e-c549-4111-853d-c344860b37c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:11.691485 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc006e-c549-4111-853d-c344860b37c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:11.693419 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc006e-c549-4111-853d-c344860b37c5 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:11.724227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1327/2673] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:21:11 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:21:11.728468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4108fc-0522-4512-8b9e-2b71738ca8ef admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:11.738580 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4108fc-0522-4512-8b9e-2b71738ca8ef admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:11.795376 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c44b0-5dde-46b1-b57b-eb0676c62d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:11.796045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c44b0-5dde-46b1-b57b-eb0676c62d3d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:11.796326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c44b0-5dde-46b1-b57b-eb0676c62d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:11.796600 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c44b0-5dde-46b1-b57b-eb0676c62d3d admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:11.797292 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c44b0-5dde-46b1-b57b-eb0676c62d3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:11.799232 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c44b0-5dde-46b1-b57b-eb0676c62d3d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:11.820277 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1347/2674] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:21:11 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:21:11.824344 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc006e-c549-4111-853d-c344860b37c5 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:11.834651 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc006e-c549-4111-853d-c344860b37c5 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:11.839487 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c0192-1ec9-4e73-9ac2-9929b49f0304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:11.840152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c0192-1ec9-4e73-9ac2-9929b49f0304 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:11.840433 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c0192-1ec9-4e73-9ac2-9929b49f0304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:11.840707 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c0192-1ec9-4e73-9ac2-9929b49f0304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:11.841460 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c0192-1ec9-4e73-9ac2-9929b49f0304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:11.843076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c0192-1ec9-4e73-9ac2-9929b49f0304 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:11.853659 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1328/2675] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:21:11.857457 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c44b0-5dde-46b1-b57b-eb0676c62d3d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:11.867950 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c44b0-5dde-46b1-b57b-eb0676c62d3d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:11.872536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be91b6-b3bc-49cd-8254-311db28fad14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:11.873184 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be91b6-b3bc-49cd-8254-311db28fad14 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:11.873468 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be91b6-b3bc-49cd-8254-311db28fad14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:11.873747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be91b6-b3bc-49cd-8254-311db28fad14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:11.874516 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be91b6-b3bc-49cd-8254-311db28fad14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:11.876101 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be91b6-b3bc-49cd-8254-311db28fad14 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:11.886607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1348/2676] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:21:11.890667 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c0192-1ec9-4e73-9ac2-9929b49f0304 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:11.900740 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c0192-1ec9-4e73-9ac2-9929b49f0304 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:11.905366 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43825b2-2923-423c-9ab5-71a1f4651c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:11.906268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43825b2-2923-423c-9ab5-71a1f4651c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:11.906551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43825b2-2923-423c-9ab5-71a1f4651c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:11.906826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43825b2-2923-423c-9ab5-71a1f4651c65 admin admin] PATH_INFO: `/v3/projects/c6453c2d87014630a66dd07e9b0e1945/users/aa7254bd1b7a4fe59cef05d5b72ee6a1/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:11.921949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43825b2-2923-423c-9ab5-71a1f4651c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6453c2d87014630a66dd07e9b0e1945, user_id=aa7254bd1b7a4fe59cef05d5b72ee6a1, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:11.924605 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43825b2-2923-423c-9ab5-71a1f4651c65 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:11.938910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1329/2677] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:21:11 2022] PUT /identity/v3/projects/c6453c2d87014630a66dd07e9b0e1945/users/aa7254bd1b7a4fe59cef05d5b72ee6a1/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:11.950901 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3112d2-f3e5-428f-b297-fa9422ce5df7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:11.951199 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3112d2-f3e5-428f-b297-fa9422ce5df7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:11.951480 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3112d2-f3e5-428f-b297-fa9422ce5df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:11.978456 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ab3112d2-f3e5-428f-b297-fa9422ce5df7 None None] MFA Rules not processed for user `aa7254bd1b7a4fe59cef05d5b72ee6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:11.979665 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ab3112d2-f3e5-428f-b297-fa9422ce5df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:11.999342 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:12.043165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1349/2678] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:12.047783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43825b2-2923-423c-9ab5-71a1f4651c65 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:12.094823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:12.109825 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43825b2-2923-423c-9ab5-71a1f4651c65 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:12.115096 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128489f-e7ed-4f3a-afff-8ec39e11a079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:12.115744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128489f-e7ed-4f3a-afff-8ec39e11a079 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:12.116026 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128489f-e7ed-4f3a-afff-8ec39e11a079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:12.116299 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128489f-e7ed-4f3a-afff-8ec39e11a079 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:12.116987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128489f-e7ed-4f3a-afff-8ec39e11a079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:12.118944 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128489f-e7ed-4f3a-afff-8ec39e11a079 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:12.147970 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1330/2679] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:21:12 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:21:12.152048 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3112d2-f3e5-428f-b297-fa9422ce5df7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:12.163362 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3112d2-f3e5-428f-b297-fa9422ce5df7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:12.220577 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6641847-8bef-4930-b3ce-1d39689cc343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:12.221274 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6641847-8bef-4930-b3ce-1d39689cc343 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:12.221550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6641847-8bef-4930-b3ce-1d39689cc343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:12.221820 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6641847-8bef-4930-b3ce-1d39689cc343 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:12.222536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6641847-8bef-4930-b3ce-1d39689cc343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:12.225031 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6641847-8bef-4930-b3ce-1d39689cc343 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:12.244663 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1350/2680] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:21:12 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:21:12.248677 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128489f-e7ed-4f3a-afff-8ec39e11a079 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:12.259028 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128489f-e7ed-4f3a-afff-8ec39e11a079 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:12.263686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c094b-fbbb-4b46-8c92-ebe1756a1f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:12.264342 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c094b-fbbb-4b46-8c92-ebe1756a1f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:12.264624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c094b-fbbb-4b46-8c92-ebe1756a1f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:12.264900 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c094b-fbbb-4b46-8c92-ebe1756a1f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:12.265656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c094b-fbbb-4b46-8c92-ebe1756a1f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:12.267286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c094b-fbbb-4b46-8c92-ebe1756a1f44 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:12.278455 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1331/2681] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:21:12.282440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6641847-8bef-4930-b3ce-1d39689cc343 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:12.292921 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6641847-8bef-4930-b3ce-1d39689cc343 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:12.297476 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e78231-5608-49da-9990-eab5e5e18a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:12.298371 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e78231-5608-49da-9990-eab5e5e18a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:12.298650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e78231-5608-49da-9990-eab5e5e18a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:12.298921 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e78231-5608-49da-9990-eab5e5e18a27 admin admin] PATH_INFO: `/v3/projects/c4453a2fa0c341bcafc14d20e239f096/users/a83ba230664e4312b52e9e7ea9612f99/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:12.313098 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e78231-5608-49da-9990-eab5e5e18a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4453a2fa0c341bcafc14d20e239f096, user_id=a83ba230664e4312b52e9e7ea9612f99, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:12.316104 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e78231-5608-49da-9990-eab5e5e18a27 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:12.328406 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1351/2682] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:21:12 2022] PUT /identity/v3/projects/c4453a2fa0c341bcafc14d20e239f096/users/a83ba230664e4312b52e9e7ea9612f99/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:12.332441 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c094b-fbbb-4b46-8c92-ebe1756a1f44 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:12.343238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c094b-fbbb-4b46-8c92-ebe1756a1f44 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:12.398735 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2c5fc-c3b0-4059-93b9-ce4439b4ec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:12.399393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2c5fc-c3b0-4059-93b9-ce4439b4ec40 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:12.399670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2c5fc-c3b0-4059-93b9-ce4439b4ec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:12.399941 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2c5fc-c3b0-4059-93b9-ce4439b4ec40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:12.400653 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2c5fc-c3b0-4059-93b9-ce4439b4ec40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:12.402261 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2c5fc-c3b0-4059-93b9-ce4439b4ec40 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:12.412532 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1332/2683] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:21:12.416616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e78231-5608-49da-9990-eab5e5e18a27 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:12.426818 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e78231-5608-49da-9990-eab5e5e18a27 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:12.431400 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d68f18-3a74-41dd-8565-cfa4809ceccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:12.432270 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d68f18-3a74-41dd-8565-cfa4809ceccf admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:12.432549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d68f18-3a74-41dd-8565-cfa4809ceccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:12.432819 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d68f18-3a74-41dd-8565-cfa4809ceccf admin admin] PATH_INFO: `/v3/projects/c4453a2fa0c341bcafc14d20e239f096/users/a83ba230664e4312b52e9e7ea9612f99/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:12.434805 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d68f18-3a74-41dd-8565-cfa4809ceccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4453a2fa0c341bcafc14d20e239f096, user_id=a83ba230664e4312b52e9e7ea9612f99, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:12.437435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d68f18-3a74-41dd-8565-cfa4809ceccf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:12.447967 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1352/2684] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:21:12 2022] PUT /identity/v3/projects/c4453a2fa0c341bcafc14d20e239f096/users/a83ba230664e4312b52e9e7ea9612f99/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:21:12.458649 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310929c5-7f5b-4590-9f8b-2a01c2b9ccf6 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:12.458944 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310929c5-7f5b-4590-9f8b-2a01c2b9ccf6 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:12.459233 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310929c5-7f5b-4590-9f8b-2a01c2b9ccf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:12.487238 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-310929c5-7f5b-4590-9f8b-2a01c2b9ccf6 None None] MFA Rules not processed for user `a83ba230664e4312b52e9e7ea9612f99`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:12.488461 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-310929c5-7f5b-4590-9f8b-2a01c2b9ccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:12.556033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1333/2685] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:12.567175 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d68f18-3a74-41dd-8565-cfa4809ceccf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:12.568901 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-47d68f18-3a74-41dd-8565-cfa4809ceccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:12.625846 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d68f18-3a74-41dd-8565-cfa4809ceccf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:12.629433 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2736f5-a336-4e05-bef7-3ae6f3f27f68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:12.630143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2736f5-a336-4e05-bef7-3ae6f3f27f68 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:12.630428 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2736f5-a336-4e05-bef7-3ae6f3f27f68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:12.630705 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2736f5-a336-4e05-bef7-3ae6f3f27f68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:12.658809 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:12.687579 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2736f5-a336-4e05-bef7-3ae6f3f27f68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:12.689045 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2736f5-a336-4e05-bef7-3ae6f3f27f68 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:12.698547 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1353/2686] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:21:15.249036 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310929c5-7f5b-4590-9f8b-2a01c2b9ccf6 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:15.293596 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:15.313164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310929c5-7f5b-4590-9f8b-2a01c2b9ccf6 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:15.318046 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fe710-8577-4a1c-ab8d-ec6df0774d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:15.319485 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fe710-8577-4a1c-ab8d-ec6df0774d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:15.319776 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fe710-8577-4a1c-ab8d-ec6df0774d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:15.320089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fe710-8577-4a1c-ab8d-ec6df0774d48 admin admin] PATH_INFO: `/v3/users/aa7254bd1b7a4fe59cef05d5b72ee6a1` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:15.321364 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67fe710-8577-4a1c-ab8d-ec6df0774d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa7254bd1b7a4fe59cef05d5b72ee6a1)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:15.323378 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67fe710-8577-4a1c-ab8d-ec6df0774d48 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:15.371997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a67fe710-8577-4a1c-ab8d-ec6df0774d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa7254bd1b7a4fe59cef05d5b72ee6a1'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:15.372647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a67fe710-8577-4a1c-ab8d-ec6df0774d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa7254bd1b7a4fe59cef05d5b72ee6a1'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:15.373263 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a67fe710-8577-4a1c-ab8d-ec6df0774d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa7254bd1b7a4fe59cef05d5b72ee6a1'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:15.386272 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a67fe710-8577-4a1c-ab8d-ec6df0774d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa7254bd1b7a4fe59cef05d5b72ee6a1'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:15.393220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a67fe710-8577-4a1c-ab8d-ec6df0774d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa7254bd1b7a4fe59cef05d5b72ee6a1'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:15.406488 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1334/2687] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:21:15 2022] DELETE /identity/v3/users/aa7254bd1b7a4fe59cef05d5b72ee6a1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:15.411139 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7f679-680c-4f89-9265-3f5ef3d2ea71 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:15.411628 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7f679-680c-4f89-9265-3f5ef3d2ea71 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:15.411889 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7f679-680c-4f89-9265-3f5ef3d2ea71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:15.431906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-05c7f679-680c-4f89-9265-3f5ef3d2ea71 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:15.433191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-05c7f679-680c-4f89-9265-3f5ef3d2ea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:15.500544 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1354/2688] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:15.511247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fe710-8577-4a1c-ab8d-ec6df0774d48 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:15.513089 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-a67fe710-8577-4a1c-ab8d-ec6df0774d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:15.580332 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fe710-8577-4a1c-ab8d-ec6df0774d48 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:15.584279 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815ecc3-43f3-44a1-bda2-b135d2994bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:15.584928 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815ecc3-43f3-44a1-bda2-b135d2994bdd service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:15.585212 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815ecc3-43f3-44a1-bda2-b135d2994bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:15.585486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815ecc3-43f3-44a1-bda2-b135d2994bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:15.594955 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815ecc3-43f3-44a1-bda2-b135d2994bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:15.596371 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815ecc3-43f3-44a1-bda2-b135d2994bdd service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:15.606507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1335/2689] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:21:15.884323 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7f679-680c-4f89-9265-3f5ef3d2ea71 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:15.886089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-05c7f679-680c-4f89-9265-3f5ef3d2ea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:15.911091 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7f679-680c-4f89-9265-3f5ef3d2ea71 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:15.916671 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204f6f0-0799-4699-b470-da4cd4cb1874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:15.917517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204f6f0-0799-4699-b470-da4cd4cb1874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:15.917812 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204f6f0-0799-4699-b470-da4cd4cb1874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:15.918162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204f6f0-0799-4699-b470-da4cd4cb1874 admin admin] PATH_INFO: `/v3/projects/c6453c2d87014630a66dd07e9b0e1945` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:15.919386 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204f6f0-0799-4699-b470-da4cd4cb1874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6453c2d87014630a66dd07e9b0e1945)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:15.921391 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204f6f0-0799-4699-b470-da4cd4cb1874 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:15.973159 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f204f6f0-0799-4699-b470-da4cd4cb1874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6453c2d87014630a66dd07e9b0e1945', 'request_id': 'req-f204f6f0-0799-4699-b470-da4cd4cb1874'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:15.978668 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f204f6f0-0799-4699-b470-da4cd4cb1874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6453c2d87014630a66dd07e9b0e1945', 'request_id': 'req-f204f6f0-0799-4699-b470-da4cd4cb1874'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:15.984875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f204f6f0-0799-4699-b470-da4cd4cb1874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6453c2d87014630a66dd07e9b0e1945', 'request_id': 'req-f204f6f0-0799-4699-b470-da4cd4cb1874'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:15.998173 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f204f6f0-0799-4699-b470-da4cd4cb1874 admin admin] The token cache is being invalidate because project c6453c2d87014630a66dd07e9b0e1945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:21:15.998458 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f204f6f0-0799-4699-b470-da4cd4cb1874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:15.999073 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f204f6f0-0799-4699-b470-da4cd4cb1874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:16.000604 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1355/2690] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:21:15 2022] DELETE /identity/v3/projects/c6453c2d87014630a66dd07e9b0e1945 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:16.004663 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815ecc3-43f3-44a1-bda2-b135d2994bdd service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:16.016498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815ecc3-43f3-44a1-bda2-b135d2994bdd service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:16.079362 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf24eb-1d11-4b2f-af62-5924a7745ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:16.080233 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf24eb-1d11-4b2f-af62-5924a7745ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:16.080515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf24eb-1d11-4b2f-af62-5924a7745ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:16.080786 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf24eb-1d11-4b2f-af62-5924a7745ed3 admin admin] PATH_INFO: `/v3/users/a83ba230664e4312b52e9e7ea9612f99` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:16.082020 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf24eb-1d11-4b2f-af62-5924a7745ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a83ba230664e4312b52e9e7ea9612f99)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:16.083944 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf24eb-1d11-4b2f-af62-5924a7745ed3 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:16.088878 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:16.140600 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-94bf24eb-1d11-4b2f-af62-5924a7745ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a83ba230664e4312b52e9e7ea9612f99'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:16.141349 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-94bf24eb-1d11-4b2f-af62-5924a7745ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a83ba230664e4312b52e9e7ea9612f99'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:16.141947 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-94bf24eb-1d11-4b2f-af62-5924a7745ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a83ba230664e4312b52e9e7ea9612f99'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:16.155092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-94bf24eb-1d11-4b2f-af62-5924a7745ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a83ba230664e4312b52e9e7ea9612f99'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:16.163384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-94bf24eb-1d11-4b2f-af62-5924a7745ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a83ba230664e4312b52e9e7ea9612f99'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:16.179447 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1336/2691] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:21:16 2022] DELETE /identity/v3/users/a83ba230664e4312b52e9e7ea9612f99 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:16.449409 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204f6f0-0799-4699-b470-da4cd4cb1874 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:16.450860 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f204f6f0-0799-4699-b470-da4cd4cb1874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:16.466657 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204f6f0-0799-4699-b470-da4cd4cb1874 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:16.514367 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:16.526441 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589cd74-1a9c-4d6b-87b8-83cd5e3f8c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:16.527264 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589cd74-1a9c-4d6b-87b8-83cd5e3f8c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:16.527546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589cd74-1a9c-4d6b-87b8-83cd5e3f8c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:16.527822 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589cd74-1a9c-4d6b-87b8-83cd5e3f8c05 admin admin] PATH_INFO: `/v3/projects/c4453a2fa0c341bcafc14d20e239f096` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:16.529025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589cd74-1a9c-4d6b-87b8-83cd5e3f8c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4453a2fa0c341bcafc14d20e239f096)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:16.530973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589cd74-1a9c-4d6b-87b8-83cd5e3f8c05 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:16.576535 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2589cd74-1a9c-4d6b-87b8-83cd5e3f8c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4453a2fa0c341bcafc14d20e239f096', 'request_id': 'req-2589cd74-1a9c-4d6b-87b8-83cd5e3f8c05'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:16.581932 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2589cd74-1a9c-4d6b-87b8-83cd5e3f8c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4453a2fa0c341bcafc14d20e239f096', 'request_id': 'req-2589cd74-1a9c-4d6b-87b8-83cd5e3f8c05'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:16.588414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2589cd74-1a9c-4d6b-87b8-83cd5e3f8c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4453a2fa0c341bcafc14d20e239f096', 'request_id': 'req-2589cd74-1a9c-4d6b-87b8-83cd5e3f8c05'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:16.601013 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2589cd74-1a9c-4d6b-87b8-83cd5e3f8c05 admin admin] The token cache is being invalidate because project c4453a2fa0c341bcafc14d20e239f096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:21:16.601298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2589cd74-1a9c-4d6b-87b8-83cd5e3f8c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:16.601924 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2589cd74-1a9c-4d6b-87b8-83cd5e3f8c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:16.603475 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1356/2692] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:21:16 2022] DELETE /identity/v3/projects/c4453a2fa0c341bcafc14d20e239f096 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:16.608407 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3c23c-20f1-480a-9753-56e6ca942aff None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:16.608859 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3c23c-20f1-480a-9753-56e6ca942aff None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:16.608988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3c23c-20f1-480a-9753-56e6ca942aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:16.627980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-dff3c23c-20f1-480a-9753-56e6ca942aff None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:16.629185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-dff3c23c-20f1-480a-9753-56e6ca942aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:16.688668 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1337/2693] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:16.697133 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e54d7-ccc7-470b-bee2-5d10a69dea9a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:16.697422 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e54d7-ccc7-470b-bee2-5d10a69dea9a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:16.697698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e54d7-ccc7-470b-bee2-5d10a69dea9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:16.717685 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-237e54d7-ccc7-470b-bee2-5d10a69dea9a None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:16.718917 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-237e54d7-ccc7-470b-bee2-5d10a69dea9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:16.727010 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1357/2694] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:16.731282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3c23c-20f1-480a-9753-56e6ca942aff None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:16.741261 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3c23c-20f1-480a-9753-56e6ca942aff None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:16.745804 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e33f6d-a407-483f-bcc4-cd2d6f14598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:16.746490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e33f6d-a407-483f-bcc4-cd2d6f14598e admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:16.746771 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e33f6d-a407-483f-bcc4-cd2d6f14598e admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:16.747043 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e33f6d-a407-483f-bcc4-cd2d6f14598e admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:16.747768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e33f6d-a407-483f-bcc4-cd2d6f14598e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:21:16.748072 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e33f6d-a407-483f-bcc4-cd2d6f14598e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:16.749642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e33f6d-a407-483f-bcc4-cd2d6f14598e admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:16.761507 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1338/2695] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:21:16.765860 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e54d7-ccc7-470b-bee2-5d10a69dea9a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:16.775871 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e54d7-ccc7-470b-bee2-5d10a69dea9a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:16.781016 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac430b-0e68-4423-adff-6160fe19f6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:16.781619 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac430b-0e68-4423-adff-6160fe19f6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:16.782389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac430b-0e68-4423-adff-6160fe19f6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:16.782389 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac430b-0e68-4423-adff-6160fe19f6d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:16.782882 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac430b-0e68-4423-adff-6160fe19f6d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:16.784775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac430b-0e68-4423-adff-6160fe19f6d3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:16.811856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1358/2696] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:21:16 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:21:16.816256 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e33f6d-a407-483f-bcc4-cd2d6f14598e admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:16.826258 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e33f6d-a407-483f-bcc4-cd2d6f14598e admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:16.882404 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202f02a-cb06-43d0-841d-e3c90669ef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:16.883073 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202f02a-cb06-43d0-841d-e3c90669ef49 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:16.883354 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202f02a-cb06-43d0-841d-e3c90669ef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:16.883628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202f02a-cb06-43d0-841d-e3c90669ef49 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:16.884317 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202f02a-cb06-43d0-841d-e3c90669ef49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:16.886225 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202f02a-cb06-43d0-841d-e3c90669ef49 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:16.902567 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:16.908775 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1339/2697] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:21:16 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:21:16.912809 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac430b-0e68-4423-adff-6160fe19f6d3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:16.923416 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac430b-0e68-4423-adff-6160fe19f6d3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:16.928018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4dfee-6835-4b44-9c06-c893b3b7d52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:16.929170 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4dfee-6835-4b44-9c06-c893b3b7d52d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:16.929455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4dfee-6835-4b44-9c06-c893b3b7d52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:16.929730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4dfee-6835-4b44-9c06-c893b3b7d52d admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:16.930510 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4dfee-6835-4b44-9c06-c893b3b7d52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:16.932111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4dfee-6835-4b44-9c06-c893b3b7d52d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:16.942275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1359/2698] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:21:16.946505 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202f02a-cb06-43d0-841d-e3c90669ef49 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:16.956380 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202f02a-cb06-43d0-841d-e3c90669ef49 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:16.960937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d9d78-b19c-4245-acfc-080778175a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:16.961705 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d9d78-b19c-4245-acfc-080778175a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:16.962481 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d9d78-b19c-4245-acfc-080778175a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:16.962762 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d9d78-b19c-4245-acfc-080778175a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:16.963555 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d9d78-b19c-4245-acfc-080778175a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:16.965802 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d9d78-b19c-4245-acfc-080778175a00 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:16.977530 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1340/2699] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:21:16.981573 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4dfee-6835-4b44-9c06-c893b3b7d52d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:16.992759 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4dfee-6835-4b44-9c06-c893b3b7d52d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:16.997500 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792124b-95c1-4b48-b112-8d7714748ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:16.998408 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792124b-95c1-4b48-b112-8d7714748ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:16.998693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792124b-95c1-4b48-b112-8d7714748ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:16.998970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792124b-95c1-4b48-b112-8d7714748ff9 admin admin] PATH_INFO: `/v3/projects/faafa5d2ad4846ffa21372a4e7c4baa6/users/3ea42274d93d41419def10fe05e4bab1/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:17.013751 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792124b-95c1-4b48-b112-8d7714748ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faafa5d2ad4846ffa21372a4e7c4baa6, user_id=3ea42274d93d41419def10fe05e4bab1, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:17.016378 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792124b-95c1-4b48-b112-8d7714748ff9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:17.029803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1360/2700] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:21:16 2022] PUT /identity/v3/projects/faafa5d2ad4846ffa21372a4e7c4baa6/users/3ea42274d93d41419def10fe05e4bab1/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:17.041508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a83ca8-1adc-437f-9267-f3a037aadd15 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:17.041808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a83ca8-1adc-437f-9267-f3a037aadd15 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:17.042132 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a83ca8-1adc-437f-9267-f3a037aadd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:17.072069 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-35a83ca8-1adc-437f-9267-f3a037aadd15 None None] MFA Rules not processed for user `3ea42274d93d41419def10fe05e4bab1`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:17.073516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-35a83ca8-1adc-437f-9267-f3a037aadd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:17.141025 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1341/2701] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:17.145669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792124b-95c1-4b48-b112-8d7714748ff9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:17.211355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792124b-95c1-4b48-b112-8d7714748ff9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:17.216111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3c2da-dd24-46a8-a534-9e432b341758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:17.216756 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3c2da-dd24-46a8-a534-9e432b341758 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:17.217058 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3c2da-dd24-46a8-a534-9e432b341758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:17.217313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3c2da-dd24-46a8-a534-9e432b341758 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:17.218020 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3c2da-dd24-46a8-a534-9e432b341758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:17.219930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3c2da-dd24-46a8-a534-9e432b341758 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:17.247466 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1361/2702] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:21:17 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:21:17.251830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a83ca8-1adc-437f-9267-f3a037aadd15 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:17.263340 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a83ca8-1adc-437f-9267-f3a037aadd15 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:17.322830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3c8ca-1342-4d06-b7b1-4a70c9a83d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:17.323506 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3c8ca-1342-4d06-b7b1-4a70c9a83d14 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:17.323798 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3c8ca-1342-4d06-b7b1-4a70c9a83d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:17.324064 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3c8ca-1342-4d06-b7b1-4a70c9a83d14 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:17.324763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3c8ca-1342-4d06-b7b1-4a70c9a83d14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:17.326726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3c8ca-1342-4d06-b7b1-4a70c9a83d14 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:17.347508 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1342/2703] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:21:17 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:21:17.352172 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3c2da-dd24-46a8-a534-9e432b341758 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:17.358884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:17.362832 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3c2da-dd24-46a8-a534-9e432b341758 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:17.368399 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd575e2-2f67-4844-80a2-4c01f47fe218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:17.369310 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd575e2-2f67-4844-80a2-4c01f47fe218 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:17.369815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd575e2-2f67-4844-80a2-4c01f47fe218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:17.370173 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd575e2-2f67-4844-80a2-4c01f47fe218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:17.371158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd575e2-2f67-4844-80a2-4c01f47fe218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:17.372837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd575e2-2f67-4844-80a2-4c01f47fe218 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:17.383670 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1362/2704] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:21:17.387636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3c8ca-1342-4d06-b7b1-4a70c9a83d14 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:17.398223 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3c8ca-1342-4d06-b7b1-4a70c9a83d14 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:17.402938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1491a-d452-4f1e-9eb8-d138bf5ff635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:17.403596 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1491a-d452-4f1e-9eb8-d138bf5ff635 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:17.403880 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1491a-d452-4f1e-9eb8-d138bf5ff635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:17.404152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1491a-d452-4f1e-9eb8-d138bf5ff635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:17.404868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1491a-d452-4f1e-9eb8-d138bf5ff635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:17.406494 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1491a-d452-4f1e-9eb8-d138bf5ff635 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:17.416842 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1343/2705] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:21:17.420805 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd575e2-2f67-4844-80a2-4c01f47fe218 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:17.430716 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd575e2-2f67-4844-80a2-4c01f47fe218 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:17.435338 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd771c-71b5-44e8-affc-a3d8041011a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:17.436202 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd771c-71b5-44e8-affc-a3d8041011a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:17.436490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd771c-71b5-44e8-affc-a3d8041011a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:17.436769 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd771c-71b5-44e8-affc-a3d8041011a2 admin admin] PATH_INFO: `/v3/projects/5f122d555603439f9d7e7ec862b4a143/users/54e395bf85154e479a85fcc9b6335af7/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:17.451551 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd771c-71b5-44e8-affc-a3d8041011a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f122d555603439f9d7e7ec862b4a143, user_id=54e395bf85154e479a85fcc9b6335af7, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:17.454256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd771c-71b5-44e8-affc-a3d8041011a2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:17.467525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1363/2706] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:21:17 2022] PUT /identity/v3/projects/5f122d555603439f9d7e7ec862b4a143/users/54e395bf85154e479a85fcc9b6335af7/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:17.478745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeeb0cb-f246-4069-9bb6-ac1415950efc None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:17.479037 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeeb0cb-f246-4069-9bb6-ac1415950efc None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:17.479315 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeeb0cb-f246-4069-9bb6-ac1415950efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:17.505964 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-ceeeb0cb-f246-4069-9bb6-ac1415950efc None None] MFA Rules not processed for user `54e395bf85154e479a85fcc9b6335af7`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:17.507268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ceeeb0cb-f246-4069-9bb6-ac1415950efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:17.551088 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:17.572186 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1344/2707] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:17.576628 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd771c-71b5-44e8-affc-a3d8041011a2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:17.636452 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd771c-71b5-44e8-affc-a3d8041011a2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:17.641095 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5615f6e-fcfd-4f30-baf6-b1297bac17ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:17.641745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5615f6e-fcfd-4f30-baf6-b1297bac17ad admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:17.642053 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5615f6e-fcfd-4f30-baf6-b1297bac17ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:17.642335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5615f6e-fcfd-4f30-baf6-b1297bac17ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:17.643015 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5615f6e-fcfd-4f30-baf6-b1297bac17ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:17.644931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5615f6e-fcfd-4f30-baf6-b1297bac17ad admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:17.672812 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1364/2708] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:21:17 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:21:17.676826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeeb0cb-f246-4069-9bb6-ac1415950efc None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:17.687830 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeeb0cb-f246-4069-9bb6-ac1415950efc None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:17.744132 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07797bcd-5c4a-4531-8a20-7dfc6005dddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:17.744793 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07797bcd-5c4a-4531-8a20-7dfc6005dddd admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:17.745071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07797bcd-5c4a-4531-8a20-7dfc6005dddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:17.745343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07797bcd-5c4a-4531-8a20-7dfc6005dddd admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:17.746055 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07797bcd-5c4a-4531-8a20-7dfc6005dddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:17.747943 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07797bcd-5c4a-4531-8a20-7dfc6005dddd admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:17.769742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1345/2709] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:21:17 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:21:17.774269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5615f6e-fcfd-4f30-baf6-b1297bac17ad admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:17.784756 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5615f6e-fcfd-4f30-baf6-b1297bac17ad admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:17.789616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610513d6-c23f-4454-8d6e-28dd864086c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:17.790313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610513d6-c23f-4454-8d6e-28dd864086c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:17.790596 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610513d6-c23f-4454-8d6e-28dd864086c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:17.790871 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610513d6-c23f-4454-8d6e-28dd864086c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:17.791593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610513d6-c23f-4454-8d6e-28dd864086c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:17.793183 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610513d6-c23f-4454-8d6e-28dd864086c4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:17.803744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1365/2710] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:21:17.807848 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07797bcd-5c4a-4531-8a20-7dfc6005dddd admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:17.818188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07797bcd-5c4a-4531-8a20-7dfc6005dddd admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:17.823402 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ccaef-b3d8-41b5-aaa1-04f70de1d843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:17.824219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ccaef-b3d8-41b5-aaa1-04f70de1d843 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:17.824499 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ccaef-b3d8-41b5-aaa1-04f70de1d843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:17.824772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ccaef-b3d8-41b5-aaa1-04f70de1d843 admin admin] PATH_INFO: `/v3/projects/eb6fb336758b4abda57ed845f4c4b3c6/users/247890492bc54583b85730ac7a7221bd/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:17.839877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ccaef-b3d8-41b5-aaa1-04f70de1d843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6fb336758b4abda57ed845f4c4b3c6, user_id=247890492bc54583b85730ac7a7221bd, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:17.842557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ccaef-b3d8-41b5-aaa1-04f70de1d843 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:17.855551 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1346/2711] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:21:17 2022] PUT /identity/v3/projects/eb6fb336758b4abda57ed845f4c4b3c6/users/247890492bc54583b85730ac7a7221bd/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:17.859723 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610513d6-c23f-4454-8d6e-28dd864086c4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:17.870677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610513d6-c23f-4454-8d6e-28dd864086c4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:17.927616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccf823-9812-4a24-8bbb-d20f677a0b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:17.928896 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccf823-9812-4a24-8bbb-d20f677a0b18 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:17.929180 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccf823-9812-4a24-8bbb-d20f677a0b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:17.929488 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccf823-9812-4a24-8bbb-d20f677a0b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:17.930279 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccf823-9812-4a24-8bbb-d20f677a0b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:17.931877 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccf823-9812-4a24-8bbb-d20f677a0b18 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:17.945869 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1366/2712] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:21:17.947054 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ccaef-b3d8-41b5-aaa1-04f70de1d843 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:17.957457 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ccaef-b3d8-41b5-aaa1-04f70de1d843 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:17.962317 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebc655-0b8a-4056-95ec-40f4ce2da41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:17.963189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebc655-0b8a-4056-95ec-40f4ce2da41d admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:17.963468 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebc655-0b8a-4056-95ec-40f4ce2da41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:17.963742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebc655-0b8a-4056-95ec-40f4ce2da41d admin admin] PATH_INFO: `/v3/projects/eb6fb336758b4abda57ed845f4c4b3c6/users/247890492bc54583b85730ac7a7221bd/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:17.965745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebc655-0b8a-4056-95ec-40f4ce2da41d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6fb336758b4abda57ed845f4c4b3c6, user_id=247890492bc54583b85730ac7a7221bd, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:17.968387 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebc655-0b8a-4056-95ec-40f4ce2da41d admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:17.979027 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1347/2713] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:21:17 2022] PUT /identity/v3/projects/eb6fb336758b4abda57ed845f4c4b3c6/users/247890492bc54583b85730ac7a7221bd/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:21:18.045959 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48ac14-05eb-48c6-857d-cb9d5ee443f0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:18.046285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48ac14-05eb-48c6-857d-cb9d5ee443f0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:18.046567 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48ac14-05eb-48c6-857d-cb9d5ee443f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:18.075553 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1f48ac14-05eb-48c6-857d-cb9d5ee443f0 None None] MFA Rules not processed for user `247890492bc54583b85730ac7a7221bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:18.076688 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1f48ac14-05eb-48c6-857d-cb9d5ee443f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:18.104978 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:18.145049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1367/2714] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:18.156547 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebc655-0b8a-4056-95ec-40f4ce2da41d admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:18.158284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-caebc655-0b8a-4056-95ec-40f4ce2da41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:18.216561 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebc655-0b8a-4056-95ec-40f4ce2da41d admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:18.220552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddd205-960b-4192-85af-88bac5a66b39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:18.221203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddd205-960b-4192-85af-88bac5a66b39 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:18.221484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddd205-960b-4192-85af-88bac5a66b39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:18.221759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddd205-960b-4192-85af-88bac5a66b39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:18.276356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:18.279853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddd205-960b-4192-85af-88bac5a66b39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:18.282082 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddd205-960b-4192-85af-88bac5a66b39 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:18.291470 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1348/2715] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:21:18.687454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48ac14-05eb-48c6-857d-cb9d5ee443f0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:18.688922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1f48ac14-05eb-48c6-857d-cb9d5ee443f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:18.765062 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48ac14-05eb-48c6-857d-cb9d5ee443f0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:18.770522 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c935d-e432-4dfc-930f-6457e4837aa2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f748b0f6b1433c87012793f0dda307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:18.771208 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c935d-e432-4dfc-930f-6457e4837aa2 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:18.771490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c935d-e432-4dfc-930f-6457e4837aa2 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:18.771771 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c935d-e432-4dfc-930f-6457e4837aa2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:18.773607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a31c935d-e432-4dfc-930f-6457e4837aa2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:18.786606 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c935d-e432-4dfc-930f-6457e4837aa2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:18.788863 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c935d-e432-4dfc-930f-6457e4837aa2 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:18.799571 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1368/2716] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:21:19.258518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddd205-960b-4192-85af-88bac5a66b39 service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:19.260167 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-43ddd205-960b-4192-85af-88bac5a66b39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:19.326180 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddd205-960b-4192-85af-88bac5a66b39 service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:19.330734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438879f-c608-4a30-9c4f-504dd7264570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:19.331590 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438879f-c608-4a30-9c4f-504dd7264570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:19.331870 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438879f-c608-4a30-9c4f-504dd7264570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:19.332142 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438879f-c608-4a30-9c4f-504dd7264570 admin admin] PATH_INFO: `/v3/users/a5e33f9993f6423793f30a86b6958dcc` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:19.333345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438879f-c608-4a30-9c4f-504dd7264570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e33f9993f6423793f30a86b6958dcc)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:19.335278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438879f-c608-4a30-9c4f-504dd7264570 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:19.380713 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-1438879f-c608-4a30-9c4f-504dd7264570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e33f9993f6423793f30a86b6958dcc'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:19.381345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-1438879f-c608-4a30-9c4f-504dd7264570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e33f9993f6423793f30a86b6958dcc'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:19.381987 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-1438879f-c608-4a30-9c4f-504dd7264570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e33f9993f6423793f30a86b6958dcc'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:19.393614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-1438879f-c608-4a30-9c4f-504dd7264570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e33f9993f6423793f30a86b6958dcc'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:19.400372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-1438879f-c608-4a30-9c4f-504dd7264570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e33f9993f6423793f30a86b6958dcc'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:19.413473 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1349/2717] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:21:19 2022] DELETE /identity/v3/users/a5e33f9993f6423793f30a86b6958dcc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:19.590686 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c935d-e432-4dfc-930f-6457e4837aa2 service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:19.601775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c935d-e432-4dfc-930f-6457e4837aa2 service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:19.662101 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139a4c0-e854-4715-a69b-a3f742d80a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:19.663597 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139a4c0-e854-4715-a69b-a3f742d80a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:19.663886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139a4c0-e854-4715-a69b-a3f742d80a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:19.664152 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139a4c0-e854-4715-a69b-a3f742d80a1a admin admin] PATH_INFO: `/v3/projects/d26fd4809ffb4cd59c14ef795476ef9d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:19.665335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139a4c0-e854-4715-a69b-a3f742d80a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d26fd4809ffb4cd59c14ef795476ef9d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:19.667299 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139a4c0-e854-4715-a69b-a3f742d80a1a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:19.716844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5139a4c0-e854-4715-a69b-a3f742d80a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26fd4809ffb4cd59c14ef795476ef9d', 'request_id': 'req-5139a4c0-e854-4715-a69b-a3f742d80a1a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:19.721530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:19.722833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5139a4c0-e854-4715-a69b-a3f742d80a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26fd4809ffb4cd59c14ef795476ef9d', 'request_id': 'req-5139a4c0-e854-4715-a69b-a3f742d80a1a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:19.731187 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5139a4c0-e854-4715-a69b-a3f742d80a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26fd4809ffb4cd59c14ef795476ef9d', 'request_id': 'req-5139a4c0-e854-4715-a69b-a3f742d80a1a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:19.743964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5139a4c0-e854-4715-a69b-a3f742d80a1a admin admin] The token cache is being invalidate because project d26fd4809ffb4cd59c14ef795476ef9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:21:19.743964 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5139a4c0-e854-4715-a69b-a3f742d80a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:19.744548 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5139a4c0-e854-4715-a69b-a3f742d80a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:19.746192 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1369/2718] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:21:19 2022] DELETE /identity/v3/projects/d26fd4809ffb4cd59c14ef795476ef9d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:19.750262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438879f-c608-4a30-9c4f-504dd7264570 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:19.751693 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-1438879f-c608-4a30-9c4f-504dd7264570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:19.772831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438879f-c608-4a30-9c4f-504dd7264570 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:19.816617 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139a4c0-e854-4715-a69b-a3f742d80a1a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:19.818230 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5139a4c0-e854-4715-a69b-a3f742d80a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:19.838393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7478dfb-3ea3-43eb-a7fb-a1647f37cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:19.839266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7478dfb-3ea3-43eb-a7fb-a1647f37cc6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:19.839550 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7478dfb-3ea3-43eb-a7fb-a1647f37cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:19.839824 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7478dfb-3ea3-43eb-a7fb-a1647f37cc6f admin admin] PATH_INFO: `/v3/users/0ccf3ec33c92432a80519f7f41354f14` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:19.841057 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7478dfb-3ea3-43eb-a7fb-a1647f37cc6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ccf3ec33c92432a80519f7f41354f14)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:19.843006 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7478dfb-3ea3-43eb-a7fb-a1647f37cc6f admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:19.856910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:19.878930 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139a4c0-e854-4715-a69b-a3f742d80a1a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:19.882682 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70c544-19b0-40b8-a7ad-56beaad35063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:19.883330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70c544-19b0-40b8-a7ad-56beaad35063 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:19.883611 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70c544-19b0-40b8-a7ad-56beaad35063 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:19.883882 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70c544-19b0-40b8-a7ad-56beaad35063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:19.885735 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0c70c544-19b0-40b8-a7ad-56beaad35063 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:19.891344 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b7478dfb-3ea3-43eb-a7fb-a1647f37cc6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ccf3ec33c92432a80519f7f41354f14'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:19.892449 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b7478dfb-3ea3-43eb-a7fb-a1647f37cc6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ccf3ec33c92432a80519f7f41354f14'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:19.893227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b7478dfb-3ea3-43eb-a7fb-a1647f37cc6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ccf3ec33c92432a80519f7f41354f14'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:19.907778 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b7478dfb-3ea3-43eb-a7fb-a1647f37cc6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ccf3ec33c92432a80519f7f41354f14'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:19.915166 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-b7478dfb-3ea3-43eb-a7fb-a1647f37cc6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ccf3ec33c92432a80519f7f41354f14'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:19.930598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1350/2719] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:21:19 2022] DELETE /identity/v3/users/0ccf3ec33c92432a80519f7f41354f14 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:21:19.948766 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70c544-19b0-40b8-a7ad-56beaad35063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:19.950333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70c544-19b0-40b8-a7ad-56beaad35063 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:19.959493 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1370/2720] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:21:20.111494 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7478dfb-3ea3-43eb-a7fb-a1647f37cc6f admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:20.113014 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b7478dfb-3ea3-43eb-a7fb-a1647f37cc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:20.185607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7478dfb-3ea3-43eb-a7fb-a1647f37cc6f admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:20.190490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2a8c2-0dc4-4fe7-a9fe-7f0032dfb840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:20.191352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2a8c2-0dc4-4fe7-a9fe-7f0032dfb840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:20.191638 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2a8c2-0dc4-4fe7-a9fe-7f0032dfb840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:20.191937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2a8c2-0dc4-4fe7-a9fe-7f0032dfb840 admin admin] PATH_INFO: `/v3/projects/ccf08c8828da4164b7a2d76cd96f35c7` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:20.193167 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2a8c2-0dc4-4fe7-a9fe-7f0032dfb840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf08c8828da4164b7a2d76cd96f35c7)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:20.195138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2a8c2-0dc4-4fe7-a9fe-7f0032dfb840 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:20.248695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a3a2a8c2-0dc4-4fe7-a9fe-7f0032dfb840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf08c8828da4164b7a2d76cd96f35c7', 'request_id': 'req-a3a2a8c2-0dc4-4fe7-a9fe-7f0032dfb840'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:20.256246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a3a2a8c2-0dc4-4fe7-a9fe-7f0032dfb840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf08c8828da4164b7a2d76cd96f35c7', 'request_id': 'req-a3a2a8c2-0dc4-4fe7-a9fe-7f0032dfb840'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:20.262133 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a3a2a8c2-0dc4-4fe7-a9fe-7f0032dfb840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf08c8828da4164b7a2d76cd96f35c7', 'request_id': 'req-a3a2a8c2-0dc4-4fe7-a9fe-7f0032dfb840'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:20.274169 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a3a2a8c2-0dc4-4fe7-a9fe-7f0032dfb840 admin admin] The token cache is being invalidate because project ccf08c8828da4164b7a2d76cd96f35c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:21:20.274461 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a3a2a8c2-0dc4-4fe7-a9fe-7f0032dfb840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:20.275120 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-a3a2a8c2-0dc4-4fe7-a9fe-7f0032dfb840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:20.276909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1351/2721] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:21:20 2022] DELETE /identity/v3/projects/ccf08c8828da4164b7a2d76cd96f35c7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:21:20.282649 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaad44f-c7bc-41ad-8737-bb5757cbd6bb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:20.282941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaad44f-c7bc-41ad-8737-bb5757cbd6bb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:20.283219 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaad44f-c7bc-41ad-8737-bb5757cbd6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:20.307210 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cfaad44f-c7bc-41ad-8737-bb5757cbd6bb None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:20.308961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cfaad44f-c7bc-41ad-8737-bb5757cbd6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:20.372811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1371/2722] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:21:20.380633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454a0b7-e3bd-401d-b57b-e4fb74909f58 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:20.380928 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454a0b7-e3bd-401d-b57b-e4fb74909f58 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:20.381208 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454a0b7-e3bd-401d-b57b-e4fb74909f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:20.402293 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-8454a0b7-e3bd-401d-b57b-e4fb74909f58 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:20.403751 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-8454a0b7-e3bd-401d-b57b-e4fb74909f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:20.412227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1352/2723] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:20.417074 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaad44f-c7bc-41ad-8737-bb5757cbd6bb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:20.427192 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaad44f-c7bc-41ad-8737-bb5757cbd6bb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:20.431789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefb395-d91a-4e8a-8a92-109660bd875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:20.432438 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefb395-d91a-4e8a-8a92-109660bd875a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:20.432726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefb395-d91a-4e8a-8a92-109660bd875a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:20.433004 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefb395-d91a-4e8a-8a92-109660bd875a admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:20.433759 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefb395-d91a-4e8a-8a92-109660bd875a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:21:20.434124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefb395-d91a-4e8a-8a92-109660bd875a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:20.435861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefb395-d91a-4e8a-8a92-109660bd875a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:20.450038 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1372/2724] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:21:20.454535 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454a0b7-e3bd-401d-b57b-e4fb74909f58 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:20.464357 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454a0b7-e3bd-401d-b57b-e4fb74909f58 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:20.469267 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ca20e-8fe2-4719-a63e-b875d998bb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:20.469976 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ca20e-8fe2-4719-a63e-b875d998bb95 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:20.470237 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ca20e-8fe2-4719-a63e-b875d998bb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:20.470603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ca20e-8fe2-4719-a63e-b875d998bb95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:20.471382 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ca20e-8fe2-4719-a63e-b875d998bb95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:20.473453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ca20e-8fe2-4719-a63e-b875d998bb95 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:20.490312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:20.510681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1353/2725] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:21:20 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:21:20.511792 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefb395-d91a-4e8a-8a92-109660bd875a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:20.512197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ca20e-8fe2-4719-a63e-b875d998bb95 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:20.513783 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-e26ca20e-8fe2-4719-a63e-b875d998bb95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:20.521870 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefb395-d91a-4e8a-8a92-109660bd875a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:20.547083 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:20.572009 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ca20e-8fe2-4719-a63e-b875d998bb95 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:20.575716 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b4ccf-feed-44c6-9edd-31ff2bb04049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:20.576384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b4ccf-feed-44c6-9edd-31ff2bb04049 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:20.576647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b4ccf-feed-44c6-9edd-31ff2bb04049 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:20.576922 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b4ccf-feed-44c6-9edd-31ff2bb04049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:20.578726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-dd2b4ccf-feed-44c6-9edd-31ff2bb04049 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:20.581246 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b789e-ab11-48b7-94f5-b4fec38f5d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:20.581912 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b789e-ab11-48b7-94f5-b4fec38f5d92 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:20.582224 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b789e-ab11-48b7-94f5-b4fec38f5d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:20.582496 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b789e-ab11-48b7-94f5-b4fec38f5d92 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:20.583185 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b789e-ab11-48b7-94f5-b4fec38f5d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:20.585654 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b789e-ab11-48b7-94f5-b4fec38f5d92 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:20.610592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1373/2726] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:21:20 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:21:20.611633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b789e-ab11-48b7-94f5-b4fec38f5d92 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:20.621078 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b789e-ab11-48b7-94f5-b4fec38f5d92 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:20.625755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6f293-b870-46d6-96b9-e1d180768b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:20.626429 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6f293-b870-46d6-96b9-e1d180768b55 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:20.626710 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6f293-b870-46d6-96b9-e1d180768b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:20.626983 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6f293-b870-46d6-96b9-e1d180768b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:20.627693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6f293-b870-46d6-96b9-e1d180768b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:20.629352 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6f293-b870-46d6-96b9-e1d180768b55 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:20.639368 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1374/2727] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:21:20.642968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6f293-b870-46d6-96b9-e1d180768b55 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:20.643385 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b4ccf-feed-44c6-9edd-31ff2bb04049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:20.644820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b4ccf-feed-44c6-9edd-31ff2bb04049 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:20.654413 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6f293-b870-46d6-96b9-e1d180768b55 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:20.655838 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1354/2728] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:21:20.664800 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525ff81-b6d7-4fd1-bd68-94e589491f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:20.666099 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525ff81-b6d7-4fd1-bd68-94e589491f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:20.666488 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525ff81-b6d7-4fd1-bd68-94e589491f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:20.666869 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525ff81-b6d7-4fd1-bd68-94e589491f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:20.667845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525ff81-b6d7-4fd1-bd68-94e589491f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:20.671171 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525ff81-b6d7-4fd1-bd68-94e589491f09 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:20.681735 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1375/2729] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:21:20.686768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b4ccf-feed-44c6-9edd-31ff2bb04049 service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:20.702460 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b4ccf-feed-44c6-9edd-31ff2bb04049 service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:20.710181 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cf6f4-6266-4b64-9fff-71a68c4948cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:20.710386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cf6f4-6266-4b64-9fff-71a68c4948cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:20.710669 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cf6f4-6266-4b64-9fff-71a68c4948cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:20.710940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cf6f4-6266-4b64-9fff-71a68c4948cc admin admin] PATH_INFO: `/v3/projects/34336c91ae0840bd867cecb1a0363010/users/7861039642d34648b18a50a77face5bb/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:20.734381 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cf6f4-6266-4b64-9fff-71a68c4948cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=34336c91ae0840bd867cecb1a0363010, user_id=7861039642d34648b18a50a77face5bb, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:20.737479 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cf6f4-6266-4b64-9fff-71a68c4948cc admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:20.752465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1355/2730] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:21:20 2022] PUT /identity/v3/projects/34336c91ae0840bd867cecb1a0363010/users/7861039642d34648b18a50a77face5bb/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:21:20.820559 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f9948-fbd6-4e7a-ba62-e55b077c5c70 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:20.821182 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f9948-fbd6-4e7a-ba62-e55b077c5c70 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:20.821182 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f9948-fbd6-4e7a-ba62-e55b077c5c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:20.849876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-511f9948-fbd6-4e7a-ba62-e55b077c5c70 None None] MFA Rules not processed for user `7861039642d34648b18a50a77face5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:20.851131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-511f9948-fbd6-4e7a-ba62-e55b077c5c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:20.918342 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1376/2731] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:20.929468 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cf6f4-6266-4b64-9fff-71a68c4948cc admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:20.985021 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cf6f4-6266-4b64-9fff-71a68c4948cc admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:20.988700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa9365-9b30-4a3a-ba6b-48fd9ffb09c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:20.989374 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa9365-9b30-4a3a-ba6b-48fd9ffb09c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:20.989662 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa9365-9b30-4a3a-ba6b-48fd9ffb09c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:20.989938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa9365-9b30-4a3a-ba6b-48fd9ffb09c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:20.998321 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa9365-9b30-4a3a-ba6b-48fd9ffb09c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:20.999753 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa9365-9b30-4a3a-ba6b-48fd9ffb09c6 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:21.009126 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1356/2732] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:21:21.034536 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f9948-fbd6-4e7a-ba62-e55b077c5c70 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:21.095862 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f9948-fbd6-4e7a-ba62-e55b077c5c70 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:21.100403 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f67524-fcec-490a-8729-dc8674e41c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:21.101255 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f67524-fcec-490a-8729-dc8674e41c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:21.101534 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f67524-fcec-490a-8729-dc8674e41c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:21.101804 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f67524-fcec-490a-8729-dc8674e41c5d admin admin] PATH_INFO: `/v3/users/7861039642d34648b18a50a77face5bb` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:21.103032 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f67524-fcec-490a-8729-dc8674e41c5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7861039642d34648b18a50a77face5bb)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:21.104981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f67524-fcec-490a-8729-dc8674e41c5d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:21.132479 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:21.151350 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d7f67524-fcec-490a-8729-dc8674e41c5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7861039642d34648b18a50a77face5bb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:21.151945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d7f67524-fcec-490a-8729-dc8674e41c5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7861039642d34648b18a50a77face5bb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:21.152560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d7f67524-fcec-490a-8729-dc8674e41c5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7861039642d34648b18a50a77face5bb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:21.164243 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d7f67524-fcec-490a-8729-dc8674e41c5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7861039642d34648b18a50a77face5bb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:21.171084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d7f67524-fcec-490a-8729-dc8674e41c5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7861039642d34648b18a50a77face5bb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:21.184055 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1377/2733] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:21:21 2022] DELETE /identity/v3/users/7861039642d34648b18a50a77face5bb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:21.188545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76441a7-2aab-48e3-af81-871e3245f06e None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:21.188834 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76441a7-2aab-48e3-af81-871e3245f06e None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:21.189113 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76441a7-2aab-48e3-af81-871e3245f06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:21.208709 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-d76441a7-2aab-48e3-af81-871e3245f06e None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:21.209933 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d76441a7-2aab-48e3-af81-871e3245f06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:21.225980 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:21.268652 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1357/2734] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:21.278747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f67524-fcec-490a-8729-dc8674e41c5d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:21.280231 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d7f67524-fcec-490a-8729-dc8674e41c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:21.337369 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f67524-fcec-490a-8729-dc8674e41c5d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:21.341054 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a17ce-f33a-4279-9414-fc0045117bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:21.341694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a17ce-f33a-4279-9414-fc0045117bbb service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:21.341980 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a17ce-f33a-4279-9414-fc0045117bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:21.342289 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a17ce-f33a-4279-9414-fc0045117bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:21.351246 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a17ce-f33a-4279-9414-fc0045117bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:21.352685 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a17ce-f33a-4279-9414-fc0045117bbb service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:21.362272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1378/2735] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:21:21.622484 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76441a7-2aab-48e3-af81-871e3245f06e None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:21.623952 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d76441a7-2aab-48e3-af81-871e3245f06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:21.636666 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76441a7-2aab-48e3-af81-871e3245f06e None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:21.641391 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1da62f-b40a-4f10-b5f7-b389cde5969c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:21.642295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1da62f-b40a-4f10-b5f7-b389cde5969c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:21.642583 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1da62f-b40a-4f10-b5f7-b389cde5969c admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:21.642877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1da62f-b40a-4f10-b5f7-b389cde5969c admin admin] PATH_INFO: `/v3/projects/34336c91ae0840bd867cecb1a0363010` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:21.644067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1da62f-b40a-4f10-b5f7-b389cde5969c admin admin] RBAC: Authorizing `identity:delete_project(project_id=34336c91ae0840bd867cecb1a0363010)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:21.646035 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1da62f-b40a-4f10-b5f7-b389cde5969c admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:21.692765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-fc1da62f-b40a-4f10-b5f7-b389cde5969c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34336c91ae0840bd867cecb1a0363010', 'request_id': 'req-fc1da62f-b40a-4f10-b5f7-b389cde5969c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:21.701241 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-fc1da62f-b40a-4f10-b5f7-b389cde5969c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34336c91ae0840bd867cecb1a0363010', 'request_id': 'req-fc1da62f-b40a-4f10-b5f7-b389cde5969c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:21.707061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-fc1da62f-b40a-4f10-b5f7-b389cde5969c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34336c91ae0840bd867cecb1a0363010', 'request_id': 'req-fc1da62f-b40a-4f10-b5f7-b389cde5969c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:21.718347 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-fc1da62f-b40a-4f10-b5f7-b389cde5969c admin admin] The token cache is being invalidate because project 34336c91ae0840bd867cecb1a0363010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:21:21.718631 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-fc1da62f-b40a-4f10-b5f7-b389cde5969c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:21.719252 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-fc1da62f-b40a-4f10-b5f7-b389cde5969c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:21.720764 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1358/2736] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:21:21 2022] DELETE /identity/v3/projects/34336c91ae0840bd867cecb1a0363010 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:24.518872 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a17ce-f33a-4279-9414-fc0045117bbb service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:24.520273 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0d6a17ce-f33a-4279-9414-fc0045117bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:24.532805 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a17ce-f33a-4279-9414-fc0045117bbb service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:24.587239 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb01b29-6f4e-4056-990c-8c5c9ac735ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:24.588101 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb01b29-6f4e-4056-990c-8c5c9ac735ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:24.588380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb01b29-6f4e-4056-990c-8c5c9ac735ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:24.588650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb01b29-6f4e-4056-990c-8c5c9ac735ec admin admin] PATH_INFO: `/v3/users/3ea42274d93d41419def10fe05e4bab1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:24.589841 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb01b29-6f4e-4056-990c-8c5c9ac735ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ea42274d93d41419def10fe05e4bab1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:24.591797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb01b29-6f4e-4056-990c-8c5c9ac735ec admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:24.636827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-eeb01b29-6f4e-4056-990c-8c5c9ac735ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ea42274d93d41419def10fe05e4bab1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:24.637455 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-eeb01b29-6f4e-4056-990c-8c5c9ac735ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ea42274d93d41419def10fe05e4bab1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:24.638077 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-eeb01b29-6f4e-4056-990c-8c5c9ac735ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ea42274d93d41419def10fe05e4bab1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:24.639160 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:24.652772 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-eeb01b29-6f4e-4056-990c-8c5c9ac735ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ea42274d93d41419def10fe05e4bab1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:24.659639 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-eeb01b29-6f4e-4056-990c-8c5c9ac735ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ea42274d93d41419def10fe05e4bab1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:24.672182 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1379/2737] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:21:24 2022] DELETE /identity/v3/users/3ea42274d93d41419def10fe05e4bab1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:24.676678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d449a-43b5-4529-9f85-f7a99cc45ee0 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:24.677153 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d449a-43b5-4529-9f85-f7a99cc45ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:24.677264 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d449a-43b5-4529-9f85-f7a99cc45ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:24.696869 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-963d449a-43b5-4529-9f85-f7a99cc45ee0 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:24.698110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-963d449a-43b5-4529-9f85-f7a99cc45ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:24.761098 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1359/2738] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:24.770660 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb01b29-6f4e-4056-990c-8c5c9ac735ec admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:24.772039 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-eeb01b29-6f4e-4056-990c-8c5c9ac735ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:24.827285 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb01b29-6f4e-4056-990c-8c5c9ac735ec admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:24.830893 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf74713-d6ae-4f72-850f-cf4dff6db4b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:24.831528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf74713-d6ae-4f72-850f-cf4dff6db4b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:24.831808 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf74713-d6ae-4f72-850f-cf4dff6db4b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:24.832082 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf74713-d6ae-4f72-850f-cf4dff6db4b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:24.841610 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf74713-d6ae-4f72-850f-cf4dff6db4b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:24.843065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf74713-d6ae-4f72-850f-cf4dff6db4b7 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:24.852318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1380/2739] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:21:25.123266 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d449a-43b5-4529-9f85-f7a99cc45ee0 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:25.124773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-963d449a-43b5-4529-9f85-f7a99cc45ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:25.137466 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d449a-43b5-4529-9f85-f7a99cc45ee0 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:25.142189 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c8eb6-34ef-4a38-84d5-4e738e291396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:25.143050 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c8eb6-34ef-4a38-84d5-4e738e291396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:25.143334 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c8eb6-34ef-4a38-84d5-4e738e291396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:25.143607 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c8eb6-34ef-4a38-84d5-4e738e291396 admin admin] PATH_INFO: `/v3/projects/faafa5d2ad4846ffa21372a4e7c4baa6` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:25.144853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c8eb6-34ef-4a38-84d5-4e738e291396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faafa5d2ad4846ffa21372a4e7c4baa6)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:25.146809 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c8eb6-34ef-4a38-84d5-4e738e291396 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:25.188261 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:25.196897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-fe6c8eb6-34ef-4a38-84d5-4e738e291396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faafa5d2ad4846ffa21372a4e7c4baa6', 'request_id': 'req-fe6c8eb6-34ef-4a38-84d5-4e738e291396'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.204278 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-fe6c8eb6-34ef-4a38-84d5-4e738e291396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faafa5d2ad4846ffa21372a4e7c4baa6', 'request_id': 'req-fe6c8eb6-34ef-4a38-84d5-4e738e291396'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.210123 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-fe6c8eb6-34ef-4a38-84d5-4e738e291396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faafa5d2ad4846ffa21372a4e7c4baa6', 'request_id': 'req-fe6c8eb6-34ef-4a38-84d5-4e738e291396'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.221236 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-fe6c8eb6-34ef-4a38-84d5-4e738e291396 admin admin] The token cache is being invalidate because project faafa5d2ad4846ffa21372a4e7c4baa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:21:25.221521 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-fe6c8eb6-34ef-4a38-84d5-4e738e291396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.222190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-fe6c8eb6-34ef-4a38-84d5-4e738e291396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.223720 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1360/2740] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:21:25 2022] DELETE /identity/v3/projects/faafa5d2ad4846ffa21372a4e7c4baa6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:25.228254 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf74713-d6ae-4f72-850f-cf4dff6db4b7 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:25.237979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf74713-d6ae-4f72-850f-cf4dff6db4b7 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:25.293791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70b53f-febb-4b9a-8a36-7024a95802d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:25.294711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70b53f-febb-4b9a-8a36-7024a95802d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:25.295003 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70b53f-febb-4b9a-8a36-7024a95802d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:25.295284 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70b53f-febb-4b9a-8a36-7024a95802d8 admin admin] PATH_INFO: `/v3/users/54e395bf85154e479a85fcc9b6335af7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:25.296471 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70b53f-febb-4b9a-8a36-7024a95802d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e395bf85154e479a85fcc9b6335af7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:25.298527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70b53f-febb-4b9a-8a36-7024a95802d8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:25.342963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ca70b53f-febb-4b9a-8a36-7024a95802d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e395bf85154e479a85fcc9b6335af7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.343605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ca70b53f-febb-4b9a-8a36-7024a95802d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e395bf85154e479a85fcc9b6335af7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.344201 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ca70b53f-febb-4b9a-8a36-7024a95802d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e395bf85154e479a85fcc9b6335af7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.356165 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ca70b53f-febb-4b9a-8a36-7024a95802d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e395bf85154e479a85fcc9b6335af7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.359636 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:25.363511 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ca70b53f-febb-4b9a-8a36-7024a95802d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e395bf85154e479a85fcc9b6335af7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.378453 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1381/2741] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:21:25 2022] DELETE /identity/v3/users/54e395bf85154e479a85fcc9b6335af7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:25.645071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c8eb6-34ef-4a38-84d5-4e738e291396 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:25.646660 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-fe6c8eb6-34ef-4a38-84d5-4e738e291396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:25.660302 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c8eb6-34ef-4a38-84d5-4e738e291396 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:25.716810 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d0ba9-bb0e-420a-835c-af3053ce31a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:25.717682 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d0ba9-bb0e-420a-835c-af3053ce31a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:25.717988 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d0ba9-bb0e-420a-835c-af3053ce31a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:25.718277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d0ba9-bb0e-420a-835c-af3053ce31a4 admin admin] PATH_INFO: `/v3/projects/5f122d555603439f9d7e7ec862b4a143` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:25.719591 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d0ba9-bb0e-420a-835c-af3053ce31a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f122d555603439f9d7e7ec862b4a143)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:25.721498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d0ba9-bb0e-420a-835c-af3053ce31a4 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:25.767524 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-1d4d0ba9-bb0e-420a-835c-af3053ce31a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f122d555603439f9d7e7ec862b4a143', 'request_id': 'req-1d4d0ba9-bb0e-420a-835c-af3053ce31a4'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.776175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-1d4d0ba9-bb0e-420a-835c-af3053ce31a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f122d555603439f9d7e7ec862b4a143', 'request_id': 'req-1d4d0ba9-bb0e-420a-835c-af3053ce31a4'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.781767 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-1d4d0ba9-bb0e-420a-835c-af3053ce31a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f122d555603439f9d7e7ec862b4a143', 'request_id': 'req-1d4d0ba9-bb0e-420a-835c-af3053ce31a4'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.793205 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-1d4d0ba9-bb0e-420a-835c-af3053ce31a4 admin admin] The token cache is being invalidate because project 5f122d555603439f9d7e7ec862b4a143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:21:25.793498 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-1d4d0ba9-bb0e-420a-835c-af3053ce31a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.794160 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-1d4d0ba9-bb0e-420a-835c-af3053ce31a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.795690 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1361/2742] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:21:25 2022] DELETE /identity/v3/projects/5f122d555603439f9d7e7ec862b4a143 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:25.799764 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70b53f-febb-4b9a-8a36-7024a95802d8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:25.801320 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ca70b53f-febb-4b9a-8a36-7024a95802d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:25.814065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70b53f-febb-4b9a-8a36-7024a95802d8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:25.869461 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b52a3f-3f68-4a0e-ae85-7185384e6c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:25.870295 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b52a3f-3f68-4a0e-ae85-7185384e6c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:25.870580 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b52a3f-3f68-4a0e-ae85-7185384e6c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:25.870856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b52a3f-3f68-4a0e-ae85-7185384e6c8a admin admin] PATH_INFO: `/v3/users/247890492bc54583b85730ac7a7221bd` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:25.872047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b52a3f-3f68-4a0e-ae85-7185384e6c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=247890492bc54583b85730ac7a7221bd)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:25.873965 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b52a3f-3f68-4a0e-ae85-7185384e6c8a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:25.917550 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-35b52a3f-3f68-4a0e-ae85-7185384e6c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247890492bc54583b85730ac7a7221bd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.918215 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-35b52a3f-3f68-4a0e-ae85-7185384e6c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247890492bc54583b85730ac7a7221bd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.918821 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-35b52a3f-3f68-4a0e-ae85-7185384e6c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247890492bc54583b85730ac7a7221bd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.930675 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-35b52a3f-3f68-4a0e-ae85-7185384e6c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247890492bc54583b85730ac7a7221bd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.937726 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-35b52a3f-3f68-4a0e-ae85-7185384e6c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247890492bc54583b85730ac7a7221bd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:25.950506 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1382/2743] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:21:25 2022] DELETE /identity/v3/users/247890492bc54583b85730ac7a7221bd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:26.217644 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d0ba9-bb0e-420a-835c-af3053ce31a4 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:26.219229 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-1d4d0ba9-bb0e-420a-835c-af3053ce31a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:26.231658 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d0ba9-bb0e-420a-835c-af3053ce31a4 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:26.291216 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ad572-f474-4e82-9a19-50ab0a634fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:26.292070 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ad572-f474-4e82-9a19-50ab0a634fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:26.292349 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ad572-f474-4e82-9a19-50ab0a634fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:26.292626 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ad572-f474-4e82-9a19-50ab0a634fe3 admin admin] PATH_INFO: `/v3/projects/eb6fb336758b4abda57ed845f4c4b3c6` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:26.293815 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ad572-f474-4e82-9a19-50ab0a634fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb6fb336758b4abda57ed845f4c4b3c6)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:26.295750 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ad572-f474-4e82-9a19-50ab0a634fe3 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:26.297168 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:26.342938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-995ad572-f474-4e82-9a19-50ab0a634fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb6fb336758b4abda57ed845f4c4b3c6', 'request_id': 'req-995ad572-f474-4e82-9a19-50ab0a634fe3'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:26.349708 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-995ad572-f474-4e82-9a19-50ab0a634fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb6fb336758b4abda57ed845f4c4b3c6', 'request_id': 'req-995ad572-f474-4e82-9a19-50ab0a634fe3'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:26.355185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-995ad572-f474-4e82-9a19-50ab0a634fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb6fb336758b4abda57ed845f4c4b3c6', 'request_id': 'req-995ad572-f474-4e82-9a19-50ab0a634fe3'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:26.365823 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-995ad572-f474-4e82-9a19-50ab0a634fe3 admin admin] The token cache is being invalidate because project eb6fb336758b4abda57ed845f4c4b3c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:21:26.366160 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-995ad572-f474-4e82-9a19-50ab0a634fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:26.367277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-995ad572-f474-4e82-9a19-50ab0a634fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:26.368802 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1362/2744] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:21:26 2022] DELETE /identity/v3/projects/eb6fb336758b4abda57ed845f4c4b3c6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:26.373693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7d4b8-d751-4066-a896-71dffaf5d503 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:26.373987 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7d4b8-d751-4066-a896-71dffaf5d503 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:26.374313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7d4b8-d751-4066-a896-71dffaf5d503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:26.394314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3bb7d4b8-d751-4066-a896-71dffaf5d503 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:26.395459 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3bb7d4b8-d751-4066-a896-71dffaf5d503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:26.454633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1383/2745] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:26.463062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70462a-637f-4712-865f-37204eb53ea3 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:26.463349 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70462a-637f-4712-865f-37204eb53ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:26.463623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70462a-637f-4712-865f-37204eb53ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:26.483531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-2a70462a-637f-4712-865f-37204eb53ea3 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:26.484718 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-2a70462a-637f-4712-865f-37204eb53ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:26.492924 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1363/2746] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:26.497153 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7d4b8-d751-4066-a896-71dffaf5d503 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:26.506755 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7d4b8-d751-4066-a896-71dffaf5d503 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:26.511344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5811dec-8465-4c5f-afa0-51a97f20e319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:26.511990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5811dec-8465-4c5f-afa0-51a97f20e319 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:26.512274 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5811dec-8465-4c5f-afa0-51a97f20e319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:26.512548 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5811dec-8465-4c5f-afa0-51a97f20e319 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:26.513269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5811dec-8465-4c5f-afa0-51a97f20e319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:21:26.513574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5811dec-8465-4c5f-afa0-51a97f20e319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:26.515202 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5811dec-8465-4c5f-afa0-51a97f20e319 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:26.516638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:26.530034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1384/2747] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:21:26.533715 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70462a-637f-4712-865f-37204eb53ea3 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:26.543370 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70462a-637f-4712-865f-37204eb53ea3 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:26.547997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22be686-2569-4fbf-a93d-60a12efce0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:26.548635 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22be686-2569-4fbf-a93d-60a12efce0af admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:26.548915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22be686-2569-4fbf-a93d-60a12efce0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:26.549188 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22be686-2569-4fbf-a93d-60a12efce0af admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:26.549867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22be686-2569-4fbf-a93d-60a12efce0af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:26.551768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22be686-2569-4fbf-a93d-60a12efce0af admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:26.577356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1364/2748] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:21:26 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:21:26.581330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5811dec-8465-4c5f-afa0-51a97f20e319 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:26.591594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5811dec-8465-4c5f-afa0-51a97f20e319 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:26.646063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4247eed-735b-46d9-90e8-a5636f2a884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:26.646801 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4247eed-735b-46d9-90e8-a5636f2a884a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:26.647085 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4247eed-735b-46d9-90e8-a5636f2a884a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:26.647356 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4247eed-735b-46d9-90e8-a5636f2a884a admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:26.648554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4247eed-735b-46d9-90e8-a5636f2a884a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:26.650560 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4247eed-735b-46d9-90e8-a5636f2a884a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:26.674523 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1385/2749] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:21:26 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:21:26.675678 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22be686-2569-4fbf-a93d-60a12efce0af admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:26.685940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22be686-2569-4fbf-a93d-60a12efce0af admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:26.690810 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37682a43-5831-4182-8a6f-8bb5dd219a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:26.691459 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37682a43-5831-4182-8a6f-8bb5dd219a2a admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:26.691743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37682a43-5831-4182-8a6f-8bb5dd219a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:26.692019 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37682a43-5831-4182-8a6f-8bb5dd219a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:26.692748 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37682a43-5831-4182-8a6f-8bb5dd219a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:26.694372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37682a43-5831-4182-8a6f-8bb5dd219a2a admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:26.704700 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1365/2750] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:21:26.708390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4247eed-735b-46d9-90e8-a5636f2a884a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:26.719251 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4247eed-735b-46d9-90e8-a5636f2a884a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:26.724184 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912e4a9-69ce-44cb-9224-d2e23a73dd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:26.724843 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912e4a9-69ce-44cb-9224-d2e23a73dd81 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:26.725127 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912e4a9-69ce-44cb-9224-d2e23a73dd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:26.725404 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912e4a9-69ce-44cb-9224-d2e23a73dd81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:26.726664 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912e4a9-69ce-44cb-9224-d2e23a73dd81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:26.728256 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912e4a9-69ce-44cb-9224-d2e23a73dd81 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:26.738833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1386/2751] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:21:26.743409 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37682a43-5831-4182-8a6f-8bb5dd219a2a admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:26.753424 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37682a43-5831-4182-8a6f-8bb5dd219a2a admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:26.758031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf3d9c-332e-40b9-8859-5819558b7a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:26.758904 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf3d9c-332e-40b9-8859-5819558b7a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:26.759185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf3d9c-332e-40b9-8859-5819558b7a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:26.759456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf3d9c-332e-40b9-8859-5819558b7a23 admin admin] PATH_INFO: `/v3/projects/93e208650523408db2f3d7d62e673d2c/users/183589ad7ced44cda9d8753e190de684/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:26.774436 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf3d9c-332e-40b9-8859-5819558b7a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e208650523408db2f3d7d62e673d2c, user_id=183589ad7ced44cda9d8753e190de684, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:26.777185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf3d9c-332e-40b9-8859-5819558b7a23 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:26.790909 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1366/2752] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:21:26 2022] PUT /identity/v3/projects/93e208650523408db2f3d7d62e673d2c/users/183589ad7ced44cda9d8753e190de684/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:26.801361 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9abd9-9628-4fd1-9e1e-482979c1974d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:26.801868 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9abd9-9628-4fd1-9e1e-482979c1974d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:26.801970 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9abd9-9628-4fd1-9e1e-482979c1974d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:26.829635 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-00f9abd9-9628-4fd1-9e1e-482979c1974d None None] MFA Rules not processed for user `183589ad7ced44cda9d8753e190de684`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:26.830858 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-00f9abd9-9628-4fd1-9e1e-482979c1974d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:26.893116 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1387/2753] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:26.904178 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf3d9c-332e-40b9-8859-5819558b7a23 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:26.905978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-22cf3d9c-332e-40b9-8859-5819558b7a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:26.962873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf3d9c-332e-40b9-8859-5819558b7a23 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:26.966553 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3faed2-f902-4137-984d-ff81978dd4a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:26.967191 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3faed2-f902-4137-984d-ff81978dd4a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:26.967476 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3faed2-f902-4137-984d-ff81978dd4a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:26.967756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3faed2-f902-4137-984d-ff81978dd4a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:26.977014 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3faed2-f902-4137-984d-ff81978dd4a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:26.978463 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3faed2-f902-4137-984d-ff81978dd4a8 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:26.987276 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1367/2754] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:21:29.516297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9abd9-9628-4fd1-9e1e-482979c1974d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:29.577022 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9abd9-9628-4fd1-9e1e-482979c1974d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:29.581521 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f219135-e8d2-4298-8dc0-75294bca5b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:29.582405 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f219135-e8d2-4298-8dc0-75294bca5b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:29.582685 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f219135-e8d2-4298-8dc0-75294bca5b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:29.582953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f219135-e8d2-4298-8dc0-75294bca5b88 admin admin] PATH_INFO: `/v3/users/183589ad7ced44cda9d8753e190de684` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:29.584127 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f219135-e8d2-4298-8dc0-75294bca5b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=183589ad7ced44cda9d8753e190de684)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:29.586084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f219135-e8d2-4298-8dc0-75294bca5b88 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:29.588275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:29.631153 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4f219135-e8d2-4298-8dc0-75294bca5b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '183589ad7ced44cda9d8753e190de684'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:29.631783 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4f219135-e8d2-4298-8dc0-75294bca5b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '183589ad7ced44cda9d8753e190de684'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:29.632992 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4f219135-e8d2-4298-8dc0-75294bca5b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '183589ad7ced44cda9d8753e190de684'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:29.644343 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4f219135-e8d2-4298-8dc0-75294bca5b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '183589ad7ced44cda9d8753e190de684'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:29.651019 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4f219135-e8d2-4298-8dc0-75294bca5b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '183589ad7ced44cda9d8753e190de684'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:29.662695 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1388/2755] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:21:29 2022] DELETE /identity/v3/users/183589ad7ced44cda9d8753e190de684 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:29.667187 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aed3a1-e799-4b25-8071-42c77a3f67bc None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:29.667666 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aed3a1-e799-4b25-8071-42c77a3f67bc None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:29.667760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aed3a1-e799-4b25-8071-42c77a3f67bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:29.687011 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-d6aed3a1-e799-4b25-8071-42c77a3f67bc None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:29.688209 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d6aed3a1-e799-4b25-8071-42c77a3f67bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:29.711480 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:29.747618 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1368/2756] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:29.757366 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f219135-e8d2-4298-8dc0-75294bca5b88 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:29.758848 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4f219135-e8d2-4298-8dc0-75294bca5b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:29.817142 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f219135-e8d2-4298-8dc0-75294bca5b88 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:29.820876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8f48f-2f3d-431f-b90d-34c8964b1682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:29.821525 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8f48f-2f3d-431f-b90d-34c8964b1682 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:29.821812 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8f48f-2f3d-431f-b90d-34c8964b1682 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:29.822130 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8f48f-2f3d-431f-b90d-34c8964b1682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:29.831275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8f48f-2f3d-431f-b90d-34c8964b1682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:29.832711 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8f48f-2f3d-431f-b90d-34c8964b1682 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:29.842202 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1389/2757] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:21:30.109576 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aed3a1-e799-4b25-8071-42c77a3f67bc None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:30.110654 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d6aed3a1-e799-4b25-8071-42c77a3f67bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:30.123749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aed3a1-e799-4b25-8071-42c77a3f67bc None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:30.128409 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904a055-502c-48fc-8efb-2fb45f7abb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:30.129282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904a055-502c-48fc-8efb-2fb45f7abb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:30.129904 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904a055-502c-48fc-8efb-2fb45f7abb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:30.129904 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904a055-502c-48fc-8efb-2fb45f7abb68 admin admin] PATH_INFO: `/v3/projects/93e208650523408db2f3d7d62e673d2c` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:30.131080 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904a055-502c-48fc-8efb-2fb45f7abb68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93e208650523408db2f3d7d62e673d2c)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:30.133605 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904a055-502c-48fc-8efb-2fb45f7abb68 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:30.179914 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e904a055-502c-48fc-8efb-2fb45f7abb68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93e208650523408db2f3d7d62e673d2c', 'request_id': 'req-e904a055-502c-48fc-8efb-2fb45f7abb68'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:30.186702 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e904a055-502c-48fc-8efb-2fb45f7abb68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93e208650523408db2f3d7d62e673d2c', 'request_id': 'req-e904a055-502c-48fc-8efb-2fb45f7abb68'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:30.192695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e904a055-502c-48fc-8efb-2fb45f7abb68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93e208650523408db2f3d7d62e673d2c', 'request_id': 'req-e904a055-502c-48fc-8efb-2fb45f7abb68'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:30.204330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e904a055-502c-48fc-8efb-2fb45f7abb68 admin admin] The token cache is being invalidate because project 93e208650523408db2f3d7d62e673d2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:21:30.204605 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e904a055-502c-48fc-8efb-2fb45f7abb68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:30.205235 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e904a055-502c-48fc-8efb-2fb45f7abb68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:30.206793 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1369/2758] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:21:30 2022] DELETE /identity/v3/projects/93e208650523408db2f3d7d62e673d2c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:30.212236 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1756f-b76a-4faa-865c-bc99486f89e6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:30.212530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1756f-b76a-4faa-865c-bc99486f89e6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:30.212810 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1756f-b76a-4faa-865c-bc99486f89e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:30.232247 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-def1756f-b76a-4faa-865c-bc99486f89e6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:30.233454 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-def1756f-b76a-4faa-865c-bc99486f89e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:30.291747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1390/2759] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:30.299161 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897c5e7-df20-46af-a8cf-741c103a6290 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:30.299449 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897c5e7-df20-46af-a8cf-741c103a6290 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:30.299726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897c5e7-df20-46af-a8cf-741c103a6290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:30.319411 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-b897c5e7-df20-46af-a8cf-741c103a6290 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:30.320643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-b897c5e7-df20-46af-a8cf-741c103a6290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:30.328554 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1370/2760] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:30.332830 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1756f-b76a-4faa-865c-bc99486f89e6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:30.342994 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1756f-b76a-4faa-865c-bc99486f89e6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:30.347541 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4ed87-dcb9-4405-8e92-a18eeafe1514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:30.348190 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4ed87-dcb9-4405-8e92-a18eeafe1514 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:30.348472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4ed87-dcb9-4405-8e92-a18eeafe1514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:30.348748 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4ed87-dcb9-4405-8e92-a18eeafe1514 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:30.349467 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4ed87-dcb9-4405-8e92-a18eeafe1514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:21:30.349770 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4ed87-dcb9-4405-8e92-a18eeafe1514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:30.352024 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4ed87-dcb9-4405-8e92-a18eeafe1514 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:30.363318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1391/2761] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:21:30.367434 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897c5e7-df20-46af-a8cf-741c103a6290 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:30.376619 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897c5e7-df20-46af-a8cf-741c103a6290 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:30.381232 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbe105-7a6b-4634-86d4-1f39e3adb1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:30.381870 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbe105-7a6b-4634-86d4-1f39e3adb1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:30.382190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbe105-7a6b-4634-86d4-1f39e3adb1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:30.382465 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbe105-7a6b-4634-86d4-1f39e3adb1d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:30.383158 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbe105-7a6b-4634-86d4-1f39e3adb1d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:30.385028 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbe105-7a6b-4634-86d4-1f39e3adb1d2 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:30.411826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1371/2762] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:21:30 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:21:30.416490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4ed87-dcb9-4405-8e92-a18eeafe1514 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:30.426243 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4ed87-dcb9-4405-8e92-a18eeafe1514 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:30.433758 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:30.484601 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073fa8f-012d-4230-93de-10c444d4b5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:30.485277 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073fa8f-012d-4230-93de-10c444d4b5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:30.485562 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073fa8f-012d-4230-93de-10c444d4b5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:30.485845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073fa8f-012d-4230-93de-10c444d4b5c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:30.486570 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073fa8f-012d-4230-93de-10c444d4b5c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:30.488497 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073fa8f-012d-4230-93de-10c444d4b5c5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:30.509507 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1392/2763] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:21:30 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:21:30.513721 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbe105-7a6b-4634-86d4-1f39e3adb1d2 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:30.524605 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbe105-7a6b-4634-86d4-1f39e3adb1d2 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:30.529191 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a261e12-c75f-42bc-97cf-b030234db75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:30.529844 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a261e12-c75f-42bc-97cf-b030234db75f admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:30.530173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a261e12-c75f-42bc-97cf-b030234db75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:30.530448 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a261e12-c75f-42bc-97cf-b030234db75f admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:30.531167 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a261e12-c75f-42bc-97cf-b030234db75f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:30.532734 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a261e12-c75f-42bc-97cf-b030234db75f admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:30.543045 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1372/2764] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:21:30.546802 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073fa8f-012d-4230-93de-10c444d4b5c5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:30.557322 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073fa8f-012d-4230-93de-10c444d4b5c5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:30.561944 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6b6ed-de44-482b-b8c0-9e8cd7050804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:30.562637 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6b6ed-de44-482b-b8c0-9e8cd7050804 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:30.562922 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6b6ed-de44-482b-b8c0-9e8cd7050804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:30.563200 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6b6ed-de44-482b-b8c0-9e8cd7050804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:30.563925 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6b6ed-de44-482b-b8c0-9e8cd7050804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:30.565778 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6b6ed-de44-482b-b8c0-9e8cd7050804 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:30.576262 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1393/2765] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:21:30.580485 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a261e12-c75f-42bc-97cf-b030234db75f admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:30.590332 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a261e12-c75f-42bc-97cf-b030234db75f admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:30.594884 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae68c43-2708-41e2-9ba5-f58cc00ba8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:30.595752 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae68c43-2708-41e2-9ba5-f58cc00ba8a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:30.596031 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae68c43-2708-41e2-9ba5-f58cc00ba8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:30.596317 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae68c43-2708-41e2-9ba5-f58cc00ba8a5 admin admin] PATH_INFO: `/v3/projects/ce456d774ac94d979848b95cbad77661/users/e0b0803a9c0140afa890661a476cc0e2/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:30.611998 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae68c43-2708-41e2-9ba5-f58cc00ba8a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce456d774ac94d979848b95cbad77661, user_id=e0b0803a9c0140afa890661a476cc0e2, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:30.614637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae68c43-2708-41e2-9ba5-f58cc00ba8a5 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:30.627958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1373/2766] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:21:30 2022] PUT /identity/v3/projects/ce456d774ac94d979848b95cbad77661/users/e0b0803a9c0140afa890661a476cc0e2/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:30.638360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e54ba-d3dc-46b7-aeba-e03be329c714 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:30.638686 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e54ba-d3dc-46b7-aeba-e03be329c714 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:30.638967 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e54ba-d3dc-46b7-aeba-e03be329c714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:30.667544 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-726e54ba-d3dc-46b7-aeba-e03be329c714 None None] MFA Rules not processed for user `e0b0803a9c0140afa890661a476cc0e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:30.668758 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-726e54ba-d3dc-46b7-aeba-e03be329c714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:30.732068 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1394/2767] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:30 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:30.743646 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae68c43-2708-41e2-9ba5-f58cc00ba8a5 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:30.745373 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-dae68c43-2708-41e2-9ba5-f58cc00ba8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:30.798369 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:30.802518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae68c43-2708-41e2-9ba5-f58cc00ba8a5 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:30.807381 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169f226-8544-491f-ab88-85b21a79bf57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:30.808160 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169f226-8544-491f-ab88-85b21a79bf57 service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:30.808788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169f226-8544-491f-ab88-85b21a79bf57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:30.809173 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169f226-8544-491f-ab88-85b21a79bf57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:30.818065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169f226-8544-491f-ab88-85b21a79bf57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:30.819475 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169f226-8544-491f-ab88-85b21a79bf57 service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:30.828724 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1374/2768] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:30 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:21:40.729017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:40.824742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=4 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:48.178679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e54ba-d3dc-46b7-aeba-e03be329c714 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:48.180137 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-726e54ba-d3dc-46b7-aeba-e03be329c714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:48.242758 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e54ba-d3dc-46b7-aeba-e03be329c714 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:48.246823 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ea4d7-ec53-4e94-a194-bb8d01153933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:48.247472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ea4d7-ec53-4e94-a194-bb8d01153933 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:48.247759 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ea4d7-ec53-4e94-a194-bb8d01153933 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:48.248039 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ea4d7-ec53-4e94-a194-bb8d01153933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:48.249818 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1a0ea4d7-ec53-4e94-a194-bb8d01153933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:48.313814 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ea4d7-ec53-4e94-a194-bb8d01153933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:48.315380 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ea4d7-ec53-4e94-a194-bb8d01153933 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:48.325447 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1395/2769] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:21:51.554022 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169f226-8544-491f-ab88-85b21a79bf57 service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:51.555768 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6169f226-8544-491f-ab88-85b21a79bf57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:51.570169 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169f226-8544-491f-ab88-85b21a79bf57 service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:51.575318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58a3f0-f026-4bff-a514-264e57f74e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:51.576251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58a3f0-f026-4bff-a514-264e57f74e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:51.576530 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58a3f0-f026-4bff-a514-264e57f74e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:51.576864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58a3f0-f026-4bff-a514-264e57f74e88 admin admin] PATH_INFO: `/v3/users/333371fa736049e3ae21068a6bc6bd6d` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:51.578183 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58a3f0-f026-4bff-a514-264e57f74e88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=333371fa736049e3ae21068a6bc6bd6d)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:51.580105 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58a3f0-f026-4bff-a514-264e57f74e88 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:51.627268 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4d58a3f0-f026-4bff-a514-264e57f74e88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '333371fa736049e3ae21068a6bc6bd6d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:51.627937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4d58a3f0-f026-4bff-a514-264e57f74e88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '333371fa736049e3ae21068a6bc6bd6d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:51.628648 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4d58a3f0-f026-4bff-a514-264e57f74e88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '333371fa736049e3ae21068a6bc6bd6d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:51.641848 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4d58a3f0-f026-4bff-a514-264e57f74e88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '333371fa736049e3ae21068a6bc6bd6d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:51.648595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-4d58a3f0-f026-4bff-a514-264e57f74e88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '333371fa736049e3ae21068a6bc6bd6d'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:51.662245 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1375/2770] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:21:51 2022] DELETE /identity/v3/users/333371fa736049e3ae21068a6bc6bd6d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:51.843164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ea4d7-ec53-4e94-a194-bb8d01153933 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:51.853703 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ea4d7-ec53-4e94-a194-bb8d01153933 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:51.919430 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eed4e2-f3d4-45fb-b1d6-f0fe732592d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:51.920274 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eed4e2-f3d4-45fb-b1d6-f0fe732592d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:51.920558 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eed4e2-f3d4-45fb-b1d6-f0fe732592d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:51.920835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eed4e2-f3d4-45fb-b1d6-f0fe732592d2 admin admin] PATH_INFO: `/v3/projects/cfcaf6c159ea4fb88789953235ce5f67` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:51.922143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eed4e2-f3d4-45fb-b1d6-f0fe732592d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfcaf6c159ea4fb88789953235ce5f67)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:51.923961 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eed4e2-f3d4-45fb-b1d6-f0fe732592d2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:51.970656 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-12eed4e2-f3d4-45fb-b1d6-f0fe732592d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfcaf6c159ea4fb88789953235ce5f67', 'request_id': 'req-12eed4e2-f3d4-45fb-b1d6-f0fe732592d2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:51.972537 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:51.977179 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-12eed4e2-f3d4-45fb-b1d6-f0fe732592d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfcaf6c159ea4fb88789953235ce5f67', 'request_id': 'req-12eed4e2-f3d4-45fb-b1d6-f0fe732592d2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:51.984461 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-12eed4e2-f3d4-45fb-b1d6-f0fe732592d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfcaf6c159ea4fb88789953235ce5f67', 'request_id': 'req-12eed4e2-f3d4-45fb-b1d6-f0fe732592d2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:51.997440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-12eed4e2-f3d4-45fb-b1d6-f0fe732592d2 admin admin] The token cache is being invalidate because project cfcaf6c159ea4fb88789953235ce5f67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:21:51.997730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-12eed4e2-f3d4-45fb-b1d6-f0fe732592d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:51.998372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-12eed4e2-f3d4-45fb-b1d6-f0fe732592d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:51.999920 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1396/2771] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:21:51 2022] DELETE /identity/v3/projects/cfcaf6c159ea4fb88789953235ce5f67 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:21:52.005196 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa1fd2-08fd-439a-a6f7-50c6a2cccda7 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:52.005485 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa1fd2-08fd-439a-a6f7-50c6a2cccda7 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:52.005759 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa1fd2-08fd-439a-a6f7-50c6a2cccda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:52.025857 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-ecaa1fd2-08fd-439a-a6f7-50c6a2cccda7 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:52.027280 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ecaa1fd2-08fd-439a-a6f7-50c6a2cccda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:52.086822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1376/2772] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:52.094747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec972178-ac37-4428-9ed9-0adcad31ab85 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:52.095036 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec972178-ac37-4428-9ed9-0adcad31ab85 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:52.095313 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec972178-ac37-4428-9ed9-0adcad31ab85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:52.115354 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ec972178-ac37-4428-9ed9-0adcad31ab85 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:52.116578 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ec972178-ac37-4428-9ed9-0adcad31ab85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:52.125001 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1397/2773] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:52.129318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa1fd2-08fd-439a-a6f7-50c6a2cccda7 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:52.139482 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa1fd2-08fd-439a-a6f7-50c6a2cccda7 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:52.144239 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf1794-5b73-4f34-9d9f-b8181cf604dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:52.144894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf1794-5b73-4f34-9d9f-b8181cf604dd admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:52.145177 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf1794-5b73-4f34-9d9f-b8181cf604dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:52.145453 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf1794-5b73-4f34-9d9f-b8181cf604dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:52.146247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf1794-5b73-4f34-9d9f-b8181cf604dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:21:52.146569 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf1794-5b73-4f34-9d9f-b8181cf604dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:52.148288 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf1794-5b73-4f34-9d9f-b8181cf604dd admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:52.160411 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1377/2774] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:21:52.164530 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec972178-ac37-4428-9ed9-0adcad31ab85 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:52.174397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec972178-ac37-4428-9ed9-0adcad31ab85 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:52.179102 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391211fb-e612-4dac-a2e4-f6f92663d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:52.179747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391211fb-e612-4dac-a2e4-f6f92663d4e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:52.180031 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391211fb-e612-4dac-a2e4-f6f92663d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:52.180307 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391211fb-e612-4dac-a2e4-f6f92663d4e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:52.181615 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391211fb-e612-4dac-a2e4-f6f92663d4e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:52.183557 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391211fb-e612-4dac-a2e4-f6f92663d4e6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:52.212358 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1398/2775] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:21:52 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:21:52.216583 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf1794-5b73-4f34-9d9f-b8181cf604dd admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:52.226712 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf1794-5b73-4f34-9d9f-b8181cf604dd admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:52.287781 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca526b1-3805-4f3b-9a2c-33f541843812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:52.288456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca526b1-3805-4f3b-9a2c-33f541843812 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:52.288743 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca526b1-3805-4f3b-9a2c-33f541843812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:52.289023 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca526b1-3805-4f3b-9a2c-33f541843812 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:52.289716 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca526b1-3805-4f3b-9a2c-33f541843812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:52.292175 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca526b1-3805-4f3b-9a2c-33f541843812 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:52.299971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:52.315330 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1378/2776] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:21:52 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:21:52.319992 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391211fb-e612-4dac-a2e4-f6f92663d4e6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:52.330282 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391211fb-e612-4dac-a2e4-f6f92663d4e6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:52.334865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312fa69-5499-47c0-8022-3e0f50d07053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:52.335523 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312fa69-5499-47c0-8022-3e0f50d07053 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:52.335792 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312fa69-5499-47c0-8022-3e0f50d07053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:52.336070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312fa69-5499-47c0-8022-3e0f50d07053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:52.336787 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312fa69-5499-47c0-8022-3e0f50d07053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:52.338450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312fa69-5499-47c0-8022-3e0f50d07053 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:52.348216 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1399/2777] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:21:52.352043 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca526b1-3805-4f3b-9a2c-33f541843812 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:52.362698 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca526b1-3805-4f3b-9a2c-33f541843812 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:52.368208 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91edb7-b393-4180-b88d-536c7d8fe3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:52.369496 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91edb7-b393-4180-b88d-536c7d8fe3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:52.369784 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91edb7-b393-4180-b88d-536c7d8fe3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:52.370096 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91edb7-b393-4180-b88d-536c7d8fe3f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:52.370831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91edb7-b393-4180-b88d-536c7d8fe3f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:52.372443 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91edb7-b393-4180-b88d-536c7d8fe3f1 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:52.383710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1379/2778] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:21:52.387886 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312fa69-5499-47c0-8022-3e0f50d07053 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:52.397656 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312fa69-5499-47c0-8022-3e0f50d07053 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:52.403111 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9afc93-1cde-4226-b8a7-72a5c2b420d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:52.403739 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9afc93-1cde-4226-b8a7-72a5c2b420d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:52.404019 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9afc93-1cde-4226-b8a7-72a5c2b420d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:52.404291 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9afc93-1cde-4226-b8a7-72a5c2b420d3 admin admin] PATH_INFO: `/v3/projects/b30ca9e5a5894f7b9a21dde3a895c523/users/d57e5a500ab646448d5b06c623ec01c5/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:52.420355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9afc93-1cde-4226-b8a7-72a5c2b420d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30ca9e5a5894f7b9a21dde3a895c523, user_id=d57e5a500ab646448d5b06c623ec01c5, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:52.423822 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9afc93-1cde-4226-b8a7-72a5c2b420d3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:52.439096 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1400/2779] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:21:52 2022] PUT /identity/v3/projects/b30ca9e5a5894f7b9a21dde3a895c523/users/d57e5a500ab646448d5b06c623ec01c5/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:52.450016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a70ae4-36c5-419a-92f2-0c69dbd136a7 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:52.450316 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a70ae4-36c5-419a-92f2-0c69dbd136a7 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:52.450593 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a70ae4-36c5-419a-92f2-0c69dbd136a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:52.478814 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-10a70ae4-36c5-419a-92f2-0c69dbd136a7 None None] MFA Rules not processed for user `d57e5a500ab646448d5b06c623ec01c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:52.479986 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-10a70ae4-36c5-419a-92f2-0c69dbd136a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:52.546246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1380/2780] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:52.557341 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9afc93-1cde-4226-b8a7-72a5c2b420d3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:52.559018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8c9afc93-1cde-4226-b8a7-72a5c2b420d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:52.632843 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9afc93-1cde-4226-b8a7-72a5c2b420d3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:52.638612 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675c81f-4d37-4bfa-9c6f-a3c4290115d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:52.639270 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675c81f-4d37-4bfa-9c6f-a3c4290115d6 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:52.639553 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675c81f-4d37-4bfa-9c6f-a3c4290115d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:52.639830 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675c81f-4d37-4bfa-9c6f-a3c4290115d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:52.648116 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675c81f-4d37-4bfa-9c6f-a3c4290115d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:52.650233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675c81f-4d37-4bfa-9c6f-a3c4290115d6 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:52.658956 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1401/2781] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:21:55.333341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a70ae4-36c5-419a-92f2-0c69dbd136a7 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:55.392826 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a70ae4-36c5-419a-92f2-0c69dbd136a7 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:55.397356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc109a7-85b5-484b-aed8-dca0c5be16b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:55.398246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc109a7-85b5-484b-aed8-dca0c5be16b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:55.398531 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc109a7-85b5-484b-aed8-dca0c5be16b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:55.398808 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc109a7-85b5-484b-aed8-dca0c5be16b9 admin admin] PATH_INFO: `/v3/users/d57e5a500ab646448d5b06c623ec01c5` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:55.399996 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc109a7-85b5-484b-aed8-dca0c5be16b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57e5a500ab646448d5b06c623ec01c5)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:55.402486 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc109a7-85b5-484b-aed8-dca0c5be16b9 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:55.447836 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6bc109a7-85b5-484b-aed8-dca0c5be16b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57e5a500ab646448d5b06c623ec01c5'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:55.448474 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6bc109a7-85b5-484b-aed8-dca0c5be16b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57e5a500ab646448d5b06c623ec01c5'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:55.449069 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6bc109a7-85b5-484b-aed8-dca0c5be16b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57e5a500ab646448d5b06c623ec01c5'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:55.460557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6bc109a7-85b5-484b-aed8-dca0c5be16b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57e5a500ab646448d5b06c623ec01c5'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:55.465628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:55.468562 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6bc109a7-85b5-484b-aed8-dca0c5be16b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57e5a500ab646448d5b06c623ec01c5'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:55.482367 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1381/2782] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:21:55 2022] DELETE /identity/v3/users/d57e5a500ab646448d5b06c623ec01c5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:55.486850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e100f4-5ce6-452e-9ad4-be93f5ee61c2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:55.487298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e100f4-5ce6-452e-9ad4-be93f5ee61c2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:55.487397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e100f4-5ce6-452e-9ad4-be93f5ee61c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:55.505644 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-51e100f4-5ce6-452e-9ad4-be93f5ee61c2 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:55.506866 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-51e100f4-5ce6-452e-9ad4-be93f5ee61c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:55.564782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1402/2783] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:55.575686 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc109a7-85b5-484b-aed8-dca0c5be16b9 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:55.577229 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6bc109a7-85b5-484b-aed8-dca0c5be16b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:55.635485 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc109a7-85b5-484b-aed8-dca0c5be16b9 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:55.639184 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e504ecf-a518-4abd-905f-4cac473514e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:55.639828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e504ecf-a518-4abd-905f-4cac473514e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:55.640113 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e504ecf-a518-4abd-905f-4cac473514e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:55.640394 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e504ecf-a518-4abd-905f-4cac473514e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:55.649675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e504ecf-a518-4abd-905f-4cac473514e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:55.651138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e504ecf-a518-4abd-905f-4cac473514e4 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:55.660582 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1382/2784] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:21:55.927607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e100f4-5ce6-452e-9ad4-be93f5ee61c2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:55.929089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-51e100f4-5ce6-452e-9ad4-be93f5ee61c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:55.937814 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:55.945229 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e100f4-5ce6-452e-9ad4-be93f5ee61c2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:55.952197 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c08737-fd1a-4d76-8f8b-76e187221d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:55.953080 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c08737-fd1a-4d76-8f8b-76e187221d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:55.953390 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c08737-fd1a-4d76-8f8b-76e187221d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:55.953732 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c08737-fd1a-4d76-8f8b-76e187221d07 admin admin] PATH_INFO: `/v3/projects/b30ca9e5a5894f7b9a21dde3a895c523` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:55.954867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c08737-fd1a-4d76-8f8b-76e187221d07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b30ca9e5a5894f7b9a21dde3a895c523)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:55.956856 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c08737-fd1a-4d76-8f8b-76e187221d07 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:56.003816 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-23c08737-fd1a-4d76-8f8b-76e187221d07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b30ca9e5a5894f7b9a21dde3a895c523', 'request_id': 'req-23c08737-fd1a-4d76-8f8b-76e187221d07'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:56.009386 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-23c08737-fd1a-4d76-8f8b-76e187221d07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b30ca9e5a5894f7b9a21dde3a895c523', 'request_id': 'req-23c08737-fd1a-4d76-8f8b-76e187221d07'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:56.015844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-23c08737-fd1a-4d76-8f8b-76e187221d07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b30ca9e5a5894f7b9a21dde3a895c523', 'request_id': 'req-23c08737-fd1a-4d76-8f8b-76e187221d07'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:56.027979 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-23c08737-fd1a-4d76-8f8b-76e187221d07 admin admin] The token cache is being invalidate because project b30ca9e5a5894f7b9a21dde3a895c523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:21:56.028266 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-23c08737-fd1a-4d76-8f8b-76e187221d07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:56.028883 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-23c08737-fd1a-4d76-8f8b-76e187221d07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:21:56.030431 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1403/2785] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:21:55 2022] DELETE /identity/v3/projects/b30ca9e5a5894f7b9a21dde3a895c523 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:56.035271 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d233f6f-ef0a-40e6-9b39-f06e34f83f12 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:56.035562 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d233f6f-ef0a-40e6-9b39-f06e34f83f12 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:56.035841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d233f6f-ef0a-40e6-9b39-f06e34f83f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:56.056430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-5d233f6f-ef0a-40e6-9b39-f06e34f83f12 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:56.058158 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5d233f6f-ef0a-40e6-9b39-f06e34f83f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:56.115130 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1383/2786] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:56.124659 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e52a2-d8c7-42fc-b94a-a58ddbfe688a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:56.124950 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e52a2-d8c7-42fc-b94a-a58ddbfe688a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:56.125228 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e52a2-d8c7-42fc-b94a-a58ddbfe688a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:56.144349 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ac2e52a2-d8c7-42fc-b94a-a58ddbfe688a None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:56.145556 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ac2e52a2-d8c7-42fc-b94a-a58ddbfe688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:56.153397 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1404/2787] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:56.157472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d233f6f-ef0a-40e6-9b39-f06e34f83f12 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:56.167717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d233f6f-ef0a-40e6-9b39-f06e34f83f12 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:56.172279 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e81f1-597c-45db-b5ff-fcde05de610e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:56.172925 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e81f1-597c-45db-b5ff-fcde05de610e admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:56.173208 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e81f1-597c-45db-b5ff-fcde05de610e admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:56.173509 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e81f1-597c-45db-b5ff-fcde05de610e admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:56.174263 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e81f1-597c-45db-b5ff-fcde05de610e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:21:56.174568 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e81f1-597c-45db-b5ff-fcde05de610e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:56.176152 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e81f1-597c-45db-b5ff-fcde05de610e admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:56.188701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1384/2788] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:21:56.193244 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e52a2-d8c7-42fc-b94a-a58ddbfe688a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:56.202471 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e52a2-d8c7-42fc-b94a-a58ddbfe688a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:56.207166 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc33afb-6732-4c0c-82d3-97e9bf85058e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:56.207805 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc33afb-6732-4c0c-82d3-97e9bf85058e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:56.208087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc33afb-6732-4c0c-82d3-97e9bf85058e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:56.208359 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc33afb-6732-4c0c-82d3-97e9bf85058e admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:56.209049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc33afb-6732-4c0c-82d3-97e9bf85058e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:56.210973 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc33afb-6732-4c0c-82d3-97e9bf85058e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:56.237155 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1405/2789] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:21:56 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:21:56.241161 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e81f1-597c-45db-b5ff-fcde05de610e admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:56.251737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e81f1-597c-45db-b5ff-fcde05de610e admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:56.307766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2168c6-9761-48ba-b74c-48475ecaa357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:56.308456 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2168c6-9761-48ba-b74c-48475ecaa357 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:56.308737 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2168c6-9761-48ba-b74c-48475ecaa357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:56.309008 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2168c6-9761-48ba-b74c-48475ecaa357 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:56.309696 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2168c6-9761-48ba-b74c-48475ecaa357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:56.311628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2168c6-9761-48ba-b74c-48475ecaa357 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:56.331781 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1385/2790] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:21:56 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:21:56.335834 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc33afb-6732-4c0c-82d3-97e9bf85058e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:56.346931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc33afb-6732-4c0c-82d3-97e9bf85058e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:56.351572 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a80cf4-4401-463d-8410-e4c2ffee1f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:56.352228 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a80cf4-4401-463d-8410-e4c2ffee1f72 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:56.352512 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a80cf4-4401-463d-8410-e4c2ffee1f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:56.352790 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a80cf4-4401-463d-8410-e4c2ffee1f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:56.354175 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a80cf4-4401-463d-8410-e4c2ffee1f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:56.355779 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a80cf4-4401-463d-8410-e4c2ffee1f72 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:56.366293 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1406/2791] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:21:56.369730 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2168c6-9761-48ba-b74c-48475ecaa357 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:56.379692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2168c6-9761-48ba-b74c-48475ecaa357 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:56.384282 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a92ffa-ca4b-498d-b20b-d0daf9966641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:56.384928 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a92ffa-ca4b-498d-b20b-d0daf9966641 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:56.385209 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a92ffa-ca4b-498d-b20b-d0daf9966641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:56.385490 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a92ffa-ca4b-498d-b20b-d0daf9966641 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:56.386240 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a92ffa-ca4b-498d-b20b-d0daf9966641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:56.387815 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a92ffa-ca4b-498d-b20b-d0daf9966641 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:56.389037 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:56.400046 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1386/2792] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:21:56.404908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a80cf4-4401-463d-8410-e4c2ffee1f72 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:56.414838 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a80cf4-4401-463d-8410-e4c2ffee1f72 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:56.420513 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8d864-e3b3-4349-b661-1c43917c5992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:56.421467 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8d864-e3b3-4349-b661-1c43917c5992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:56.421752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8d864-e3b3-4349-b661-1c43917c5992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:56.422056 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8d864-e3b3-4349-b661-1c43917c5992 admin admin] PATH_INFO: `/v3/projects/fce925b5f9fa4b76b441df99202980d6/users/5ba5f9d920e24ae8b6aeea0704ee31d7/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:56.436501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8d864-e3b3-4349-b661-1c43917c5992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fce925b5f9fa4b76b441df99202980d6, user_id=5ba5f9d920e24ae8b6aeea0704ee31d7, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:56.439196 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8d864-e3b3-4349-b661-1c43917c5992 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:56.452943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1407/2793] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:21:56 2022] PUT /identity/v3/projects/fce925b5f9fa4b76b441df99202980d6/users/5ba5f9d920e24ae8b6aeea0704ee31d7/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:56.464321 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ebe5e-cfb2-42f1-8313-42cb293ed39d None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:56.464691 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ebe5e-cfb2-42f1-8313-42cb293ed39d None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:56.465067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ebe5e-cfb2-42f1-8313-42cb293ed39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:56.493044 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-751ebe5e-cfb2-42f1-8313-42cb293ed39d None None] MFA Rules not processed for user `5ba5f9d920e24ae8b6aeea0704ee31d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:56.494277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-751ebe5e-cfb2-42f1-8313-42cb293ed39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:56.557633 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1387/2794] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:56.562231 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8d864-e3b3-4349-b661-1c43917c5992 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:56.629168 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8d864-e3b3-4349-b661-1c43917c5992 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:56.633894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94645201-0b2e-4cde-9fff-661b74830138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:56.635112 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94645201-0b2e-4cde-9fff-661b74830138 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:56.635396 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94645201-0b2e-4cde-9fff-661b74830138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:56.635674 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94645201-0b2e-4cde-9fff-661b74830138 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:56.636450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94645201-0b2e-4cde-9fff-661b74830138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:56.638353 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94645201-0b2e-4cde-9fff-661b74830138 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:56.665792 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1408/2795] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:21:56 2022] POST /identity/v3/projects => generated 407 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:21:56.669635 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ebe5e-cfb2-42f1-8313-42cb293ed39d None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:56.680670 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ebe5e-cfb2-42f1-8313-42cb293ed39d None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:56.740207 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec80bd-2310-4222-9db2-e610385b87d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:56.740881 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec80bd-2310-4222-9db2-e610385b87d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:56.741841 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec80bd-2310-4222-9db2-e610385b87d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:56.742162 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec80bd-2310-4222-9db2-e610385b87d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:56.742859 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec80bd-2310-4222-9db2-e610385b87d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:56.744770 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec80bd-2310-4222-9db2-e610385b87d4 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:56.765745 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1388/2796] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:21:56 2022] POST /identity/v3/users => generated 310 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:21:56.769611 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94645201-0b2e-4cde-9fff-661b74830138 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:56.780872 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94645201-0b2e-4cde-9fff-661b74830138 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:56.785614 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd169a-1e6d-4832-bd23-c1d6e007ee76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:56.786311 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd169a-1e6d-4832-bd23-c1d6e007ee76 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:56.786593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd169a-1e6d-4832-bd23-c1d6e007ee76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:56.786865 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd169a-1e6d-4832-bd23-c1d6e007ee76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:56.787592 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd169a-1e6d-4832-bd23-c1d6e007ee76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:56.789251 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd169a-1e6d-4832-bd23-c1d6e007ee76 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:56.790786 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:56.803113 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1409/2797] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:21:56.806851 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec80bd-2310-4222-9db2-e610385b87d4 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:56.817682 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec80bd-2310-4222-9db2-e610385b87d4 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:56.823309 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92988565-0817-49a9-809c-e0da66ffc49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:56.824216 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92988565-0817-49a9-809c-e0da66ffc49f admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:56.824495 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92988565-0817-49a9-809c-e0da66ffc49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:56.824766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92988565-0817-49a9-809c-e0da66ffc49f admin admin] PATH_INFO: `/v3/projects/ba6ce8dc20874bdfbe556b414c751ae0/users/2656fdfc816f456c94a7d22150dcdccf/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:56.842614 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92988565-0817-49a9-809c-e0da66ffc49f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6ce8dc20874bdfbe556b414c751ae0, user_id=2656fdfc816f456c94a7d22150dcdccf, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:56.845742 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92988565-0817-49a9-809c-e0da66ffc49f admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:56.861676 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1389/2798] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:21:56 2022] PUT /identity/v3/projects/ba6ce8dc20874bdfbe556b414c751ae0/users/2656fdfc816f456c94a7d22150dcdccf/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:56.866088 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd169a-1e6d-4832-bd23-c1d6e007ee76 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:56.876429 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd169a-1e6d-4832-bd23-c1d6e007ee76 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:56.933687 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c17c1-ece1-4655-8859-bb02106cdf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:56.934383 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c17c1-ece1-4655-8859-bb02106cdf79 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:56.934670 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c17c1-ece1-4655-8859-bb02106cdf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:56.934949 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c17c1-ece1-4655-8859-bb02106cdf79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:56.935690 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c17c1-ece1-4655-8859-bb02106cdf79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:56.937335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c17c1-ece1-4655-8859-bb02106cdf79 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:56.948591 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1410/2799] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:21:56.952921 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92988565-0817-49a9-809c-e0da66ffc49f admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:56.963921 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92988565-0817-49a9-809c-e0da66ffc49f admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:56.968497 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b7277-85e5-48ae-b332-f958a365b6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:56.969369 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b7277-85e5-48ae-b332-f958a365b6b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:56.969643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b7277-85e5-48ae-b332-f958a365b6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:56.969910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b7277-85e5-48ae-b332-f958a365b6b8 admin admin] PATH_INFO: `/v3/projects/ba6ce8dc20874bdfbe556b414c751ae0/users/2656fdfc816f456c94a7d22150dcdccf/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:56.971921 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b7277-85e5-48ae-b332-f958a365b6b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6ce8dc20874bdfbe556b414c751ae0, user_id=2656fdfc816f456c94a7d22150dcdccf, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:56.974556 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b7277-85e5-48ae-b332-f958a365b6b8 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:56.989861 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1390/2800] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:21:56 2022] PUT /identity/v3/projects/ba6ce8dc20874bdfbe556b414c751ae0/users/2656fdfc816f456c94a7d22150dcdccf/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:21:57.000247 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167ef6f-7be7-4197-8721-1a946abc76d8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:57.000427 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167ef6f-7be7-4197-8721-1a946abc76d8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:57.000692 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167ef6f-7be7-4197-8721-1a946abc76d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:57.029391 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d167ef6f-7be7-4197-8721-1a946abc76d8 None None] MFA Rules not processed for user `2656fdfc816f456c94a7d22150dcdccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:21:57.031089 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d167ef6f-7be7-4197-8721-1a946abc76d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:57.105509 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1411/2801] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:21:56 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:21:57.116458 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b7277-85e5-48ae-b332-f958a365b6b8 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:57.118222 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-0c5b7277-85e5-48ae-b332-f958a365b6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:21:57.164423 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:21:57.180995 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b7277-85e5-48ae-b332-f958a365b6b8 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:57.185251 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6cf8d-6fc0-4cab-8f41-820eeec4959b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:57.185905 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6cf8d-6fc0-4cab-8f41-820eeec4959b service cinder] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:57.186222 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6cf8d-6fc0-4cab-8f41-820eeec4959b service cinder] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:57.186504 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6cf8d-6fc0-4cab-8f41-820eeec4959b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:57.195894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6cf8d-6fc0-4cab-8f41-820eeec4959b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:57.197892 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6cf8d-6fc0-4cab-8f41-820eeec4959b service cinder] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:57.207356 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1391/2802] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:57 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:21:57.354240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167ef6f-7be7-4197-8721-1a946abc76d8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:21:57.364330 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167ef6f-7be7-4197-8721-1a946abc76d8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:21:57.367912 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7e026-24b7-4b20-9d37-744e84b4da17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:21:57.368545 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7e026-24b7-4b20-9d37-744e84b4da17 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:21:57.369307 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7e026-24b7-4b20-9d37-744e84b4da17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:21:57.369590 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7e026-24b7-4b20-9d37-744e84b4da17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:21:57.427043 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7e026-24b7-4b20-9d37-744e84b4da17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:21:57.428409 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7e026-24b7-4b20-9d37-744e84b4da17 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:21:57.437968 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1412/2803] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:21:57 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:22:01.657321 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6cf8d-6fc0-4cab-8f41-820eeec4959b service cinder] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:01.658853 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-66b6cf8d-6fc0-4cab-8f41-820eeec4959b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:01.723819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6cf8d-6fc0-4cab-8f41-820eeec4959b service cinder] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:01.728415 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cae7b-7bba-442f-a09c-9b9630abcbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:01.729283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cae7b-7bba-442f-a09c-9b9630abcbc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:01.729552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cae7b-7bba-442f-a09c-9b9630abcbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:01.729824 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cae7b-7bba-442f-a09c-9b9630abcbc7 admin admin] PATH_INFO: `/v3/users/e0b0803a9c0140afa890661a476cc0e2` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:01.731051 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cae7b-7bba-442f-a09c-9b9630abcbc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0b0803a9c0140afa890661a476cc0e2)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:01.732953 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cae7b-7bba-442f-a09c-9b9630abcbc7 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:01.778178 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-8f8cae7b-7bba-442f-a09c-9b9630abcbc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0b0803a9c0140afa890661a476cc0e2'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:01.778827 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-8f8cae7b-7bba-442f-a09c-9b9630abcbc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0b0803a9c0140afa890661a476cc0e2'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:01.779438 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-8f8cae7b-7bba-442f-a09c-9b9630abcbc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0b0803a9c0140afa890661a476cc0e2'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:01.791455 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-8f8cae7b-7bba-442f-a09c-9b9630abcbc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0b0803a9c0140afa890661a476cc0e2'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:01.798584 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-8f8cae7b-7bba-442f-a09c-9b9630abcbc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0b0803a9c0140afa890661a476cc0e2'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:01.811672 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1392/2804] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:22:01 2022] DELETE /identity/v3/users/e0b0803a9c0140afa890661a476cc0e2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:22:01.816458 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81e8a0-411e-4b98-af78-a175d2e55266 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:01.816921 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81e8a0-411e-4b98-af78-a175d2e55266 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:01.817033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81e8a0-411e-4b98-af78-a175d2e55266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:01.836103 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8f81e8a0-411e-4b98-af78-a175d2e55266 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:22:01.837298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8f81e8a0-411e-4b98-af78-a175d2e55266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:01.846216 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:01.895474 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1413/2805] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:22:01.905326 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cae7b-7bba-442f-a09c-9b9630abcbc7 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:01.906819 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-8f8cae7b-7bba-442f-a09c-9b9630abcbc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:01.964967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cae7b-7bba-442f-a09c-9b9630abcbc7 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:01.968654 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380fca8-fbd8-42c3-8f8c-4aaa2af76df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:01.969291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380fca8-fbd8-42c3-8f8c-4aaa2af76df6 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:01.969573 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380fca8-fbd8-42c3-8f8c-4aaa2af76df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:01.969847 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380fca8-fbd8-42c3-8f8c-4aaa2af76df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:01.979292 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380fca8-fbd8-42c3-8f8c-4aaa2af76df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:01.980695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380fca8-fbd8-42c3-8f8c-4aaa2af76df6 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:01.990510 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1393/2806] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:22:02.260105 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81e8a0-411e-4b98-af78-a175d2e55266 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:02.262515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8f81e8a0-411e-4b98-af78-a175d2e55266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:02.283689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81e8a0-411e-4b98-af78-a175d2e55266 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:02.291639 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c10208-432f-451c-90ea-3d7a492b599b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:02.292833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c10208-432f-451c-90ea-3d7a492b599b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:02.293179 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c10208-432f-451c-90ea-3d7a492b599b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:02.293659 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c10208-432f-451c-90ea-3d7a492b599b admin admin] PATH_INFO: `/v3/projects/ce456d774ac94d979848b95cbad77661` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:02.295129 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c10208-432f-451c-90ea-3d7a492b599b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce456d774ac94d979848b95cbad77661)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:02.298336 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c10208-432f-451c-90ea-3d7a492b599b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:02.345744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-44c10208-432f-451c-90ea-3d7a492b599b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce456d774ac94d979848b95cbad77661', 'request_id': 'req-44c10208-432f-451c-90ea-3d7a492b599b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:02.351170 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-44c10208-432f-451c-90ea-3d7a492b599b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce456d774ac94d979848b95cbad77661', 'request_id': 'req-44c10208-432f-451c-90ea-3d7a492b599b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:02.357746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-44c10208-432f-451c-90ea-3d7a492b599b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce456d774ac94d979848b95cbad77661', 'request_id': 'req-44c10208-432f-451c-90ea-3d7a492b599b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:02.369812 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-44c10208-432f-451c-90ea-3d7a492b599b admin admin] The token cache is being invalidate because project ce456d774ac94d979848b95cbad77661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:22:02.370132 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-44c10208-432f-451c-90ea-3d7a492b599b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:02.370775 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-44c10208-432f-451c-90ea-3d7a492b599b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:02.372315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1414/2807] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:22:02 2022] DELETE /identity/v3/projects/ce456d774ac94d979848b95cbad77661 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:22:02.669847 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380fca8-fbd8-42c3-8f8c-4aaa2af76df6 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:02.671359 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-9380fca8-fbd8-42c3-8f8c-4aaa2af76df6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:02.679326 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:02.685927 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380fca8-fbd8-42c3-8f8c-4aaa2af76df6 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:02.743377 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee0c2b-7685-4546-b8d8-34ce770aa660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:02.744190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee0c2b-7685-4546-b8d8-34ce770aa660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:02.744475 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee0c2b-7685-4546-b8d8-34ce770aa660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:02.744749 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee0c2b-7685-4546-b8d8-34ce770aa660 admin admin] PATH_INFO: `/v3/users/5ba5f9d920e24ae8b6aeea0704ee31d7` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:02.745938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee0c2b-7685-4546-b8d8-34ce770aa660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba5f9d920e24ae8b6aeea0704ee31d7)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:02.747942 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee0c2b-7685-4546-b8d8-34ce770aa660 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:02.792485 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-53ee0c2b-7685-4546-b8d8-34ce770aa660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba5f9d920e24ae8b6aeea0704ee31d7'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:02.793129 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-53ee0c2b-7685-4546-b8d8-34ce770aa660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba5f9d920e24ae8b6aeea0704ee31d7'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:02.793825 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-53ee0c2b-7685-4546-b8d8-34ce770aa660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba5f9d920e24ae8b6aeea0704ee31d7'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:02.805416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-53ee0c2b-7685-4546-b8d8-34ce770aa660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba5f9d920e24ae8b6aeea0704ee31d7'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:02.812320 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-53ee0c2b-7685-4546-b8d8-34ce770aa660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba5f9d920e24ae8b6aeea0704ee31d7'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:02.824894 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1394/2808] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:22:02 2022] DELETE /identity/v3/users/5ba5f9d920e24ae8b6aeea0704ee31d7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:22:02.829445 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01f07d-f8ec-4380-83e1-65bd38321f01 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:02.829931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01f07d-f8ec-4380-83e1-65bd38321f01 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:02.830063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01f07d-f8ec-4380-83e1-65bd38321f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:02.849448 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5b01f07d-f8ec-4380-83e1-65bd38321f01 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:22:02.850607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5b01f07d-f8ec-4380-83e1-65bd38321f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:02.907686 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1415/2809] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:22:02.917447 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee0c2b-7685-4546-b8d8-34ce770aa660 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:02.918877 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-53ee0c2b-7685-4546-b8d8-34ce770aa660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:02.976467 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee0c2b-7685-4546-b8d8-34ce770aa660 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:02.980156 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c62bd2-ee78-46d8-a8ea-ad251fec2187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:02.980789 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c62bd2-ee78-46d8-a8ea-ad251fec2187 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:02.981071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c62bd2-ee78-46d8-a8ea-ad251fec2187 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:02.981349 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c62bd2-ee78-46d8-a8ea-ad251fec2187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:02.990312 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c62bd2-ee78-46d8-a8ea-ad251fec2187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:02.991717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c62bd2-ee78-46d8-a8ea-ad251fec2187 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:03.001123 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1395/2810] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:22:03.263350 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01f07d-f8ec-4380-83e1-65bd38321f01 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:03.264837 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5b01f07d-f8ec-4380-83e1-65bd38321f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:03.277467 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01f07d-f8ec-4380-83e1-65bd38321f01 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:03.282125 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d4b8b-adbc-4106-bbd2-c8cae3d847ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:03.282983 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d4b8b-adbc-4106-bbd2-c8cae3d847ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:03.283267 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d4b8b-adbc-4106-bbd2-c8cae3d847ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:03.283543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d4b8b-adbc-4106-bbd2-c8cae3d847ad admin admin] PATH_INFO: `/v3/projects/fce925b5f9fa4b76b441df99202980d6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:03.284804 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d4b8b-adbc-4106-bbd2-c8cae3d847ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=fce925b5f9fa4b76b441df99202980d6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:03.286769 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d4b8b-adbc-4106-bbd2-c8cae3d847ad admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:03.324888 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:03.336075 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f45d4b8b-adbc-4106-bbd2-c8cae3d847ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fce925b5f9fa4b76b441df99202980d6', 'request_id': 'req-f45d4b8b-adbc-4106-bbd2-c8cae3d847ad'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:03.341517 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f45d4b8b-adbc-4106-bbd2-c8cae3d847ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fce925b5f9fa4b76b441df99202980d6', 'request_id': 'req-f45d4b8b-adbc-4106-bbd2-c8cae3d847ad'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:03.348183 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f45d4b8b-adbc-4106-bbd2-c8cae3d847ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fce925b5f9fa4b76b441df99202980d6', 'request_id': 'req-f45d4b8b-adbc-4106-bbd2-c8cae3d847ad'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:03.360484 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f45d4b8b-adbc-4106-bbd2-c8cae3d847ad admin admin] The token cache is being invalidate because project fce925b5f9fa4b76b441df99202980d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:22:03.360767 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f45d4b8b-adbc-4106-bbd2-c8cae3d847ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:03.361382 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f45d4b8b-adbc-4106-bbd2-c8cae3d847ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:03.362965 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1416/2811] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:22:03 2022] DELETE /identity/v3/projects/fce925b5f9fa4b76b441df99202980d6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:22:03.367072 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c62bd2-ee78-46d8-a8ea-ad251fec2187 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:03.377055 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c62bd2-ee78-46d8-a8ea-ad251fec2187 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:03.396837 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:03.435417 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63abcea-b0d7-4739-8022-b8f185daad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:03.436300 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63abcea-b0d7-4739-8022-b8f185daad53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:03.436580 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63abcea-b0d7-4739-8022-b8f185daad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:03.436852 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63abcea-b0d7-4739-8022-b8f185daad53 admin admin] PATH_INFO: `/v3/users/2656fdfc816f456c94a7d22150dcdccf` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:03.438054 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63abcea-b0d7-4739-8022-b8f185daad53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2656fdfc816f456c94a7d22150dcdccf)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:03.439994 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63abcea-b0d7-4739-8022-b8f185daad53 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:03.485801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e63abcea-b0d7-4739-8022-b8f185daad53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2656fdfc816f456c94a7d22150dcdccf'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:03.486475 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e63abcea-b0d7-4739-8022-b8f185daad53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2656fdfc816f456c94a7d22150dcdccf'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:03.487077 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e63abcea-b0d7-4739-8022-b8f185daad53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2656fdfc816f456c94a7d22150dcdccf'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:03.499142 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e63abcea-b0d7-4739-8022-b8f185daad53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2656fdfc816f456c94a7d22150dcdccf'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:03.505896 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-e63abcea-b0d7-4739-8022-b8f185daad53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2656fdfc816f456c94a7d22150dcdccf'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:03.518374 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1396/2812] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:22:03 2022] DELETE /identity/v3/users/2656fdfc816f456c94a7d22150dcdccf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:22:03.787688 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d4b8b-adbc-4106-bbd2-c8cae3d847ad admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:03.789164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f45d4b8b-adbc-4106-bbd2-c8cae3d847ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:03.802798 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d4b8b-adbc-4106-bbd2-c8cae3d847ad admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:03.860598 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdd029-5203-4336-bda2-a0e004f4411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:03.861449 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdd029-5203-4336-bda2-a0e004f4411e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:03.861730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdd029-5203-4336-bda2-a0e004f4411e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:03.862020 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdd029-5203-4336-bda2-a0e004f4411e admin admin] PATH_INFO: `/v3/projects/ba6ce8dc20874bdfbe556b414c751ae0` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:03.863211 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdd029-5203-4336-bda2-a0e004f4411e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba6ce8dc20874bdfbe556b414c751ae0)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:03.865142 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdd029-5203-4336-bda2-a0e004f4411e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:03.909982 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5dcdd029-5203-4336-bda2-a0e004f4411e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba6ce8dc20874bdfbe556b414c751ae0', 'request_id': 'req-5dcdd029-5203-4336-bda2-a0e004f4411e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:03.915473 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5dcdd029-5203-4336-bda2-a0e004f4411e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba6ce8dc20874bdfbe556b414c751ae0', 'request_id': 'req-5dcdd029-5203-4336-bda2-a0e004f4411e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:03.922164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5dcdd029-5203-4336-bda2-a0e004f4411e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba6ce8dc20874bdfbe556b414c751ae0', 'request_id': 'req-5dcdd029-5203-4336-bda2-a0e004f4411e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:03.933891 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5dcdd029-5203-4336-bda2-a0e004f4411e admin admin] The token cache is being invalidate because project ba6ce8dc20874bdfbe556b414c751ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:22:03.934333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5dcdd029-5203-4336-bda2-a0e004f4411e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:03.934967 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5dcdd029-5203-4336-bda2-a0e004f4411e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:03.936665 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1417/2813] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:22:03 2022] DELETE /identity/v3/projects/ba6ce8dc20874bdfbe556b414c751ae0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:22:03.941631 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e797a-6ea6-42b7-ad9d-e79a2a2c2c09 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:03.942115 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e797a-6ea6-42b7-ad9d-e79a2a2c2c09 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:03.942229 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e797a-6ea6-42b7-ad9d-e79a2a2c2c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:03.961313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-9e0e797a-6ea6-42b7-ad9d-e79a2a2c2c09 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:22:03.962549 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-9e0e797a-6ea6-42b7-ad9d-e79a2a2c2c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:04.020342 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1397/2814] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:22:04.030213 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e504f-9a4e-4b22-a54e-8415a95c03a3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:04.030549 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e504f-9a4e-4b22-a54e-8415a95c03a3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:04.030787 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e504f-9a4e-4b22-a54e-8415a95c03a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:04.050435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-381e504f-9a4e-4b22-a54e-8415a95c03a3 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:22:04.051623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-381e504f-9a4e-4b22-a54e-8415a95c03a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:04.059464 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1418/2815] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:22:04.063554 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e797a-6ea6-42b7-ad9d-e79a2a2c2c09 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:04.073427 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e797a-6ea6-42b7-ad9d-e79a2a2c2c09 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:04.077948 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939c3ff-024c-48ce-86b4-1ba815017d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:04.078628 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939c3ff-024c-48ce-86b4-1ba815017d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:04.078912 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939c3ff-024c-48ce-86b4-1ba815017d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:04.079190 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939c3ff-024c-48ce-86b4-1ba815017d06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:04.079919 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939c3ff-024c-48ce-86b4-1ba815017d06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:22:04.080224 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939c3ff-024c-48ce-86b4-1ba815017d06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:04.081811 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939c3ff-024c-48ce-86b4-1ba815017d06 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:04.093643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1398/2816] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:22:04.097695 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e504f-9a4e-4b22-a54e-8415a95c03a3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:04.107372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e504f-9a4e-4b22-a54e-8415a95c03a3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:04.112025 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540278a-b474-4ec7-8aa8-8a8cc73312e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:04.112661 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540278a-b474-4ec7-8aa8-8a8cc73312e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:04.112939 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540278a-b474-4ec7-8aa8-8a8cc73312e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:04.113209 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540278a-b474-4ec7-8aa8-8a8cc73312e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:04.113901 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540278a-b474-4ec7-8aa8-8a8cc73312e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:04.115803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540278a-b474-4ec7-8aa8-8a8cc73312e3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:04.142092 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1419/2817] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:22:04 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:22:04.146086 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939c3ff-024c-48ce-86b4-1ba815017d06 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:04.156657 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939c3ff-024c-48ce-86b4-1ba815017d06 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:04.184269 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:04.213270 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47305f6a-f208-41b6-9f9b-f46ada7f8a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:04.213932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47305f6a-f208-41b6-9f9b-f46ada7f8a33 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:04.214787 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47305f6a-f208-41b6-9f9b-f46ada7f8a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:04.215065 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47305f6a-f208-41b6-9f9b-f46ada7f8a33 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:04.215762 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47305f6a-f208-41b6-9f9b-f46ada7f8a33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:04.217677 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47305f6a-f208-41b6-9f9b-f46ada7f8a33 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:04.237431 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1399/2818] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:22:04 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:22:04.241516 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540278a-b474-4ec7-8aa8-8a8cc73312e3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:04.251699 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540278a-b474-4ec7-8aa8-8a8cc73312e3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:04.256281 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baacfd0-46dd-4c35-9d39-ed72e892f11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:04.256928 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baacfd0-46dd-4c35-9d39-ed72e892f11e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:04.257207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baacfd0-46dd-4c35-9d39-ed72e892f11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:04.257478 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baacfd0-46dd-4c35-9d39-ed72e892f11e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:04.258232 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baacfd0-46dd-4c35-9d39-ed72e892f11e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:04.259815 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baacfd0-46dd-4c35-9d39-ed72e892f11e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:04.270079 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1420/2819] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:22:04.274692 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47305f6a-f208-41b6-9f9b-f46ada7f8a33 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:04.285459 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47305f6a-f208-41b6-9f9b-f46ada7f8a33 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:04.290106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e22c2-1da5-4e26-a8de-773d584d6d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:04.290760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e22c2-1da5-4e26-a8de-773d584d6d48 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:04.291046 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e22c2-1da5-4e26-a8de-773d584d6d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:04.291325 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e22c2-1da5-4e26-a8de-773d584d6d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:04.292054 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e22c2-1da5-4e26-a8de-773d584d6d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:04.293627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e22c2-1da5-4e26-a8de-773d584d6d48 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:04.303557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1400/2820] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:22:04.307594 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baacfd0-46dd-4c35-9d39-ed72e892f11e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:04.317877 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baacfd0-46dd-4c35-9d39-ed72e892f11e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:04.322676 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95a970-f39d-42ab-b62e-c2506b3ef767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:04.324038 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95a970-f39d-42ab-b62e-c2506b3ef767 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:04.324319 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95a970-f39d-42ab-b62e-c2506b3ef767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:04.324605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95a970-f39d-42ab-b62e-c2506b3ef767 admin admin] PATH_INFO: `/v3/projects/4b597f77219e4f029cc657b520c30fb2/users/3c57bc78224a4437bcec6ec4ac0f601a/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:04.336065 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:04.341206 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95a970-f39d-42ab-b62e-c2506b3ef767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b597f77219e4f029cc657b520c30fb2, user_id=3c57bc78224a4437bcec6ec4ac0f601a, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:04.344752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95a970-f39d-42ab-b62e-c2506b3ef767 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:04.357344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1421/2821] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:22:04 2022] PUT /identity/v3/projects/4b597f77219e4f029cc657b520c30fb2/users/3c57bc78224a4437bcec6ec4ac0f601a/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:22:04.367644 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96019ae3-b208-4a4f-8186-229245fb0184 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:04.367940 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96019ae3-b208-4a4f-8186-229245fb0184 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:04.368220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96019ae3-b208-4a4f-8186-229245fb0184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:04.395589 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-96019ae3-b208-4a4f-8186-229245fb0184 None None] MFA Rules not processed for user `3c57bc78224a4437bcec6ec4ac0f601a`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:22:04.396802 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-96019ae3-b208-4a4f-8186-229245fb0184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:04.460813 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1401/2822] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:22:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:22:04.472672 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95a970-f39d-42ab-b62e-c2506b3ef767 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:04.474407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bd95a970-f39d-42ab-b62e-c2506b3ef767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:04.529430 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95a970-f39d-42ab-b62e-c2506b3ef767 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:04.533011 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dd3ec-2f81-4ef2-92ba-1cfb39902701 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:04.533641 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dd3ec-2f81-4ef2-92ba-1cfb39902701 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:04.533928 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dd3ec-2f81-4ef2-92ba-1cfb39902701 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:04.534241 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dd3ec-2f81-4ef2-92ba-1cfb39902701 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:04.542593 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07dd3ec-2f81-4ef2-92ba-1cfb39902701 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:04.543953 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07dd3ec-2f81-4ef2-92ba-1cfb39902701 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:04.552554 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1422/2823] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:22:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:22:04.571997 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96019ae3-b208-4a4f-8186-229245fb0184 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:04.634298 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96019ae3-b208-4a4f-8186-229245fb0184 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:04.639487 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02794cc6-fb41-4fca-ac73-48243d8e9fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:04.640345 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02794cc6-fb41-4fca-ac73-48243d8e9fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:04.640627 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02794cc6-fb41-4fca-ac73-48243d8e9fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:04.640903 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02794cc6-fb41-4fca-ac73-48243d8e9fa5 admin admin] PATH_INFO: `/v3/users/3c57bc78224a4437bcec6ec4ac0f601a` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:04.642136 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02794cc6-fb41-4fca-ac73-48243d8e9fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c57bc78224a4437bcec6ec4ac0f601a)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:04.644051 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02794cc6-fb41-4fca-ac73-48243d8e9fa5 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:04.685112 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:04.690611 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-02794cc6-fb41-4fca-ac73-48243d8e9fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c57bc78224a4437bcec6ec4ac0f601a'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:04.691763 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-02794cc6-fb41-4fca-ac73-48243d8e9fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c57bc78224a4437bcec6ec4ac0f601a'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:04.692889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-02794cc6-fb41-4fca-ac73-48243d8e9fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c57bc78224a4437bcec6ec4ac0f601a'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:04.705560 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-02794cc6-fb41-4fca-ac73-48243d8e9fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c57bc78224a4437bcec6ec4ac0f601a'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:04.712545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-02794cc6-fb41-4fca-ac73-48243d8e9fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c57bc78224a4437bcec6ec4ac0f601a'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:04.725730 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1402/2824] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:22:04 2022] DELETE /identity/v3/users/3c57bc78224a4437bcec6ec4ac0f601a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:22:04.730411 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d4d34-7814-4800-b328-a5db0577ee86 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:04.730730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d4d34-7814-4800-b328-a5db0577ee86 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:04.731006 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d4d34-7814-4800-b328-a5db0577ee86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:04.749804 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b05d4d34-7814-4800-b328-a5db0577ee86 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:22:04.751015 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b05d4d34-7814-4800-b328-a5db0577ee86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:04.808745 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1423/2825] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:22:04.818516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02794cc6-fb41-4fca-ac73-48243d8e9fa5 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:04.819902 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-02794cc6-fb41-4fca-ac73-48243d8e9fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:04.878472 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02794cc6-fb41-4fca-ac73-48243d8e9fa5 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:04.882099 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954c134-5397-4605-897f-9326b9853efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:04.882736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954c134-5397-4605-897f-9326b9853efa service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:04.883016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954c134-5397-4605-897f-9326b9853efa service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:04.883289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954c134-5397-4605-897f-9326b9853efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:04.892151 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954c134-5397-4605-897f-9326b9853efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:04.894288 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954c134-5397-4605-897f-9326b9853efa service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:04.904875 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1403/2826] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:22:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:22:05.166768 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d4d34-7814-4800-b328-a5db0577ee86 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:05.168787 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b05d4d34-7814-4800-b328-a5db0577ee86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:05.180785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d4d34-7814-4800-b328-a5db0577ee86 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:05.186448 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d14021-c16c-4d79-bf7b-a4fd626f36de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:05.187314 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d14021-c16c-4d79-bf7b-a4fd626f36de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:05.187599 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d14021-c16c-4d79-bf7b-a4fd626f36de admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:05.187871 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d14021-c16c-4d79-bf7b-a4fd626f36de admin admin] PATH_INFO: `/v3/projects/4b597f77219e4f029cc657b520c30fb2` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:05.189069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d14021-c16c-4d79-bf7b-a4fd626f36de admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b597f77219e4f029cc657b520c30fb2)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:05.191272 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d14021-c16c-4d79-bf7b-a4fd626f36de admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:05.237781 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-93d14021-c16c-4d79-bf7b-a4fd626f36de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b597f77219e4f029cc657b520c30fb2', 'request_id': 'req-93d14021-c16c-4d79-bf7b-a4fd626f36de'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:05.243098 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-93d14021-c16c-4d79-bf7b-a4fd626f36de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b597f77219e4f029cc657b520c30fb2', 'request_id': 'req-93d14021-c16c-4d79-bf7b-a4fd626f36de'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:05.249611 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-93d14021-c16c-4d79-bf7b-a4fd626f36de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b597f77219e4f029cc657b520c30fb2', 'request_id': 'req-93d14021-c16c-4d79-bf7b-a4fd626f36de'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:05.261501 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-93d14021-c16c-4d79-bf7b-a4fd626f36de admin admin] The token cache is being invalidate because project 4b597f77219e4f029cc657b520c30fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:22:05.261785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-93d14021-c16c-4d79-bf7b-a4fd626f36de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:05.262432 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-93d14021-c16c-4d79-bf7b-a4fd626f36de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:05.263965 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1424/2827] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:22:05 2022] DELETE /identity/v3/projects/4b597f77219e4f029cc657b520c30fb2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:22:05.268788 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74ee3d-8e28-4f56-b2e5-19de5c40c130 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:05.269262 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74ee3d-8e28-4f56-b2e5-19de5c40c130 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:05.269389 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74ee3d-8e28-4f56-b2e5-19de5c40c130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:05.288878 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-ab74ee3d-8e28-4f56-b2e5-19de5c40c130 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:22:05.290103 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-ab74ee3d-8e28-4f56-b2e5-19de5c40c130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:05.348962 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1404/2828] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:22:05.357198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98683d4-0578-47fb-bbe4-15f0e66f13f5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:05.357485 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98683d4-0578-47fb-bbe4-15f0e66f13f5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:05.357758 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98683d4-0578-47fb-bbe4-15f0e66f13f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:05.376892 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e98683d4-0578-47fb-bbe4-15f0e66f13f5 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:22:05.378117 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e98683d4-0578-47fb-bbe4-15f0e66f13f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:05.385905 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1425/2829] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:22:05.389910 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74ee3d-8e28-4f56-b2e5-19de5c40c130 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:05.399521 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74ee3d-8e28-4f56-b2e5-19de5c40c130 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:05.404622 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527b6ae-bd0f-4c4b-aa44-84cb52d7abf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:05.405277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527b6ae-bd0f-4c4b-aa44-84cb52d7abf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:05.405550 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527b6ae-bd0f-4c4b-aa44-84cb52d7abf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:05.405827 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527b6ae-bd0f-4c4b-aa44-84cb52d7abf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:05.406595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527b6ae-bd0f-4c4b-aa44-84cb52d7abf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:22:05.406904 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527b6ae-bd0f-4c4b-aa44-84cb52d7abf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:05.408487 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527b6ae-bd0f-4c4b-aa44-84cb52d7abf4 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:05.420545 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1405/2830] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:22:05.424610 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98683d4-0578-47fb-bbe4-15f0e66f13f5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:05.433681 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98683d4-0578-47fb-bbe4-15f0e66f13f5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:05.438324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb093c-a459-4c87-904d-586703f0e91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:05.438994 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb093c-a459-4c87-904d-586703f0e91b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:05.439274 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb093c-a459-4c87-904d-586703f0e91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:05.439546 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb093c-a459-4c87-904d-586703f0e91b admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:05.440252 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb093c-a459-4c87-904d-586703f0e91b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:05.442470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb093c-a459-4c87-904d-586703f0e91b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:05.447900 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:05.474083 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1426/2831] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:22:05 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:22:05.475527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527b6ae-bd0f-4c4b-aa44-84cb52d7abf4 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:05.486066 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527b6ae-bd0f-4c4b-aa44-84cb52d7abf4 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:05.529613 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:05.542109 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a06cb-8172-4f03-adca-7e32688fb6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:05.543316 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a06cb-8172-4f03-adca-7e32688fb6cb admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:05.543595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a06cb-8172-4f03-adca-7e32688fb6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:05.543867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a06cb-8172-4f03-adca-7e32688fb6cb admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:05.544557 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a06cb-8172-4f03-adca-7e32688fb6cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:05.546487 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a06cb-8172-4f03-adca-7e32688fb6cb admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:05.569723 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1406/2832] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:22:05 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:22:05.570957 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb093c-a459-4c87-904d-586703f0e91b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:05.581167 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb093c-a459-4c87-904d-586703f0e91b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:05.585981 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca0512-74bc-42c6-84a8-b70a187d11c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:05.586708 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca0512-74bc-42c6-84a8-b70a187d11c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:05.586989 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca0512-74bc-42c6-84a8-b70a187d11c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:05.587261 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca0512-74bc-42c6-84a8-b70a187d11c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:05.588018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca0512-74bc-42c6-84a8-b70a187d11c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:05.590198 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca0512-74bc-42c6-84a8-b70a187d11c9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:05.600138 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1427/2833] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:22:05.603726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a06cb-8172-4f03-adca-7e32688fb6cb admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:05.614192 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a06cb-8172-4f03-adca-7e32688fb6cb admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:05.618792 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a865f-5572-4226-82f1-c768ac8992cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:05.619435 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a865f-5572-4226-82f1-c768ac8992cb admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:05.619717 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a865f-5572-4226-82f1-c768ac8992cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:05.619989 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a865f-5572-4226-82f1-c768ac8992cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:05.620735 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a865f-5572-4226-82f1-c768ac8992cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:05.622347 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a865f-5572-4226-82f1-c768ac8992cb admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:05.632766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1407/2834] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:22:05.637451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca0512-74bc-42c6-84a8-b70a187d11c9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:05.647521 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca0512-74bc-42c6-84a8-b70a187d11c9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:05.652811 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c730a15-330b-4762-a1d3-5a2b942bd8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:05.653827 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c730a15-330b-4762-a1d3-5a2b942bd8dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:05.654152 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c730a15-330b-4762-a1d3-5a2b942bd8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:05.654429 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c730a15-330b-4762-a1d3-5a2b942bd8dc admin admin] PATH_INFO: `/v3/projects/386d7b009e6642a9b5e8b3523f93c1ff/users/627f1d7ec5114f5284411f292b68506c/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:05.668818 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c730a15-330b-4762-a1d3-5a2b942bd8dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=386d7b009e6642a9b5e8b3523f93c1ff, user_id=627f1d7ec5114f5284411f292b68506c, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:05.671518 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c730a15-330b-4762-a1d3-5a2b942bd8dc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:05.684289 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1428/2835] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:22:05 2022] PUT /identity/v3/projects/386d7b009e6642a9b5e8b3523f93c1ff/users/627f1d7ec5114f5284411f292b68506c/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:22:05.695654 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a60fd3-2d4c-4290-a13a-e97cd0fd3f76 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:05.695941 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a60fd3-2d4c-4290-a13a-e97cd0fd3f76 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:05.696222 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a60fd3-2d4c-4290-a13a-e97cd0fd3f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:05.725149 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-78a60fd3-2d4c-4290-a13a-e97cd0fd3f76 None None] MFA Rules not processed for user `627f1d7ec5114f5284411f292b68506c`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:22:05.726417 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-78a60fd3-2d4c-4290-a13a-e97cd0fd3f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:05.789289 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1408/2836] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:22:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:22:05.801082 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c730a15-330b-4762-a1d3-5a2b942bd8dc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:05.802803 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1c730a15-330b-4762-a1d3-5a2b942bd8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:05.859316 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c730a15-330b-4762-a1d3-5a2b942bd8dc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:05.862943 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e74f1-bf8d-4cc4-b321-481bdaa581d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52ff8138094d64bce9de60c819ab4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:05.863582 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e74f1-bf8d-4cc4-b321-481bdaa581d3 service glance] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:05.863867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e74f1-bf8d-4cc4-b321-481bdaa581d3 service glance] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:05.864146 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e74f1-bf8d-4cc4-b321-481bdaa581d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:05.872456 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e74f1-bf8d-4cc4-b321-481bdaa581d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:05.873885 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e74f1-bf8d-4cc4-b321-481bdaa581d3 service glance] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:05.882709 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1429/2837] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:22:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:22:15.786416 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:15.878728 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=46,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:28.364482 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a60fd3-2d4c-4290-a13a-e97cd0fd3f76 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:28.425727 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a60fd3-2d4c-4290-a13a-e97cd0fd3f76 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:28.430296 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9d1a4-fc44-4ed3-b7a1-99f6965fe819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:28.431162 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9d1a4-fc44-4ed3-b7a1-99f6965fe819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:28.431446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9d1a4-fc44-4ed3-b7a1-99f6965fe819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:28.431726 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9d1a4-fc44-4ed3-b7a1-99f6965fe819 admin admin] PATH_INFO: `/v3/users/627f1d7ec5114f5284411f292b68506c` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:28.432919 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9d1a4-fc44-4ed3-b7a1-99f6965fe819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=627f1d7ec5114f5284411f292b68506c)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:28.434870 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9d1a4-fc44-4ed3-b7a1-99f6965fe819 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:28.482765 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cbb9d1a4-fc44-4ed3-b7a1-99f6965fe819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627f1d7ec5114f5284411f292b68506c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:28.483434 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cbb9d1a4-fc44-4ed3-b7a1-99f6965fe819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627f1d7ec5114f5284411f292b68506c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:28.484022 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cbb9d1a4-fc44-4ed3-b7a1-99f6965fe819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627f1d7ec5114f5284411f292b68506c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:28.495527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cbb9d1a4-fc44-4ed3-b7a1-99f6965fe819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627f1d7ec5114f5284411f292b68506c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:28.502225 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-cbb9d1a4-fc44-4ed3-b7a1-99f6965fe819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627f1d7ec5114f5284411f292b68506c'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:28.514663 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1409/2838] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:22:28 2022] DELETE /identity/v3/users/627f1d7ec5114f5284411f292b68506c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:22:28.519226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025e566-c90c-429d-bca6-497ac45e8010 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:28.519694 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025e566-c90c-429d-bca6-497ac45e8010 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:28.519793 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025e566-c90c-429d-bca6-497ac45e8010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:28.538678 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0025e566-c90c-429d-bca6-497ac45e8010 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:22:28.539873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0025e566-c90c-429d-bca6-497ac45e8010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:28.597355 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1430/2839] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:22:28.607643 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9d1a4-fc44-4ed3-b7a1-99f6965fe819 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:28.609041 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-cbb9d1a4-fc44-4ed3-b7a1-99f6965fe819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:28.664493 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9d1a4-fc44-4ed3-b7a1-99f6965fe819 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:28.668166 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c292e-2e38-4e5c-9290-f11730739df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:28.668801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c292e-2e38-4e5c-9290-f11730739df1 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:28.669085 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c292e-2e38-4e5c-9290-f11730739df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:28.669363 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c292e-2e38-4e5c-9290-f11730739df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:28.678887 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c292e-2e38-4e5c-9290-f11730739df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:28.680304 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c292e-2e38-4e5c-9290-f11730739df1 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:28.689675 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1410/2840] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:22:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:22:28.956066 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025e566-c90c-429d-bca6-497ac45e8010 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:28.963360 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0025e566-c90c-429d-bca6-497ac45e8010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:28.975766 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025e566-c90c-429d-bca6-497ac45e8010 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:28.980419 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b873889-5e37-41e3-b7d0-fc52b42458e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:28.983450 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b873889-5e37-41e3-b7d0-fc52b42458e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:28.983738 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b873889-5e37-41e3-b7d0-fc52b42458e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:28.984015 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b873889-5e37-41e3-b7d0-fc52b42458e6 admin admin] PATH_INFO: `/v3/projects/386d7b009e6642a9b5e8b3523f93c1ff` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:28.985250 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b873889-5e37-41e3-b7d0-fc52b42458e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=386d7b009e6642a9b5e8b3523f93c1ff)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:28.987275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b873889-5e37-41e3-b7d0-fc52b42458e6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:29.038435 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3b873889-5e37-41e3-b7d0-fc52b42458e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386d7b009e6642a9b5e8b3523f93c1ff', 'request_id': 'req-3b873889-5e37-41e3-b7d0-fc52b42458e6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:29.044344 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3b873889-5e37-41e3-b7d0-fc52b42458e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386d7b009e6642a9b5e8b3523f93c1ff', 'request_id': 'req-3b873889-5e37-41e3-b7d0-fc52b42458e6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:29.050384 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3b873889-5e37-41e3-b7d0-fc52b42458e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386d7b009e6642a9b5e8b3523f93c1ff', 'request_id': 'req-3b873889-5e37-41e3-b7d0-fc52b42458e6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:29.062321 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3b873889-5e37-41e3-b7d0-fc52b42458e6 admin admin] The token cache is being invalidate because project 386d7b009e6642a9b5e8b3523f93c1ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:22:29.063084 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3b873889-5e37-41e3-b7d0-fc52b42458e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:29.063700 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3b873889-5e37-41e3-b7d0-fc52b42458e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:22:29.065226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1431/2841] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:22:28 2022] DELETE /identity/v3/projects/386d7b009e6642a9b5e8b3523f93c1ff => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:22:29.070386 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38495a-155a-426c-ba72-ebe29a759a70 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:29.070680 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38495a-155a-426c-ba72-ebe29a759a70 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:29.070959 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38495a-155a-426c-ba72-ebe29a759a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:29.092235 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-5e38495a-155a-426c-ba72-ebe29a759a70 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:22:29.093461 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5e38495a-155a-426c-ba72-ebe29a759a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:29.109777 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:29.153656 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1411/2842] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:22:29.161879 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230df270-2bff-49ba-bbbe-8bc7f3e252dc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:29.162204 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230df270-2bff-49ba-bbbe-8bc7f3e252dc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:29.162483 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230df270-2bff-49ba-bbbe-8bc7f3e252dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:29.181528 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-230df270-2bff-49ba-bbbe-8bc7f3e252dc None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:22:29.182765 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-230df270-2bff-49ba-bbbe-8bc7f3e252dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:29.191110 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1432/2843] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:22:29.195283 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38495a-155a-426c-ba72-ebe29a759a70 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:29.205361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38495a-155a-426c-ba72-ebe29a759a70 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:29.209904 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48294ca8-e8a4-4407-87df-a0efabbf00c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:29.210595 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48294ca8-e8a4-4407-87df-a0efabbf00c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:29.210873 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48294ca8-e8a4-4407-87df-a0efabbf00c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:29.211142 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48294ca8-e8a4-4407-87df-a0efabbf00c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:29.211867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48294ca8-e8a4-4407-87df-a0efabbf00c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:22:29.212167 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48294ca8-e8a4-4407-87df-a0efabbf00c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:29.213736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48294ca8-e8a4-4407-87df-a0efabbf00c8 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:29.224969 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1412/2844] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:22:29.229016 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230df270-2bff-49ba-bbbe-8bc7f3e252dc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:29.238049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230df270-2bff-49ba-bbbe-8bc7f3e252dc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:29.242669 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bf5b2-9002-486c-b5ce-7b803f545ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:29.243305 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bf5b2-9002-486c-b5ce-7b803f545ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:29.243590 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bf5b2-9002-486c-b5ce-7b803f545ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:29.243863 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bf5b2-9002-486c-b5ce-7b803f545ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:29.244578 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bf5b2-9002-486c-b5ce-7b803f545ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:29.246533 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bf5b2-9002-486c-b5ce-7b803f545ac1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:29.274162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1433/2845] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:22:29 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:22:29.278478 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48294ca8-e8a4-4407-87df-a0efabbf00c8 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:29.288261 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48294ca8-e8a4-4407-87df-a0efabbf00c8 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:29.344071 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c69a2e-a215-4949-84ff-1013ebab465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:29.344736 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c69a2e-a215-4949-84ff-1013ebab465e admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:29.345018 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c69a2e-a215-4949-84ff-1013ebab465e admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:29.345291 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c69a2e-a215-4949-84ff-1013ebab465e admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:29.345984 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c69a2e-a215-4949-84ff-1013ebab465e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:29.347900 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c69a2e-a215-4949-84ff-1013ebab465e admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:29.371056 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1413/2846] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:22:29 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:22:29.372584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bf5b2-9002-486c-b5ce-7b803f545ac1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:29.383326 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bf5b2-9002-486c-b5ce-7b803f545ac1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:29.387944 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe1c22-56d8-4e99-b5f7-6cd419e88468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:29.388601 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe1c22-56d8-4e99-b5f7-6cd419e88468 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:29.388883 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe1c22-56d8-4e99-b5f7-6cd419e88468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:29.389758 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe1c22-56d8-4e99-b5f7-6cd419e88468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:29.390515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe1c22-56d8-4e99-b5f7-6cd419e88468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:29.392120 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe1c22-56d8-4e99-b5f7-6cd419e88468 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:29.402082 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1434/2847] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:22:29.405960 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c69a2e-a215-4949-84ff-1013ebab465e admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:29.415772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c69a2e-a215-4949-84ff-1013ebab465e admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:29.420341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce70dd6-048e-4c69-919b-153371f12372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:29.421015 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce70dd6-048e-4c69-919b-153371f12372 admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:29.421295 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce70dd6-048e-4c69-919b-153371f12372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:29.421567 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce70dd6-048e-4c69-919b-153371f12372 admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:29.422318 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce70dd6-048e-4c69-919b-153371f12372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:29.423915 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce70dd6-048e-4c69-919b-153371f12372 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:29.434395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1414/2848] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:22:29.439324 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe1c22-56d8-4e99-b5f7-6cd419e88468 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:29.449698 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe1c22-56d8-4e99-b5f7-6cd419e88468 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:29.454976 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8c997-8ec7-4c75-8c0e-ccb7cf3019a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:29.455845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8c997-8ec7-4c75-8c0e-ccb7cf3019a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:29.456124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8c997-8ec7-4c75-8c0e-ccb7cf3019a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:29.456394 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8c997-8ec7-4c75-8c0e-ccb7cf3019a3 admin admin] PATH_INFO: `/v3/projects/5a5a50d06858459295eba428b7520244/users/daf8a3c3fc064116b234f6a8696ab2a9/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:29.471318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8c997-8ec7-4c75-8c0e-ccb7cf3019a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5a50d06858459295eba428b7520244, user_id=daf8a3c3fc064116b234f6a8696ab2a9, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:29.473472 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8c997-8ec7-4c75-8c0e-ccb7cf3019a3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:29.485965 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1435/2849] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:22:29 2022] PUT /identity/v3/projects/5a5a50d06858459295eba428b7520244/users/daf8a3c3fc064116b234f6a8696ab2a9/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:22:29.491012 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c41f77-4094-4c4c-aee5-0e9f0b16933c None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:29.491302 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c41f77-4094-4c4c-aee5-0e9f0b16933c None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:29.491598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c41f77-4094-4c4c-aee5-0e9f0b16933c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:29.510463 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-d6c41f77-4094-4c4c-aee5-0e9f0b16933c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:22:29.511679 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-d6c41f77-4094-4c4c-aee5-0e9f0b16933c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:29.571310 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1415/2850] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:22:29.580791 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8c997-8ec7-4c75-8c0e-ccb7cf3019a3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:29.582553 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fae8c997-8ec7-4c75-8c0e-ccb7cf3019a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:29.603490 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:29.641425 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8c997-8ec7-4c75-8c0e-ccb7cf3019a3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:29.645190 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b1ff0-0e33-4f8b-8de1-27284e6421bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:29.645876 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b1ff0-0e33-4f8b-8de1-27284e6421bf service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:29.646206 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b1ff0-0e33-4f8b-8de1-27284e6421bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:29.646482 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b1ff0-0e33-4f8b-8de1-27284e6421bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:29.655638 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b1ff0-0e33-4f8b-8de1-27284e6421bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:29.657116 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b1ff0-0e33-4f8b-8de1-27284e6421bf service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:29.666782 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1436/2851] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:22:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:22:30.324245 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80480efa-8de8-4821-bf14-f2fdad05f55a None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:30.324527 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80480efa-8de8-4821-bf14-f2fdad05f55a None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:30.324805 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80480efa-8de8-4821-bf14-f2fdad05f55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:30.355179 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-80480efa-8de8-4821-bf14-f2fdad05f55a None None] MFA Rules not processed for user `daf8a3c3fc064116b234f6a8696ab2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:22:30.356413 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-80480efa-8de8-4821-bf14-f2fdad05f55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:30.374033 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:30.422418 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1416/2852] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:22:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:22:30.442187 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b1ff0-0e33-4f8b-8de1-27284e6421bf service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:30.443901 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d13b1ff0-0e33-4f8b-8de1-27284e6421bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:30.501873 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b1ff0-0e33-4f8b-8de1-27284e6421bf service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:30.505452 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74bb61-4da4-4f82-9798-82286c68645f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f014af35de5c47ab86ec02ebed360678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:30.506131 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74bb61-4da4-4f82-9798-82286c68645f service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:30.506417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74bb61-4da4-4f82-9798-82286c68645f service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:30.506691 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74bb61-4da4-4f82-9798-82286c68645f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:30.514804 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74bb61-4da4-4f82-9798-82286c68645f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:30.516753 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74bb61-4da4-4f82-9798-82286c68645f service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:30.525381 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1437/2853] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:22:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:22:31.868744 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd22a34-1975-4d9c-bb67-52f622542018 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:31.869265 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd22a34-1975-4d9c-bb67-52f622542018 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:31.869393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd22a34-1975-4d9c-bb67-52f622542018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:31.888016 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-5cd22a34-1975-4d9c-bb67-52f622542018 None None] MFA Rules not processed for user `daf8a3c3fc064116b234f6a8696ab2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:22:31.889217 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5cd22a34-1975-4d9c-bb67-52f622542018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:31.896581 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1417/2854] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:22:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:22:40.521416 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=43 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:41.883361 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=22 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:22:56.891298 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77ce38-83b0-430e-914b-a56277cad866 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:56.891821 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77ce38-83b0-430e-914b-a56277cad866 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:56.891821 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77ce38-83b0-430e-914b-a56277cad866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:56.969126 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7f77ce38-83b0-430e-914b-a56277cad866 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:22:56.970375 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7f77ce38-83b0-430e-914b-a56277cad866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:57.020119 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1438/2855] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 25 12:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:22:57.053646 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd22a34-1975-4d9c-bb67-52f622542018 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:57.055438 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-5cd22a34-1975-4d9c-bb67-52f622542018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:57.195451 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd22a34-1975-4d9c-bb67-52f622542018 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:57.201029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453995a3-b46c-4b0c-b6eb-942edc51836f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:57.201733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453995a3-b46c-4b0c-b6eb-942edc51836f service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:57.202036 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453995a3-b46c-4b0c-b6eb-942edc51836f service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:57.202319 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453995a3-b46c-4b0c-b6eb-942edc51836f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:57.210978 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453995a3-b46c-4b0c-b6eb-942edc51836f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:22:57.212548 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453995a3-b46c-4b0c-b6eb-942edc51836f service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:22:57.222450 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1418/2856] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:22:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:22:59.927835 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e3596-7bd3-45c8-a3f6-0099b456200b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:59.928407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e3596-7bd3-45c8-a3f6-0099b456200b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:59.928407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e3596-7bd3-45c8-a3f6-0099b456200b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:22:59.947845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f94e3596-7bd3-45c8-a3f6-0099b456200b None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:22:59.949047 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f94e3596-7bd3-45c8-a3f6-0099b456200b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:59.956857 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1439/2857] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 25 12:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:22:59.974581 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453995a3-b46c-4b0c-b6eb-942edc51836f service nova] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:22:59.976157 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-453995a3-b46c-4b0c-b6eb-942edc51836f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:22:59.991739 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453995a3-b46c-4b0c-b6eb-942edc51836f service nova] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:22:59.997340 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720aa88-1508-43cc-8006-dc99e1255d57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:22:59.997973 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720aa88-1508-43cc-8006-dc99e1255d57 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:22:59.998286 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720aa88-1508-43cc-8006-dc99e1255d57 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:22:59.998565 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720aa88-1508-43cc-8006-dc99e1255d57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:00.006667 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720aa88-1508-43cc-8006-dc99e1255d57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:23:00.008232 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720aa88-1508-43cc-8006-dc99e1255d57 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:23:00.017698 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1419/2858] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:23:03.187366 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724356c-3a25-4c6a-82a7-809473e54b01 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:03.187931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724356c-3a25-4c6a-82a7-809473e54b01 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:03.187931 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724356c-3a25-4c6a-82a7-809473e54b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:03.207531 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7724356c-3a25-4c6a-82a7-809473e54b01 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:23:03.208728 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7724356c-3a25-4c6a-82a7-809473e54b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:23:03.216543 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1440/2859] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 25 12:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:23:03.240757 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720aa88-1508-43cc-8006-dc99e1255d57 service nova] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:23:03.252197 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720aa88-1508-43cc-8006-dc99e1255d57 service nova] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:23:03.257649 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32ffb3-635d-43c2-a277-1d8736feecd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:23:03.258311 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32ffb3-635d-43c2-a277-1d8736feecd5 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:03.258597 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32ffb3-635d-43c2-a277-1d8736feecd5 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:03.258876 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32ffb3-635d-43c2-a277-1d8736feecd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:03.267088 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32ffb3-635d-43c2-a277-1d8736feecd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:23:03.269143 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32ffb3-635d-43c2-a277-1d8736feecd5 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:23:03.278714 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1420/2860] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:23:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:23:06.270027 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcac4d-7d01-4082-b121-d01da34235c2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:06.270494 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcac4d-7d01-4082-b121-d01da34235c2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:06.270597 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcac4d-7d01-4082-b121-d01da34235c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:06.292207 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e1fcac4d-7d01-4082-b121-d01da34235c2 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:23:06.293417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e1fcac4d-7d01-4082-b121-d01da34235c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:23:06.301270 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1441/2861] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 25 12:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:23:06.317679 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32ffb3-635d-43c2-a277-1d8736feecd5 service nova] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:23:06.328918 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32ffb3-635d-43c2-a277-1d8736feecd5 service nova] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:23:06.334917 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f3d23-d644-4026-88a3-0cff962d5a8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:23:06.335548 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f3d23-d644-4026-88a3-0cff962d5a8b service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:06.335831 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f3d23-d644-4026-88a3-0cff962d5a8b service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:06.336110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f3d23-d644-4026-88a3-0cff962d5a8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:06.344219 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f3d23-d644-4026-88a3-0cff962d5a8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:23:06.345780 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f3d23-d644-4026-88a3-0cff962d5a8b service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:23:06.355801 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1421/2862] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:23:09.423398 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb932e-f89f-4f13-8a68-d6ac8efa55b5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:09.423875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb932e-f89f-4f13-8a68-d6ac8efa55b5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:09.423988 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb932e-f89f-4f13-8a68-d6ac8efa55b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:09.443607 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-eeeb932e-f89f-4f13-8a68-d6ac8efa55b5 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:23:09.444825 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-eeeb932e-f89f-4f13-8a68-d6ac8efa55b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:23:09.452642 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1442/2863] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 25 12:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:23:09.468974 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f3d23-d644-4026-88a3-0cff962d5a8b service nova] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:23:09.480864 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f3d23-d644-4026-88a3-0cff962d5a8b service nova] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:23:09.486352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361cf07-1d05-4a6a-ad1e-0dad0dc67abf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:23:09.486979 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361cf07-1d05-4a6a-ad1e-0dad0dc67abf service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:09.487261 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361cf07-1d05-4a6a-ad1e-0dad0dc67abf service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:09.487554 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361cf07-1d05-4a6a-ad1e-0dad0dc67abf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:09.495546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361cf07-1d05-4a6a-ad1e-0dad0dc67abf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:23:09.497093 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361cf07-1d05-4a6a-ad1e-0dad0dc67abf service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:23:09.506352 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1422/2864] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:23:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:23:12.583683 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5057b2-b770-4cf2-97b4-39c0cddc6068 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:12.584156 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5057b2-b770-4cf2-97b4-39c0cddc6068 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:12.584372 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5057b2-b770-4cf2-97b4-39c0cddc6068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:12.603690 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0a5057b2-b770-4cf2-97b4-39c0cddc6068 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:23:12.604891 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0a5057b2-b770-4cf2-97b4-39c0cddc6068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:23:12.612864 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1443/2865] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 25 12:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:23:12.631131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361cf07-1d05-4a6a-ad1e-0dad0dc67abf service nova] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:23:12.642403 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361cf07-1d05-4a6a-ad1e-0dad0dc67abf service nova] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:23:12.648471 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f5824-f84d-454f-8aa1-9111feabfe6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:23:12.649105 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f5824-f84d-454f-8aa1-9111feabfe6d service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:12.649393 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f5824-f84d-454f-8aa1-9111feabfe6d service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:12.649674 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f5824-f84d-454f-8aa1-9111feabfe6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:12.657863 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f5824-f84d-454f-8aa1-9111feabfe6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:23:12.659518 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f5824-f84d-454f-8aa1-9111feabfe6d service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:23:12.668932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1423/2866] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:23:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:23:22.599069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=60 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:23:22.664761 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=95 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:23:22.676728 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5057b2-b770-4cf2-97b4-39c0cddc6068 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:23:22.678182 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0a5057b2-b770-4cf2-97b4-39c0cddc6068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:23:22.767899 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5057b2-b770-4cf2-97b4-39c0cddc6068 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:23:22.772882 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e1f45-d8da-46a3-8ca3-fbe6fa90f5b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f748b0f6b1433c87012793f0dda307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:23:22.773527 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e1f45-d8da-46a3-8ca3-fbe6fa90f5b5 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:22.773810 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e1f45-d8da-46a3-8ca3-fbe6fa90f5b5 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:22.774124 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e1f45-d8da-46a3-8ca3-fbe6fa90f5b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:22.775894 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-426e1f45-d8da-46a3-8ca3-fbe6fa90f5b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:23:22.787210 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e1f45-d8da-46a3-8ca3-fbe6fa90f5b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:23:22.788784 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e1f45-d8da-46a3-8ca3-fbe6fa90f5b5 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:23:22.798545 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1444/2867] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:23:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:23:27.633285 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860e577-ecc1-4684-bd7f-b94fdf828e24 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:27.633773 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860e577-ecc1-4684-bd7f-b94fdf828e24 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:27.633875 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860e577-ecc1-4684-bd7f-b94fdf828e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:27.654111 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-4860e577-ecc1-4684-bd7f-b94fdf828e24 None None] MFA Rules not processed for user `daf8a3c3fc064116b234f6a8696ab2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:23:27.655297 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-4860e577-ecc1-4684-bd7f-b94fdf828e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:23:27.662076 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1424/2868] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:23:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:23:27.889403 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e1f45-d8da-46a3-8ca3-fbe6fa90f5b5 service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:23:27.890861 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-426e1f45-d8da-46a3-8ca3-fbe6fa90f5b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:23:27.924920 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e1f45-d8da-46a3-8ca3-fbe6fa90f5b5 service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:23:27.929008 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0239d4-9e7f-4fee-9e07-500f71eec7fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:23:27.929642 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0239d4-9e7f-4fee-9e07-500f71eec7fa service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:27.929927 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0239d4-9e7f-4fee-9e07-500f71eec7fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:27.930307 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0239d4-9e7f-4fee-9e07-500f71eec7fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:27.932056 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9e0239d4-9e7f-4fee-9e07-500f71eec7fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:23:27.942079 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0239d4-9e7f-4fee-9e07-500f71eec7fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:23:27.943862 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0239d4-9e7f-4fee-9e07-500f71eec7fa service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:23:27.953807 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1445/2869] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:23:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:23:37.649346 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=3 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:23:37.949239 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=56 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:23:38.123110 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9c1f2-1239-4de2-a8ad-76b6cf48cef6 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:38.123395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9c1f2-1239-4de2-a8ad-76b6cf48cef6 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:38.123672 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9c1f2-1239-4de2-a8ad-76b6cf48cef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:38.142875 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-cdf9c1f2-1239-4de2-a8ad-76b6cf48cef6 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:23:38.144711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-cdf9c1f2-1239-4de2-a8ad-76b6cf48cef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:23:38.152891 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1425/2870] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 25 12:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:23:38.167186 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0239d4-9e7f-4fee-9e07-500f71eec7fa service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:23:38.180747 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0239d4-9e7f-4fee-9e07-500f71eec7fa service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:23:38.186357 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d0785-bf37-4f62-8594-e1ebd35b142d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:23:38.186991 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d0785-bf37-4f62-8594-e1ebd35b142d service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:38.187275 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d0785-bf37-4f62-8594-e1ebd35b142d service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:38.187553 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d0785-bf37-4f62-8594-e1ebd35b142d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:38.195929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d0785-bf37-4f62-8594-e1ebd35b142d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:23:38.197514 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d0785-bf37-4f62-8594-e1ebd35b142d service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:23:38.206890 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1446/2871] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:23:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:23:41.380519 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7de40-634a-4055-afdb-5be7d254d8bd None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:41.381061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7de40-634a-4055-afdb-5be7d254d8bd None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:41.381061 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7de40-634a-4055-afdb-5be7d254d8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:41.400406 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-84f7de40-634a-4055-afdb-5be7d254d8bd None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:23:41.401619 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-84f7de40-634a-4055-afdb-5be7d254d8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:23:41.409525 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1426/2872] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 25 12:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:23:41.425785 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d0785-bf37-4f62-8594-e1ebd35b142d service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:23:41.436859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d0785-bf37-4f62-8594-e1ebd35b142d service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:23:41.442430 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4032af-c303-455b-b4ac-939deefca01c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:23:41.443325 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4032af-c303-455b-b4ac-939deefca01c service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:41.443609 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4032af-c303-455b-b4ac-939deefca01c service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:41.443883 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4032af-c303-455b-b4ac-939deefca01c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:41.452157 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4032af-c303-455b-b4ac-939deefca01c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:23:41.453741 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4032af-c303-455b-b4ac-939deefca01c service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:23:41.463616 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1447/2873] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:23:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:23:44.477204 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39919b65-3dbe-4119-afea-6f2e2d21001c None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:44.477651 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39919b65-3dbe-4119-afea-6f2e2d21001c None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:44.477751 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39919b65-3dbe-4119-afea-6f2e2d21001c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:44.497140 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-39919b65-3dbe-4119-afea-6f2e2d21001c None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:23:44.498405 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-39919b65-3dbe-4119-afea-6f2e2d21001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:23:44.506401 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1427/2874] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 25 12:23:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:23:44.525850 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4032af-c303-455b-b4ac-939deefca01c service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:23:44.536831 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4032af-c303-455b-b4ac-939deefca01c service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:23:44.542789 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cb91d-2c6c-477a-a931-67bbda9da143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:23:44.543413 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cb91d-2c6c-477a-a931-67bbda9da143 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:44.543689 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cb91d-2c6c-477a-a931-67bbda9da143 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:44.543958 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cb91d-2c6c-477a-a931-67bbda9da143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:44.551862 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792cb91d-2c6c-477a-a931-67bbda9da143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:23:44.553595 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792cb91d-2c6c-477a-a931-67bbda9da143 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:23:44.562799 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1448/2875] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:23:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:23:47.628710 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0a15b-8561-4f36-9869-a1334e51ff85 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:47.629203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0a15b-8561-4f36-9869-a1334e51ff85 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:47.629313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0a15b-8561-4f36-9869-a1334e51ff85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:47.648695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-c8d0a15b-8561-4f36-9869-a1334e51ff85 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:23:47.649897 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-c8d0a15b-8561-4f36-9869-a1334e51ff85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:23:47.657799 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1428/2876] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 25 12:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:23:47.689224 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cb91d-2c6c-477a-a931-67bbda9da143 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:23:47.700875 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cb91d-2c6c-477a-a931-67bbda9da143 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:23:47.706596 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81edafb-8416-4993-b539-0da9a33231d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:23:47.707233 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81edafb-8416-4993-b539-0da9a33231d8 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:47.707520 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81edafb-8416-4993-b539-0da9a33231d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:47.707797 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81edafb-8416-4993-b539-0da9a33231d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:47.716413 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81edafb-8416-4993-b539-0da9a33231d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:23:47.717988 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81edafb-8416-4993-b539-0da9a33231d8 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:23:47.728069 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1449/2877] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:23:50.793143 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17362dd1-354c-4230-8052-b083f967d990 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:50.793660 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17362dd1-354c-4230-8052-b083f967d990 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:50.793766 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17362dd1-354c-4230-8052-b083f967d990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:50.812492 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-17362dd1-354c-4230-8052-b083f967d990 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:23:50.813695 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-17362dd1-354c-4230-8052-b083f967d990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:23:50.822180 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1429/2878] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 25 12:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:23:50.838105 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81edafb-8416-4993-b539-0da9a33231d8 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:23:50.849335 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81edafb-8416-4993-b539-0da9a33231d8 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:23:50.854752 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c0487-ab47-42e4-97e5-fe6869770348 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:23:50.855377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c0487-ab47-42e4-97e5-fe6869770348 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:23:50.855658 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c0487-ab47-42e4-97e5-fe6869770348 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:23:50.855929 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c0487-ab47-42e4-97e5-fe6869770348 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:23:50.863845 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c0487-ab47-42e4-97e5-fe6869770348 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:23:50.865418 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c0487-ab47-42e4-97e5-fe6869770348 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:23:50.875119 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1450/2879] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:24:00.807938 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=15 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:24:00.870731 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=30 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:24:18.590284 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17362dd1-354c-4230-8052-b083f967d990 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:18.600104 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17362dd1-354c-4230-8052-b083f967d990 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:18.604812 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50c77e-50b2-42a7-9be1-030809b9fb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:18.605677 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50c77e-50b2-42a7-9be1-030809b9fb99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:18.605958 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50c77e-50b2-42a7-9be1-030809b9fb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:18.606277 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50c77e-50b2-42a7-9be1-030809b9fb99 admin admin] PATH_INFO: `/v3/users/daf8a3c3fc064116b234f6a8696ab2a9` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:18.607477 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50c77e-50b2-42a7-9be1-030809b9fb99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf8a3c3fc064116b234f6a8696ab2a9)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:18.609392 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50c77e-50b2-42a7-9be1-030809b9fb99 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:18.655017 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-1f50c77e-50b2-42a7-9be1-030809b9fb99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf8a3c3fc064116b234f6a8696ab2a9'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:24:18.655603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-1f50c77e-50b2-42a7-9be1-030809b9fb99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf8a3c3fc064116b234f6a8696ab2a9'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:24:18.656213 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-1f50c77e-50b2-42a7-9be1-030809b9fb99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf8a3c3fc064116b234f6a8696ab2a9'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:24:18.668185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-1f50c77e-50b2-42a7-9be1-030809b9fb99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf8a3c3fc064116b234f6a8696ab2a9'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:24:18.674899 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-1f50c77e-50b2-42a7-9be1-030809b9fb99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf8a3c3fc064116b234f6a8696ab2a9'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:24:18.687206 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1430/2880] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:24:18 2022] DELETE /identity/v3/users/daf8a3c3fc064116b234f6a8696ab2a9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:24:18.860629 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c0487-ab47-42e4-97e5-fe6869770348 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:18.872833 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c0487-ab47-42e4-97e5-fe6869770348 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:18.929031 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51fcfc-18ab-40aa-a2c9-ac505d071f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:18.930357 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51fcfc-18ab-40aa-a2c9-ac505d071f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:18.930637 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51fcfc-18ab-40aa-a2c9-ac505d071f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:18.930909 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51fcfc-18ab-40aa-a2c9-ac505d071f75 admin admin] PATH_INFO: `/v3/projects/5a5a50d06858459295eba428b7520244` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:18.932087 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51fcfc-18ab-40aa-a2c9-ac505d071f75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a5a50d06858459295eba428b7520244)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:18.934031 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51fcfc-18ab-40aa-a2c9-ac505d071f75 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:18.978884 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bf51fcfc-18ab-40aa-a2c9-ac505d071f75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a5a50d06858459295eba428b7520244', 'request_id': 'req-bf51fcfc-18ab-40aa-a2c9-ac505d071f75'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:24:18.984631 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bf51fcfc-18ab-40aa-a2c9-ac505d071f75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a5a50d06858459295eba428b7520244', 'request_id': 'req-bf51fcfc-18ab-40aa-a2c9-ac505d071f75'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:24:18.990730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bf51fcfc-18ab-40aa-a2c9-ac505d071f75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a5a50d06858459295eba428b7520244', 'request_id': 'req-bf51fcfc-18ab-40aa-a2c9-ac505d071f75'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:24:19.003143 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bf51fcfc-18ab-40aa-a2c9-ac505d071f75 admin admin] The token cache is being invalidate because project 5a5a50d06858459295eba428b7520244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:24:19.003461 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bf51fcfc-18ab-40aa-a2c9-ac505d071f75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:24:19.004088 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bf51fcfc-18ab-40aa-a2c9-ac505d071f75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:24:19.005651 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1451/2881] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:24:18 2022] DELETE /identity/v3/projects/5a5a50d06858459295eba428b7520244 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:24:19.011273 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a94cb-f766-406a-bae4-e1da88360a19 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:19.011572 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a94cb-f766-406a-bae4-e1da88360a19 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:19.011856 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a94cb-f766-406a-bae4-e1da88360a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:19.031013 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-579a94cb-f766-406a-bae4-e1da88360a19 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:24:19.032220 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-579a94cb-f766-406a-bae4-e1da88360a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:24:19.091362 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1431/2882] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:24:19.099333 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5abc46-7d53-48a7-a919-99ddc57fad71 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:19.099623 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5abc46-7d53-48a7-a919-99ddc57fad71 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:19.099906 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5abc46-7d53-48a7-a919-99ddc57fad71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:19.119574 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ab5abc46-7d53-48a7-a919-99ddc57fad71 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:24:19.120809 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ab5abc46-7d53-48a7-a919-99ddc57fad71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:24:19.130386 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1452/2883] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:24:19.136469 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a94cb-f766-406a-bae4-e1da88360a19 None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:19.147384 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a94cb-f766-406a-bae4-e1da88360a19 None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:19.151623 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d4b51-0f65-4fdd-9c87-82b2f01310ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:19.152305 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d4b51-0f65-4fdd-9c87-82b2f01310ae admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:19.152590 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d4b51-0f65-4fdd-9c87-82b2f01310ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:19.152867 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d4b51-0f65-4fdd-9c87-82b2f01310ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:19.153601 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d4b51-0f65-4fdd-9c87-82b2f01310ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:24:19.153908 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d4b51-0f65-4fdd-9c87-82b2f01310ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:19.155562 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d4b51-0f65-4fdd-9c87-82b2f01310ae admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:19.167247 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1432/2884] 10.222.0.48 () {58 vars in 1153 bytes} [Mon Jul 25 12:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:24:19.171371 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5abc46-7d53-48a7-a919-99ddc57fad71 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:19.181248 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5abc46-7d53-48a7-a919-99ddc57fad71 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:19.185921 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0e5b3-f844-4319-ae09-db5cd77447de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:19.186605 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0e5b3-f844-4319-ae09-db5cd77447de admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:19.186885 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0e5b3-f844-4319-ae09-db5cd77447de admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:19.187157 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0e5b3-f844-4319-ae09-db5cd77447de admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:19.187847 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0e5b3-f844-4319-ae09-db5cd77447de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:19.189725 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0e5b3-f844-4319-ae09-db5cd77447de admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:19.216810 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1453/2885] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:24:19 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:24:19.220615 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d4b51-0f65-4fdd-9c87-82b2f01310ae admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:19.230932 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d4b51-0f65-4fdd-9c87-82b2f01310ae admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:19.287106 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e970bd-33dc-41ca-8f6b-65d2788bc816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:19.287772 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e970bd-33dc-41ca-8f6b-65d2788bc816 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:19.288056 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e970bd-33dc-41ca-8f6b-65d2788bc816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:19.288332 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e970bd-33dc-41ca-8f6b-65d2788bc816 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:19.289574 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e970bd-33dc-41ca-8f6b-65d2788bc816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:19.291515 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e970bd-33dc-41ca-8f6b-65d2788bc816 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:19.299603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:24:19.314889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1433/2886] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:24:19 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:24:19.319347 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0e5b3-f844-4319-ae09-db5cd77447de admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:19.329705 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0e5b3-f844-4319-ae09-db5cd77447de admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:19.334620 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d023b78-38db-4b06-89ce-4a955169319b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:19.335283 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d023b78-38db-4b06-89ce-4a955169319b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:19.335584 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d023b78-38db-4b06-89ce-4a955169319b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:19.335854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d023b78-38db-4b06-89ce-4a955169319b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:19.336572 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d023b78-38db-4b06-89ce-4a955169319b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:19.338196 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d023b78-38db-4b06-89ce-4a955169319b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:19.348063 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1454/2887] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:24:19.352395 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e970bd-33dc-41ca-8f6b-65d2788bc816 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:19.362565 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e970bd-33dc-41ca-8f6b-65d2788bc816 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:19.367885 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5042ef-89aa-471a-a15b-79e91699923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:19.368546 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5042ef-89aa-471a-a15b-79e91699923c admin admin] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:19.368828 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5042ef-89aa-471a-a15b-79e91699923c admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:19.369105 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5042ef-89aa-471a-a15b-79e91699923c admin admin] PATH_INFO: `/v3/roles` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:19.369829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5042ef-89aa-471a-a15b-79e91699923c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:19.371466 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5042ef-89aa-471a-a15b-79e91699923c admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:19.382048 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1434/2888] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:24:19.385990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d023b78-38db-4b06-89ce-4a955169319b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:19.395826 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d023b78-38db-4b06-89ce-4a955169319b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:19.400464 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47249998-fa6d-4487-aee7-e658ef208751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:19.401337 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47249998-fa6d-4487-aee7-e658ef208751 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:19.401619 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47249998-fa6d-4487-aee7-e658ef208751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:19.401892 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47249998-fa6d-4487-aee7-e658ef208751 admin admin] PATH_INFO: `/v3/projects/5c974c6e0639478e89b8a0fc6d12cf43/users/af42bdec664c4ae2aae1af8accf5653d/roles/ae11679806844c6f8d55ce5ccb32ee8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:19.417236 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47249998-fa6d-4487-aee7-e658ef208751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c974c6e0639478e89b8a0fc6d12cf43, user_id=af42bdec664c4ae2aae1af8accf5653d, role_id=ae11679806844c6f8d55ce5ccb32ee8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:19.419914 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47249998-fa6d-4487-aee7-e658ef208751 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:19.433424 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1455/2889] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:24:19 2022] PUT /identity/v3/projects/5c974c6e0639478e89b8a0fc6d12cf43/users/af42bdec664c4ae2aae1af8accf5653d/roles/ae11679806844c6f8d55ce5ccb32ee8b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:24:19.438478 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610fa9b-0f4b-45c7-9d95-7669a0196a42 None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:19.438774 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610fa9b-0f4b-45c7-9d95-7669a0196a42 None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:19.439055 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610fa9b-0f4b-45c7-9d95-7669a0196a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:19.458431 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-e610fa9b-0f4b-45c7-9d95-7669a0196a42 None None] MFA Rules not processed for user `2482f101e58a43bca5e9411a6d355e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:24:19.459641 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-e610fa9b-0f4b-45c7-9d95-7669a0196a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:24:19.518983 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1435/2890] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:24:19.528730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47249998-fa6d-4487-aee7-e658ef208751 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:19.530441 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-47249998-fa6d-4487-aee7-e658ef208751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:24:19.561035 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:24:19.589470 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47249998-fa6d-4487-aee7-e658ef208751 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:19.593082 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d346cd4-00cc-4fbd-966c-d11a56431878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:19.593718 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d346cd4-00cc-4fbd-966c-d11a56431878 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:19.594018 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d346cd4-00cc-4fbd-966c-d11a56431878 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:19.594315 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d346cd4-00cc-4fbd-966c-d11a56431878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:19.603796 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d346cd4-00cc-4fbd-966c-d11a56431878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:19.605221 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d346cd4-00cc-4fbd-966c-d11a56431878 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:19.614561 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1456/2891] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:24:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:24:23.486837 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2154f-9937-4595-a7df-7c3a8426bb2f None None] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:23.487355 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2154f-9937-4595-a7df-7c3a8426bb2f None None] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:23.487454 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2154f-9937-4595-a7df-7c3a8426bb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:23.518528 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.auth.core [None req-0fe2154f-9937-4595-a7df-7c3a8426bb2f None None] MFA Rules not processed for user `af42bdec664c4ae2aae1af8accf5653d`. Rule list: `[]` (Enabled: `True`). {{(pid=80317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:24:23.519704 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-0fe2154f-9937-4595-a7df-7c3a8426bb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:24:23.601199 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1436/2892] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:24:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:24:23.605515 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d346cd4-00cc-4fbd-966c-d11a56431878 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:23.615643 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d346cd4-00cc-4fbd-966c-d11a56431878 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:23.620817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf4e4c-dcba-482d-bf7e-4b6afad8d49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:23.621537 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf4e4c-dcba-482d-bf7e-4b6afad8d49e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:23.621945 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf4e4c-dcba-482d-bf7e-4b6afad8d49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:23.622134 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf4e4c-dcba-482d-bf7e-4b6afad8d49e admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:23.622854 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf4e4c-dcba-482d-bf7e-4b6afad8d49e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:23.624786 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf4e4c-dcba-482d-bf7e-4b6afad8d49e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:23.655040 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1457/2893] 10.222.0.48 () {60 vars in 1153 bytes} [Mon Jul 25 12:24:23 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:24:23.659213 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2154f-9937-4595-a7df-7c3a8426bb2f None None] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:23.670862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2154f-9937-4595-a7df-7c3a8426bb2f None None] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:23.730820 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05cfee-e213-4b3e-a784-bcc0b8c24598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:23.731573 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05cfee-e213-4b3e-a784-bcc0b8c24598 admin admin] REQUEST_METHOD: `POST` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:23.731860 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05cfee-e213-4b3e-a784-bcc0b8c24598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:23.732138 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05cfee-e213-4b3e-a784-bcc0b8c24598 admin admin] PATH_INFO: `/v3/users` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:23.732843 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05cfee-e213-4b3e-a784-bcc0b8c24598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:23.734807 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05cfee-e213-4b3e-a784-bcc0b8c24598 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:23.752701 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:24:23.762711 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1437/2894] 10.222.0.48 () {60 vars in 1144 bytes} [Mon Jul 25 12:24:23 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:24:23.763963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf4e4c-dcba-482d-bf7e-4b6afad8d49e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:23.774757 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf4e4c-dcba-482d-bf7e-4b6afad8d49e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:23.779422 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefa5ae-7528-48c6-8df8-a81b97f1a48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:23.780097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefa5ae-7528-48c6-8df8-a81b97f1a48c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:23.780377 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefa5ae-7528-48c6-8df8-a81b97f1a48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:23.780650 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefa5ae-7528-48c6-8df8-a81b97f1a48c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:23.781383 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefa5ae-7528-48c6-8df8-a81b97f1a48c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:23.783017 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefa5ae-7528-48c6-8df8-a81b97f1a48c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:23.795024 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1458/2895] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:24:23.799137 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05cfee-e213-4b3e-a784-bcc0b8c24598 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:23.809822 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05cfee-e213-4b3e-a784-bcc0b8c24598 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:23.814967 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3770ce-443a-47e2-8617-3715fdf5914b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:23.815865 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3770ce-443a-47e2-8617-3715fdf5914b admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:23.816157 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3770ce-443a-47e2-8617-3715fdf5914b admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:23.816431 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3770ce-443a-47e2-8617-3715fdf5914b admin admin] PATH_INFO: `/v3/projects/3b9fffac8c7f4fd7907fc6b75507cbe5/users/356598fecfbe45b59363c1de2f88b9e8/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:23.832647 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3770ce-443a-47e2-8617-3715fdf5914b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9fffac8c7f4fd7907fc6b75507cbe5, user_id=356598fecfbe45b59363c1de2f88b9e8, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:23.835378 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3770ce-443a-47e2-8617-3715fdf5914b admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:23.849405 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1438/2896] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:24:23 2022] PUT /identity/v3/projects/3b9fffac8c7f4fd7907fc6b75507cbe5/users/356598fecfbe45b59363c1de2f88b9e8/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:24:23.853992 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefa5ae-7528-48c6-8df8-a81b97f1a48c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:23.865211 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefa5ae-7528-48c6-8df8-a81b97f1a48c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:23.931318 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b486e73-28df-4258-b419-8a2301104f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:23.932023 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b486e73-28df-4258-b419-8a2301104f25 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:23.932306 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b486e73-28df-4258-b419-8a2301104f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:23.932582 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b486e73-28df-4258-b419-8a2301104f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:23.933358 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b486e73-28df-4258-b419-8a2301104f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:23.935038 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b486e73-28df-4258-b419-8a2301104f25 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:23.945240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1459/2897] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 12:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:24:23.949372 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3770ce-443a-47e2-8617-3715fdf5914b admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:23.959813 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3770ce-443a-47e2-8617-3715fdf5914b admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:23.964564 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f8b1a-7904-40f1-9e0c-bacc477f0614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:23.965448 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f8b1a-7904-40f1-9e0c-bacc477f0614 admin admin] REQUEST_METHOD: `PUT` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:23.965728 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f8b1a-7904-40f1-9e0c-bacc477f0614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:23.966092 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f8b1a-7904-40f1-9e0c-bacc477f0614 admin admin] PATH_INFO: `/v3/projects/3b9fffac8c7f4fd7907fc6b75507cbe5/users/356598fecfbe45b59363c1de2f88b9e8/roles/d0665d2cada24a7d9f40ff3e34ef6cb8` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:23.968054 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f8b1a-7904-40f1-9e0c-bacc477f0614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9fffac8c7f4fd7907fc6b75507cbe5, user_id=356598fecfbe45b59363c1de2f88b9e8, role_id=d0665d2cada24a7d9f40ff3e34ef6cb8)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:23.970730 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f8b1a-7904-40f1-9e0c-bacc477f0614 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:23.982111 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1439/2898] 10.222.0.48 () {60 vars in 1483 bytes} [Mon Jul 25 12:24:23 2022] PUT /identity/v3/projects/3b9fffac8c7f4fd7907fc6b75507cbe5/users/356598fecfbe45b59363c1de2f88b9e8/roles/d0665d2cada24a7d9f40ff3e34ef6cb8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:24:28.470172 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc4d66-8cd4-4a21-9f99-9f3e86691e3e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:28.471034 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc4d66-8cd4-4a21-9f99-9f3e86691e3e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:28.471959 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc4d66-8cd4-4a21-9f99-9f3e86691e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:28.514452 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f2fc4d66-8cd4-4a21-9f99-9f3e86691e3e None None] MFA Rules not processed for user `356598fecfbe45b59363c1de2f88b9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:24:28.516136 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f2fc4d66-8cd4-4a21-9f99-9f3e86691e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:24:28.616542 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1460/2899] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:24:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:24:28.637335 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f8b1a-7904-40f1-9e0c-bacc477f0614 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:28.639511 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-974f8b1a-7904-40f1-9e0c-bacc477f0614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:24:28.724685 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f8b1a-7904-40f1-9e0c-bacc477f0614 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:28.730920 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384d82f-4c6e-4357-8ab5-d67e7520bd78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:28.733035 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384d82f-4c6e-4357-8ab5-d67e7520bd78 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:28.733326 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384d82f-4c6e-4357-8ab5-d67e7520bd78 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:28.733606 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384d82f-4c6e-4357-8ab5-d67e7520bd78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:28.795689 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384d82f-4c6e-4357-8ab5-d67e7520bd78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:28.797298 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384d82f-4c6e-4357-8ab5-d67e7520bd78 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:28.808400 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1440/2900] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:24:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:24:29.763049 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b528ddf-1580-4eb4-b8f3-7d384b69064f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:29.763556 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b528ddf-1580-4eb4-b8f3-7d384b69064f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:29.763663 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b528ddf-1580-4eb4-b8f3-7d384b69064f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:29.782859 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0b528ddf-1580-4eb4-b8f3-7d384b69064f None None] MFA Rules not processed for user `af42bdec664c4ae2aae1af8accf5653d`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:24:29.784097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0b528ddf-1580-4eb4-b8f3-7d384b69064f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:24:29.794963 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1461/2901] 10.222.0.48 () {58 vars in 958 bytes} [Mon Jul 25 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:24:38.802846 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:24:39.778033 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:24:48.093084 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384d82f-4c6e-4357-8ab5-d67e7520bd78 service nova] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:48.148871 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384d82f-4c6e-4357-8ab5-d67e7520bd78 service nova] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:48.152466 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fde5b-2359-43cd-b965-ea8396047ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:48.153109 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fde5b-2359-43cd-b965-ea8396047ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:48.153394 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fde5b-2359-43cd-b965-ea8396047ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:48.153672 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fde5b-2359-43cd-b965-ea8396047ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:48.155558 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-e53fde5b-2359-43cd-b965-ea8396047ab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:24:48.169552 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fde5b-2359-43cd-b965-ea8396047ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:48.171087 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fde5b-2359-43cd-b965-ea8396047ab1 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:48.182326 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1441/2902] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:24:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:24:51.789158 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b528ddf-1580-4eb4-b8f3-7d384b69064f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:51.790606 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0b528ddf-1580-4eb4-b8f3-7d384b69064f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:24:51.803164 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b528ddf-1580-4eb4-b8f3-7d384b69064f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:51.806896 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1739900-43b1-47fc-abaa-e80a85cf4be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:51.807915 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1739900-43b1-47fc-abaa-e80a85cf4be3 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:51.808194 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1739900-43b1-47fc-abaa-e80a85cf4be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:51.808465 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1739900-43b1-47fc-abaa-e80a85cf4be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:51.810266 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d1739900-43b1-47fc-abaa-e80a85cf4be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:24:51.823679 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1739900-43b1-47fc-abaa-e80a85cf4be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:51.825097 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1739900-43b1-47fc-abaa-e80a85cf4be3 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:51.836162 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1462/2903] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:24:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:24:55.642045 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fde5b-2359-43cd-b965-ea8396047ab1 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:24:55.650637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fde5b-2359-43cd-b965-ea8396047ab1 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:24:55.654249 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2a56d-b6ae-479b-8ba7-d28207ad66b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:24:55.654883 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2a56d-b6ae-479b-8ba7-d28207ad66b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:24:55.655164 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2a56d-b6ae-479b-8ba7-d28207ad66b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:24:55.655441 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2a56d-b6ae-479b-8ba7-d28207ad66b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:24:55.664227 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2a56d-b6ae-479b-8ba7-d28207ad66b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:24:55.665636 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2a56d-b6ae-479b-8ba7-d28207ad66b3 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:24:55.675027 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1442/2904] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:24:55 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:25:01.831201 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:25:05.670848 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=32 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:25:55.499716 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1739900-43b1-47fc-abaa-e80a85cf4be3 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:25:55.509191 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1739900-43b1-47fc-abaa-e80a85cf4be3 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:25:55.512870 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecf3f6-6163-4b11-a96a-51d063aaa44f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:25:55.513508 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecf3f6-6163-4b11-a96a-51d063aaa44f service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:25:55.513792 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecf3f6-6163-4b11-a96a-51d063aaa44f service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:25:55.514104 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecf3f6-6163-4b11-a96a-51d063aaa44f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:25:55.515867 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-10ecf3f6-6163-4b11-a96a-51d063aaa44f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:25:55.525281 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecf3f6-6163-4b11-a96a-51d063aaa44f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:25:55.526771 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecf3f6-6163-4b11-a96a-51d063aaa44f service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:25:55.534759 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1463/2905] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:25:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:26:05.531141 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:27:07.967131 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2a56d-b6ae-479b-8ba7-d28207ad66b3 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:27:07.976230 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2a56d-b6ae-479b-8ba7-d28207ad66b3 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:27:07.980598 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763331be-726d-44de-87d5-60c673ddca45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:27:07.981313 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763331be-726d-44de-87d5-60c673ddca45 service neutron] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:27:07.981669 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763331be-726d-44de-87d5-60c673ddca45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:27:07.982068 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763331be-726d-44de-87d5-60c673ddca45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:27:07.983937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-763331be-726d-44de-87d5-60c673ddca45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:27:07.994430 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763331be-726d-44de-87d5-60c673ddca45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:27:07.995875 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763331be-726d-44de-87d5-60c673ddca45 service neutron] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:27:08.004200 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1443/2906] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:27:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:27:08.103913 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecf3f6-6163-4b11-a96a-51d063aaa44f service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:27:08.112958 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecf3f6-6163-4b11-a96a-51d063aaa44f service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:27:08.116633 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b87251-a415-4af6-8409-9f26a5f47dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbc9fad7089b4c95ac92e846d46cb5a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:27:08.117274 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b87251-a415-4af6-8409-9f26a5f47dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:27:08.117588 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b87251-a415-4af6-8409-9f26a5f47dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:27:08.117863 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b87251-a415-4af6-8409-9f26a5f47dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:27:08.124438 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-09b87251-a415-4af6-8409-9f26a5f47dc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:27:08.137985 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b87251-a415-4af6-8409-9f26a5f47dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:27:08.139440 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b87251-a415-4af6-8409-9f26a5f47dc8 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:27:08.150677 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1464/2907] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:27:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:27:08.210375 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763331be-726d-44de-87d5-60c673ddca45 service neutron] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:27:08.211821 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-763331be-726d-44de-87d5-60c673ddca45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:27:08.279764 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763331be-726d-44de-87d5-60c673ddca45 service neutron] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:27:08.284803 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62174d43-1c0a-47f1-a27a-5615b4a1d601 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f748b0f6b1433c87012793f0dda307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:27:08.285446 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62174d43-1c0a-47f1-a27a-5615b4a1d601 service placement] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:27:08.285760 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62174d43-1c0a-47f1-a27a-5615b4a1d601 service placement] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:27:08.286067 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62174d43-1c0a-47f1-a27a-5615b4a1d601 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:27:08.287829 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-62174d43-1c0a-47f1-a27a-5615b4a1d601 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:27:08.300460 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62174d43-1c0a-47f1-a27a-5615b4a1d601 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:27:08.302043 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62174d43-1c0a-47f1-a27a-5615b4a1d601 service placement] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:27:08.312185 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1444/2908] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:27:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:27:11.456999 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b87251-a415-4af6-8409-9f26a5f47dc8 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:27:11.458597 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-09b87251-a415-4af6-8409-9f26a5f47dc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:27:11.472783 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b87251-a415-4af6-8409-9f26a5f47dc8 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:27:11.480405 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08e983-4874-4a16-9923-06e21628a763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:27:11.481282 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08e983-4874-4a16-9923-06e21628a763 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:27:11.481388 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08e983-4874-4a16-9923-06e21628a763 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:27:11.481576 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08e983-4874-4a16-9923-06e21628a763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:27:11.483407 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fb08e983-4874-4a16-9923-06e21628a763 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:27:11.498778 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08e983-4874-4a16-9923-06e21628a763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:27:11.500414 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08e983-4874-4a16-9923-06e21628a763 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:27:11.514458 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1465/2909] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:27:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:27:18.307664 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=38 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:27:21.509240 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=12 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:28:29.095317 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62174d43-1c0a-47f1-a27a-5615b4a1d601 service placement] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:28:29.111977 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62174d43-1c0a-47f1-a27a-5615b4a1d601 service placement] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:28:29.118889 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2f66a-f3e7-4b32-bb3a-9870f731c142 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9db26891a04b0bb7e655c21feeffdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:28:29.119637 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2f66a-f3e7-4b32-bb3a-9870f731c142 service nova] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:28:29.119954 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2f66a-f3e7-4b32-bb3a-9870f731c142 service nova] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:28:29.120269 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2f66a-f3e7-4b32-bb3a-9870f731c142 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:28:29.122562 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-0bc2f66a-f3e7-4b32-bb3a-9870f731c142 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:28:29.135066 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2f66a-f3e7-4b32-bb3a-9870f731c142 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:28:29.136634 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2f66a-f3e7-4b32-bb3a-9870f731c142 service nova] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:28:29.148516 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1445/2910] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:28:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:28:31.862653 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08e983-4874-4a16-9923-06e21628a763 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:28:31.864109 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fb08e983-4874-4a16-9923-06e21628a763 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:28:31.880297 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08e983-4874-4a16-9923-06e21628a763 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:28:31.885830 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5b4a2-ec6e-4364-bda2-8f6814f3dcf0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f748b0f6b1433c87012793f0dda307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:28:31.886507 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5b4a2-ec6e-4364-bda2-8f6814f3dcf0 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:28:31.886787 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5b4a2-ec6e-4364-bda2-8f6814f3dcf0 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:28:31.887061 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5b4a2-ec6e-4364-bda2-8f6814f3dcf0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:28:31.888941 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-98e5b4a2-ec6e-4364-bda2-8f6814f3dcf0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:28:31.902348 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5b4a2-ec6e-4364-bda2-8f6814f3dcf0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:28:31.904735 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5b4a2-ec6e-4364-bda2-8f6814f3dcf0 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:28:31.916184 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1466/2911] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:28:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:28:35.891273 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2f66a-f3e7-4b32-bb3a-9870f731c142 service nova] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:28:35.903021 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2f66a-f3e7-4b32-bb3a-9870f731c142 service nova] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:28:35.908252 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8112c3-6f19-4643-8f75-ab6daf9f1261 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f748b0f6b1433c87012793f0dda307', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c80b9db7ace42c0a0cd1f31901599fd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:28:35.908968 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8112c3-6f19-4643-8f75-ab6daf9f1261 service placement] REQUEST_METHOD: `GET` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:28:35.909343 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8112c3-6f19-4643-8f75-ab6daf9f1261 service placement] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:28:35.909698 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8112c3-6f19-4643-8f75-ab6daf9f1261 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:28:35.913344 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6b8112c3-6f19-4643-8f75-ab6daf9f1261 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:28:35.928029 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8112c3-6f19-4643-8f75-ab6daf9f1261 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:28:35.929961 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8112c3-6f19-4643-8f75-ab6daf9f1261 service placement] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:28:35.943062 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1446/2912] 10.222.0.48 () {60 vars in 1365 bytes} [Mon Jul 25 12:28:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:28:39.028029 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5b4a2-ec6e-4364-bda2-8f6814f3dcf0 service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:28:39.099823 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5b4a2-ec6e-4364-bda2-8f6814f3dcf0 service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:28:39.104417 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65162e-9161-431a-a6f7-0072dd5a4f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:28:39.105283 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65162e-9161-431a-a6f7-0072dd5a4f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:28:39.105566 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65162e-9161-431a-a6f7-0072dd5a4f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:28:39.105844 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65162e-9161-431a-a6f7-0072dd5a4f64 admin admin] PATH_INFO: `/v3/users/af42bdec664c4ae2aae1af8accf5653d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:28:39.107070 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65162e-9161-431a-a6f7-0072dd5a4f64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af42bdec664c4ae2aae1af8accf5653d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:28:39.108990 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65162e-9161-431a-a6f7-0072dd5a4f64 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:28:39.154226 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cc65162e-9161-431a-a6f7-0072dd5a4f64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af42bdec664c4ae2aae1af8accf5653d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.154889 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cc65162e-9161-431a-a6f7-0072dd5a4f64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af42bdec664c4ae2aae1af8accf5653d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.155497 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cc65162e-9161-431a-a6f7-0072dd5a4f64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af42bdec664c4ae2aae1af8accf5653d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.167744 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cc65162e-9161-431a-a6f7-0072dd5a4f64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af42bdec664c4ae2aae1af8accf5653d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.174693 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cc65162e-9161-431a-a6f7-0072dd5a4f64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af42bdec664c4ae2aae1af8accf5653d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.187730 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1467/2913] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:28:39 2022] DELETE /identity/v3/users/af42bdec664c4ae2aae1af8accf5653d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:28:39.359038 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8112c3-6f19-4643-8f75-ab6daf9f1261 service placement] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:28:39.370263 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8112c3-6f19-4643-8f75-ab6daf9f1261 service placement] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:28:39.427333 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682198b-f05c-43f4-b50c-6a0d95245fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:28:39.428194 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682198b-f05c-43f4-b50c-6a0d95245fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:28:39.428478 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682198b-f05c-43f4-b50c-6a0d95245fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:28:39.428756 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682198b-f05c-43f4-b50c-6a0d95245fd3 admin admin] PATH_INFO: `/v3/projects/5c974c6e0639478e89b8a0fc6d12cf43` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:28:39.430030 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682198b-f05c-43f4-b50c-6a0d95245fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c974c6e0639478e89b8a0fc6d12cf43)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:28:39.432203 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682198b-f05c-43f4-b50c-6a0d95245fd3 admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:28:39.477616 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6682198b-f05c-43f4-b50c-6a0d95245fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c974c6e0639478e89b8a0fc6d12cf43', 'request_id': 'req-6682198b-f05c-43f4-b50c-6a0d95245fd3'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.485394 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6682198b-f05c-43f4-b50c-6a0d95245fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c974c6e0639478e89b8a0fc6d12cf43', 'request_id': 'req-6682198b-f05c-43f4-b50c-6a0d95245fd3'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.491642 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6682198b-f05c-43f4-b50c-6a0d95245fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c974c6e0639478e89b8a0fc6d12cf43', 'request_id': 'req-6682198b-f05c-43f4-b50c-6a0d95245fd3'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.502341 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6682198b-f05c-43f4-b50c-6a0d95245fd3 admin admin] The token cache is being invalidate because project 5c974c6e0639478e89b8a0fc6d12cf43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:28:39.502624 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6682198b-f05c-43f4-b50c-6a0d95245fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.503246 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-6682198b-f05c-43f4-b50c-6a0d95245fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.504882 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1447/2914] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:28:39 2022] DELETE /identity/v3/projects/5c974c6e0639478e89b8a0fc6d12cf43 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:28:39.508817 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65162e-9161-431a-a6f7-0072dd5a4f64 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:28:39.510270 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cc65162e-9161-431a-a6f7-0072dd5a4f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:28:39.523761 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65162e-9161-431a-a6f7-0072dd5a4f64 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:28:39.577766 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31919d-f935-4bb9-9276-8c7ea2817ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:28:39.578723 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31919d-f935-4bb9-9276-8c7ea2817ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:28:39.579000 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31919d-f935-4bb9-9276-8c7ea2817ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:28:39.579269 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31919d-f935-4bb9-9276-8c7ea2817ef9 admin admin] PATH_INFO: `/v3/users/356598fecfbe45b59363c1de2f88b9e8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:28:39.580451 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31919d-f935-4bb9-9276-8c7ea2817ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=356598fecfbe45b59363c1de2f88b9e8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:28:39.582908 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31919d-f935-4bb9-9276-8c7ea2817ef9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:28:39.587975 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:28:39.627516 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7c31919d-f935-4bb9-9276-8c7ea2817ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '356598fecfbe45b59363c1de2f88b9e8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.628148 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7c31919d-f935-4bb9-9276-8c7ea2817ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '356598fecfbe45b59363c1de2f88b9e8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.628746 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7c31919d-f935-4bb9-9276-8c7ea2817ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '356598fecfbe45b59363c1de2f88b9e8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.640346 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7c31919d-f935-4bb9-9276-8c7ea2817ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '356598fecfbe45b59363c1de2f88b9e8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.648153 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7c31919d-f935-4bb9-9276-8c7ea2817ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '356598fecfbe45b59363c1de2f88b9e8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.660133 dv-cinder-797608-61-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1468/2915] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 12:28:39 2022] DELETE /identity/v3/users/356598fecfbe45b59363c1de2f88b9e8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:28:39.827364 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682198b-f05c-43f4-b50c-6a0d95245fd3 admin admin] Authenticating user token {{(pid=80317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:28:39.828862 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.fernet_utils [None req-6682198b-f05c-43f4-b50c-6a0d95245fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:28:39.842667 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682198b-f05c-43f4-b50c-6a0d95245fd3 admin admin] Validating token access rules against request {{(pid=80317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:28:39.900333 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee5afe-aeb6-45ed-a2b6-52f70b86d24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2482f101e58a43bca5e9411a6d355e61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f6b44ea8df423598fdb5ab7cad5172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:28:39.901178 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee5afe-aeb6-45ed-a2b6-52f70b86d24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:28:39.901458 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee5afe-aeb6-45ed-a2b6-52f70b86d24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:28:39.901733 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee5afe-aeb6-45ed-a2b6-52f70b86d24b admin admin] PATH_INFO: `/v3/projects/3b9fffac8c7f4fd7907fc6b75507cbe5` {{(pid=80317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:28:39.902937 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee5afe-aeb6-45ed-a2b6-52f70b86d24b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9fffac8c7f4fd7907fc6b75507cbe5)` {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:28:39.904868 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee5afe-aeb6-45ed-a2b6-52f70b86d24b admin admin] RBAC: Authorization granted {{(pid=80317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:28:39.910981 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:28:39.951371 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c9ee5afe-aeb6-45ed-a2b6-52f70b86d24b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9fffac8c7f4fd7907fc6b75507cbe5', 'request_id': 'req-c9ee5afe-aeb6-45ed-a2b6-52f70b86d24b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.960338 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c9ee5afe-aeb6-45ed-a2b6-52f70b86d24b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9fffac8c7f4fd7907fc6b75507cbe5', 'request_id': 'req-c9ee5afe-aeb6-45ed-a2b6-52f70b86d24b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.965949 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c9ee5afe-aeb6-45ed-a2b6-52f70b86d24b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9fffac8c7f4fd7907fc6b75507cbe5', 'request_id': 'req-c9ee5afe-aeb6-45ed-a2b6-52f70b86d24b'} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.976681 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c9ee5afe-aeb6-45ed-a2b6-52f70b86d24b admin admin] The token cache is being invalidate because project 3b9fffac8c7f4fd7907fc6b75507cbe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:28:39.976971 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c9ee5afe-aeb6-45ed-a2b6-52f70b86d24b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.977603 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG keystone.notifications [None req-c9ee5afe-aeb6-45ed-a2b6-52f70b86d24b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:28:39.979193 dv-cinder-797608-61-smb devstack@keystone.service[80317]: [pid: 80317|app: 0|req: 1448/2916] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 12:28:39 2022] DELETE /identity/v3/projects/3b9fffac8c7f4fd7907fc6b75507cbe5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:28:49.656680 dv-cinder-797608-61-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:28:49.973672 dv-cinder-797608-61-smb devstack@keystone.service[80317]: DEBUG dbcounter [-] [80317] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}